# Pattern Discovery and Validation Using Scientific Research Methods

arXiv: https://arxiv.org/abs/2107.06065 · HTML: https://mlsanity.com/paper/2107.06065/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 2 of its 59 references that are in the map.
- First posted on arXiv 11 Jul 2021.

## Builds on (most cited first, 2 of 2)

- [Sampling in Software Engineering Research: A Critical Review and Guidelines](https://mlsanity.com/paper/2002.07764/) (2020)
- [Challenges in Survey Research](https://mlsanity.com/paper/1908.05899/) (2019)

## Abstract (arXiv)

Pattern discovery, the process of discovering previously unrecognized patterns, is often performed as an ad-hoc process with little resulting certainty in the quality of the proposed patterns. Pattern validation, the process of validating the accuracy of proposed patterns, remains dominated by the simple heuristic of "the rule of three". This article shows how to use established scientific research methods for the purpose of pattern discovery and validation. We present a specific approach, called the handbook method, that uses the qualitative survey, action research, and case study research for pattern discovery and evaluation, and we discuss the underlying principle of using scientific methods in general. We evaluate the handbook method using three exploratory studies and demonstrate its usefulness.