Strategic Management Review > Vol 6 > Issue 3

Surprises, Conflicting Findings, or Questionable Research Practices? A Methodology for Evaluating Cumulative Empirical Analyses and Replication Studies

Gwendolyn K. Lee, Warrington College of Business, University of Florida, USA, glee@alum.mit.edu
 
Suggested Citation
Gwendolyn K. Lee (2025), "Surprises, Conflicting Findings, or Questionable Research Practices? A Methodology for Evaluating Cumulative Empirical Analyses and Replication Studies", Strategic Management Review: Vol. 6: No. 3, pp 273-292. http://dx.doi.org/10.1561/111.00000081

Publication Date: 22 Apr 2025
© 2025 now Publishers, Inc.
 
Subjects
Research methodology in strategic management
 
Keywords
Science of sciencequestionable research practicesrobustnessreplication studiesrecommendations for peer review and editorial guidelines
 

Share

Download article
In this article:
Introduction 
Surprises, Conflicting Findings, or Questionable Research Practices? 
Abductive Reasoning in the Science of Science 
The Normative Mode of Evaluation 
The Descriptive Mode of Evaluation 
The Prescriptive Mode of Evaluation 
Concluding Remarks: Toward Robust and Reliable Knowledge 
References 

Abstract

Critiques about the research practices that the scholars in strategic management engage in have called out that the field of strategic management appears vulnerable to a credibility crisis. As the field accumulates discrepancies between an initial observation and subsequent observations about a theoretical expectation, how do we know that the discrepancies are surprises, conflicting findings or questionable research practices? Questionable research practices that operate in the ambiguous space between what one might consider best practices and academic misconduct alert the research community to confront the discrepancies. Yet, the field does not have a methodology for diagnosing the root causes of discrepancies in cumulative empirical analyses. In the current article, we propose a methodology that uses abductive reasoning in the evaluation of discrepancies. Abductive reasoning is a process for reacting to discrepancies through model reformulation, revision of hypotheses, and addition of new information. The proposed methodology may aid not only authors, but also journal editors and reviewers, in evaluating discrepancies and assessing the merits of replication studies.

DOI:10.1561/111.00000081