Foundations and Trends® in Accounting > Vol 10 > Issue 2-4

Mostly Useless Econometrics? Assessing the Causal Effect of Econometric Theory

John Rust, Department of Economics, Georgetown University, USA, jr1393@georgetown.edu
 
Suggested Citation
John Rust (2016), "Mostly Useless Econometrics? Assessing the Causal Effect of Econometric Theory", Foundations and Trends® in Accounting: Vol. 10: No. 2-4, pp 125-203. http://dx.doi.org/10.1561/1400000049

Publication Date: 17 Aug 2016
© 2016 J. Rust
 
Subjects
 

Free Preview:

Download extract

Share

Download article
In this article:
1. Introduction
2. Unhealthy Theory Bias at Econometrica?
3. Econometric Theory and Causality
4. Examples of Useful Causal Inference
5. Measuring the Causal Effect of Training Programs
6. Many Paths to Useful Applied Economic Research
7. Towards Mostly Useful Econometrics
Acknowledgements
References

Abstract

Economics is highly invested in sophisticated mathematics and empirical methodologies. Yet the payoff to these investments in terms of uncontroverted empirical knowledge is much less clear. I argue that leading economics journals err by imposing an unrealistic burden of proof on empirical work: there is an obsession with establishing causal relationships that must be proven beyond the shadow of a doubt. It is far easier to publish theoretical econometrics, an increasingly arid subject that meets the burden of mathematical proof. But the overabundance of econometric theory has not paid off in terms of empirical knowledge, and may paradoxically hinder empirical work by obligating empirical researchers to employ the latest methods that are often difficult to understand and use and fail to address the problems that researchers actually confront. I argue that a change in the professional culture and incentives can help econometrics from losing its empirical relevance. Econometric theory needs to be more empirically motivated and problem-driven. Economics journals should lower the burden of proof for empirical work and raise the burden of proof for econometric theory. Specifically, there should be more room for descriptive empirical work in our journals. It should not be necessary to establish a causal mechanism or a non-parametrically identified structural model that provides an unambiguous explanation of empirical phenomena as a litmus test for publication. On the other hand, journals should increase the burden on econometric theory by requiring more of them to show how the new methods they propose are likely to be used and be useful for generating new empirical knowledge.

DOI:10.1561/1400000049
ISBN: 978-1-68083-160-3
338 pp. $99.00
Buy book (pb)
 
ISBN: 978-1-68083-161-0
338 pp. $260.00
Buy E-book (.pdf)
Table of contents:
1. "Causal Inferences in Capital Markets Research" by I. Marinovic
2. "Where’s the Rigor When You Need It?" by N. Cartwright
3. "Mostly Useless Econometrics?" by J. Rust
4. "Just How Sensitive are Instrumental Variable Estimates?" by P. C. Reiss
5. "Interpreting Point Predictions: Some Logical Issues" by C. F. Manski
6. "From Casual to Causal Inference in Accounting Research" by J. Bertomeu, A. Beyer, and D. J. Taylor
7. "Comments and Observations Regarding the Relation Between Theory and Empirical Research in Contemporary Accounting Research" by Q. Chen and K. Schipper
8. "Identification with Models and Exogenous Data Variation" by R. J. Kahn and T. M. Whited
9. "Plausibility" by I. Welch

Causal Inferences in Capital Markets Research

This article is included as a chapter in Causal Inferences in Capital Markets Research.

Causal Inferences in Capital Markets Research is an attempt to promote a broad interdisciplinary debate about the notion of causality and the role of causal inference in the social sciences.

At the risk of oversimplifying, the issue of causality divides the accounting research community in two polar views: the view that causality is an unattainable ideal for the social sciences and must be given up as a standard, and the view that, on one hand, causality should be the ultimate goal of all scientific endeavors and, on the other hand, theory and causal inference are inextricable. Reflecting and discussing these views was the main motivation for this volume. This volume contains eight articles on three topics: I) Econometrics; III) Accounting, and III) Finance.

First, Nancy Cartwright addresses the problem of external validity and the reliability of scientific claims that generalize individual cases. Then, John Rust discusses the role of assumptions in empirical research and the possibility of assumption-free inference. Peter Reiss considers the question how sensitive are instrumental variables to functional form transformations. Finally, Charles Manski studies the logical issues that affect the interpretation of point predictions.

Second, Jeremy Bertomeu, Anne Beyer and Daniel Taylor provide a critical overview of empirical accounting research focusing on the benefits of theory-based estimation, while Qi Chen and Katherine Schipper consider the question whether all research should be causal and assess the existing gap between theory and empirical research in accounting.

Third, R. Jay Kahn and Toni Whited clarifies and contrasts the notions of identification and causality, whereas Ivo Welch adopts a sociology of science approach to understand the consequences of the researchers’ race for discovering novel and surprising results.

This volume allows researchers and Ph.D students in accounting, and the social sciences in general, to acquire a deeper understanding of the notion of causality and the nature, limits, and scope of empirical research in the social sciences.

 
ACC-049

Companion

Causal Inferences in Capital Markets Research: Preface , Foundations and Trends® in Accounting, Volume 10, Issue 2-4 10.1561/1400000040
This preface by editor I. Marinovic also appears in this special issue.

Companion

From Casual to Causal Inference in Accounting Research: The Need for Theoretical Foundations , Foundations and Trends® in Accounting, Volume 10, Issue 2-4 10.1561/1400000044
This article by J. Bertomeu et al. also appears in this special issue.

Companion

Where’s the Rigor When You Need It? , Foundations and Trends® in Accounting, Volume 10, Issue 2-4 10.1561/1400000045
This article by N. Cartwright also appears in this special issue.

Companion

Interpreting Point Predictions: Some Logical Issues , Foundations and Trends® in Accounting, Volume 10, Issue 2-4 10.1561/1400000047
This article by C. F. Manski also appears in this special issue.

Companion

Comments and Observations Regarding the Relation Between Theory and Empirical Research in Contemporary Accounting Research , Foundations and Trends® in Accounting, Volume 10, Issue 2-4 10.1561/1400000046
This article by Q. Chen and K. Schipper also appears in this special issue.

Companion

Just How Sensitive are Instrumental Variable Estimates? , Foundations and Trends® in Accounting, Volume 10, Issue 2-4 10.1561/1400000048
This article by P. C. Reiss also appears in this special issue.

Companion

Plausibility: A Fair & Balanced View of 30 Years of Progress in Ecologics , Foundations and Trends® in Accounting, Volume 10, Issue 2-4 10.1561/1400000050
This article by I. Welch also appears in this special issue.

Companion

Identification with Models and Exogenous Data Variation , Foundations and Trends® in Accounting, Volume 10, Issue 2-4 10.1561/1400000051
This article by R. J. Kahn and T. M. Whited also appears in this special issue.

Companion

Foundations and Trends® in Accounting, Volume 10, Issue 2-4 Causal Inferences in Capital Markets Research: Articles Overiew
See the other articles that are part of this special issue.