Dear IBERO Colleagues,
The use of control variables is widespread in all management subfields-virtually every published article includes them. But, there are many gray areas, judgment calls, undisclosed practices, and overall lack of transparency in the inclusion/exclusion of controls and how their usage is reported in published articles. These idiosyncratic practices may account for, at least in part, lack of repeatability of empirical results in our field (e.g., see article in press in SMJ titled "Creating repeatable cumulative knowledge in strategic management" by Bettis, Ethiraj, Gambardella, Helfat, and Mitchell).
To help address concerns about control variable usage, we are making the following article just published in Personnel Psychology available at http://mypage.iu.edu/~haguinis/pubs.html (item #125):
· Bernerth, J. & Aguinis, H. 2016. A critical review and best-practice recommendations for control variable usage. Personnel Psychology, 69: 229-283.
We hope these recommendations will be useful for authors and also for journal editors/reviewers as they evaluate manuscripts reporting the use of control variables. The article's Abstract is below and we look forward to a continued dialogue about these and other important methodological issues with clear consequences for substantive conclusions.
All the best,
--Herman.
Abstract
The use of control variables plays a central role in organizational research due to practical difficulties associated with the implementation of experimental and quasi-experimental designs. As such, we conducted an in-depth review and content analysis of what variables and why such variables are controlled for in ten of the most popular research domains in organizational behavior/human resource management (OB/HRM) and applied psychology. Specifically, we examined 580 articles published from 2003 to 2012 in Academy of Management Journal, Administrative Science Quarterly, Journal of Applied Psychology, Journal of Management, and Personnel Psychology. Results indicate that, across research domains with clearly distinct theoretical bases, the overwhelming majority of the more than 3,500 controls identified in our review converge around the same simple demographic factors (i.e., gender, age, tenure), very little effort is made to explain why and how controls relate to focal variables of interest, and control variable practices have not changed much over the past decade. To address these results, we offer best-practice recommendations in the form of a sequence of questions and subsequent steps that can be followed to make decisions on the appropriateness of including a specific control variable within a particular theoretical framework, research domain, and empirical study. Our recommendations can be used by authors as well as journal editors and reviewers to improve the transparency and appropriateness of practices regarding control variable usage.
Herman Aguinis
John F. Mee Chair of Management
Professor of Organizational Behavior and Human Resources
Founding and Managing Director, Institute for Global Organizational Effectiveness
Indiana University
Kelley School of Business
http://mypage.iu.edu/~haguinis/
GO FROM MOMENT TO MOMENTUM