Welcome to CARMA’s Webcast

Dr. Jason Colquitt, University of Notre Dame

Quantifying Content Validity

April 9th, 2021 / 12:00 – 1:30 pm ET

PowerPoint Slides

Jason A. Colquitt is the Franklin D. Schurz Professor in the Department of Management & Organization at the University of Notre Dame’s Mendoza College of Business. He received his Ph.D. from Michigan State University’s Eli Broad Graduate School of Management, and earned his B.S. in Psychology from Indiana University. His research interests include justice, trust, and personality. He has published more than forty articles on these and other topics in Academy of Management Journal, Academy of Management Review, Journal of Applied Psychology, Organizational Behavior and Human Decision Processes, and Personnel Psychology. He is a past Editor-in-Chief of Academy of Management Journal and previously served as an Associate Editor for that journal. Professor Colquitt is currently serving on the editorial boards of Academy of Management Journal, Academy of Management Review, and Administrative Science Quarterly. He is a recipient of the Society for Industrial and Organizational Psychology’s Distinguished Early Career Contributions Award and the Cummings Scholar Award for early to mid-career achievement, sponsored by the Organizational Behavior division of the Academy of Management. He also authors one of the top-selling organizational behavior textbooks, now in its seventh edition.


Articles that introduce new measures tend to focus their attention on factor structure, convergent validity, and discriminant validity, with less attention paid to content validity. Moreover, when content validity is examined, there is often ambiguity surrounding the appropriate tests and the standards for acceptability. In this talk, I’ll guide the audience through Colquitt, Sabey, Rodell, and Hill’s (2019) extension of Hinkin and Tracey’s (1999) quantitative approach to content validation. Using a running example, the talk will focus on creating construct definitions, generating items, choosing appropriate orbiting measures, gathering validation data, calculating definitional correspondence, calculating definitional distinctiveness, and applying evaluation criteria. The talk will include all the specific details needed to apply the method, along with a discussion of the judgment calls encountered when doing so.

Access Info

Meeting Link: https://zoom.us/j/99662027121?pwd=bERSeE1kcVF1eUY4Y25oMTA1dkxEZz09

Meeting ID: 996 6202 7121

Meeting Password: 966018

Other CARMA Recordings on Similar Topics

  • Adapting Scales – Dr. Erik Heggestad
  • Dirty Data – Dr. Justin DeSimone
  • Continuum Specification in Construct Validation: A Proposal and Call for Research – Dr. Louis Tay
  • A Tutorial on the Causes, Consequences, and Remedies for Common Method Biases – Dr. Nathan Podsakoff
  • Construct Mixology: Forming New Management Constructs by Combining Old Ones – Dr. Dan Newman
  • Computer Adaptive Assessment of Personality – Dr. Fritz Drasgow
  • Understanding and Detecting Careless Responding in Survey Research – Dr. Adam Meade
  • Variation into Elevation: Diversity Paradigms for Explaining Team and Organizational Outcomes – Dr. David Harrison
  • The Promise and Perils of Wearable Sensors in Organizational Research – Dr. John Hollenbeck
  • Practical Recommendations for Measuring Implicit Constructs Via Conditional Reasoning – Dr. James LeBreton
  • Conditional Reasoning and the Measurement of Power – Dr. Lawrence James
  • Practical Issues in Developing a Measure – Dr. Fred Oswald
  • Question and Context Effects in Organizational Survey Data – Dr. Adam Meade
  • Measurement of Affect and Episodic Events – Dr. Howard Weiss
  • Measurement Issues in Stress Research – Dr. Daniel Ganster
  • Conditional Reasoning and Personality Measurement – Dr. Lawrence James
  • Issues with Internet Data Collection – Dr. Jeff Stanton
  • Current Issues in Measurement – Individual Level – Dr. Claudia Cogliser
  • The Effect of Criterion Reliability on Means and Interactions in Meta-Analysis – Dr. Lawrence James