Course Description

OVERVIEW:

Open science practices are widely believed to help researchers produce studies that are better planned and understood by all collaborators involved; more transparent and reproducible; and more accessible, useful, and impactful to the research and practice communities interested in the research. These practices play an important role in replication studies that help build evidence-based management theory.

This short course presents critical principles and practices that can be introduced into your research pipeline as well as learn about the perspectives of journal editors and associate editors hoping to encourage open science practices and enhance the robustness of our work. It will also introduce best practices for doctoral students and management scholars on how to select replication-worthy studies and then design, execute, and publish high-quality replication-type studies in top management journals.

Dr. Andreas Schwab

Course Abstract

Replication studies have started to play an important role in building evidence-based management theory. This short course introduces best practices for doctoral students and management scholars on (1) how to select replication-worthy studies, (2) how to design and execute replication data collection and data analysis, and (3) how to report and publish replication-type studies in top management journals. The workshop will also feature a final ask-the-experts session, with three management scholars with broad replication experiences.

Course Outline

• Role of replications for scientific progress
• Introduction of the alternative types of replication studies and their roles for theory development
• Best Practices for the execution of high-quality replication studies

• • Selection studies to replicate (salience, impact, transparency)
  • Manage relationships with original authors
  • Conducting a reproduction of the original study
  • Design and execution of data collection (statistical power, combining exact and constructive replications)
  • Analysis and interpretation of replication data

• • • Frequentist, Bayesian, and Meta-analytic analyses
    • Deductive, integrative, and abductive approaches)

• • Reporting and publishing replication studies

• Future of replication research in the field of management

• • Role of replications in doctoral student education and dissertation research
  • Collective replication initiatives to rapidly develop evidence-based theories
  • Replication-promoting academic ecosystems to enable massive replication research

• Ask-the-expert panel

• • Xavier Martin, Tilburg University
  • Billy Obenauer, University of Maine
  • Maria Rumyantseva, University of Sydney

Dr. Roman Briker:

Course Abstract:

Pre-registration is increasingly becoming the norm and even requirement for many journals, programs, and scholarly practices. Yet, many scholars still are unsure or unaware why and how they should pre-register their studies. This short course teaches scholars (1) why they should pre-register their studies, (2) how they can pre-register their studies (on common platforms including the Open Science Framework and AsPredicted.Org), (3) navigating common pitfalls and best practices for conducting and evaluating pre-registrations (across methodologies and disciplines). The workshop will also feature short, hands-on talks and Q&A sessions with three renowned scholars with extensive pre-registration experiences.

Course Outline
Wednesday, June 18

• Introduction into the need for pre-registration

• Understanding pre-registrations

• Navigating pre-registrations on the OSF and AsPredicted.Org

• Pre-Registration in Practice: Mock Pre-Registration

• Success strategies and pitfalls when conducting pre-registration

• Evaluating Sample Pre-Registrations in Top-Journals and Peer-Review

• Discussing the Future of Pre-Registrations and Registered Reports

Thursday June 19

• Reflections on Day 1 and Outlook 2 Day (Roman Briker)

• Why and How to Deviate from Pre-Registrations (Daniël Lakens)

• Navigating Pre-Registration in Qualitative Work (Tamarinde Haven)

• Pre-Registration: Insights from Editorial and Author Angles (George Banks)

• Reflections and Concluding Remarks (Roman Briker)