Welcome!
SIOP/CARMA
Open Science
Virtual Summer Series

About the Consortium for the Advancement of Research Methods and Analysis (CARMA)

CARMA, the Consortium for the Advancement of Research Methods and Analysis, is an interdisciplinary consortium devoted to helping faculty, graduate students and professionals learn of current developments in various areas of research methods and statistics. Our focus in research methods is relevant to the management and organizational sciences. CARMA is a non-profit unit at the Texas Tech University. CARMA was established in 1997 by Dr. Larry J. Williams (former Chairperson of the Research Methods Division of the Academy of Management and Founding Editor of Organizational Research Methods) and offers Live Online Short Courses throughout the year for several global regions. Since 2004 CARMA has also offered its Consortium Webcast Program that includes access to live research methods lectures and panels and their recordings via the CARMA Video Library. The CARMA Video Library now includes over 200 recordings (click here to see contents).

About the Society for Industrial and Organizational Psychology (SIOP)

SIOP is the premier professional association for the science and practice of I-O psychology. While an independent organization with its own governance, SIOP also represents Division 14 of the American Psychological Association and is an organizational affiliate of the Association for Psychological Science.

I-O psychology is a dynamic and growing field that addresses workplace issues at the individual and organizational level. I-O psychologists apply research that improves the well-being and performance of people and the organizations that employ them. This involves everything from workforce planning, employee selection, and leader development to studying job attitudes and job motivation, implementing work teams, improving diversity and inclusion, and facilitating organizational change.

SIOP/CARMA Open Science Virtual Summer Series – No Registration Fee!

(May 19, May 26, June 2, June 9, and June 16)

Overview

The overall focus of the workshop series is to introduce and teach attendees about open science practices that are widely believed to help researchers produce studies that are better planned and understood by all collaborators involved; more transparent and reproducible; and more accessible, useful, and impactful to the research and practice communities interested in the research. The virtual workshops will be hosted via CARMA’s resources (i.e., Zoom), and attendees can choose to attend any or all virtual workshops.

By attending the summer series, you will learn critical principles and how-tos of open science practices that can be introduced into your research pipeline as well as learn about the perspectives of journal editors and associate editors hoping to encourage open science practices and enhance the robustness of our work (e.g., Lillian Eby of the Journal of Applied Psychology, Steven Rogelberg of the Journal of Business and Psychology).

Goals

The first is to connect our attendees with leaders in the community who want to practice and promote open science. Such social support will be crucial to making the kinds of productive changes that make our science even stronger and better.
The second is to offer sessions that facilitate the development of knowledge and skills for making open science a reality for both research and practice.

Overview of the Series

The Series will be delivered over five dates and will consist of workshops and panel sessions. The workshops will be divided into morning and afternoon sessions and led by a fantastic slate of speakers, panelists, and former CARMA presenters. Morning sessions will typically consist of skill-building sessions and extend into the afternoon as needed. There will be time each day (breaks, meals) to reflect and network with fellow attendees, presenters, and workshop organizers to promote building SIOP’s open science community. For instance, we’ll breakout into small groups, reflect on the practices highlighted that day, and discuss small ways each of us can commit to opening up our work. We’ll discuss questions such as:

Of the practices highlighted in the workshop, which would you want to use and why?
How might you go about successfully implementing the open science practices we’ve covered to make your research even more open or robust?
There are many reasons for adopting open science. Reflecting on what was discussed in the workshop(s), what are the best reasons you can think of for using open science practices? How important is it for you to leverage these practices in your research?
Do you need any support from this community we’ve built? What do you think you’ll do after leaving the summer series?

After our breakouts, we’ll return to the larger group, sharing stories and ideas about committing to open science. As facilitators, we’ll – where appropriate – highlight some key findings emerging from the meta-science literature that shed light on the value and impact of open science practices where they have been utilized.

Following each workshop, we’ll hold discussions with invited panelists that will include journal editors, associate editors, and reviewers of major journals in the organizational sciences. These individuals hope to enhance the rigor and credibility of our science and their perspectives are pivotal to the incremental improvements we hope to spur with our summer series.

Schedule of Workshop Topics and Panel Presentations

Sessions will begin at 10 AM ET and go till 4:30 PM ET.

Wednesday, May 19

Workshop 1: (a) What is open science?, (b) Accelerating robust research in the organizational sciences

Panelists: Scott Highhouse (Journal of Personnel Assessment and Decisions), Andrew Timming (Human Resource Management Journal), Mo Wang (Work, Aging and Retirement)

Wednesday, May 26

Workshop 2 : (a) What is the Open Science Framework?, (b) An ounce of prevention is worth more than a pound of cure: The various forms of pre-registering research

Panelists: John Antonakis (Leadership Quarterly), Maryam Kouchaki (Organizational Behavior and Human Decision Processes), Cornelius Konig (International Journal of Selection and Assessment)

Wednesday, June 2

Workshop 3: (a) An open science workflow template and (b) Reviewing with open science in mind (e.g., are findings reported transparently and in a reproducible manner?; not all results need to be significant for science to move forward; also how to review in a results-blind manner, consulting pre-registrations; reviewing registered reports)

Panelists: Lillian Eby (Journal of Applied Psychology), Nadya A. Fouad (Journal of Vocational Behavior), Jonas W. B. Lang (Journal of Personnel Psychology)

Wednesday, June 9

Workshop 4: (a): The many ways of ensuring analytic reproducibility: From open code, to open data, to full computational reproducibility; (b) Promoting open science and replication work

Panelists: Paul Bliese (Organizational Research Methods), Berrin Erdogan (Personnel Psychology), Nikolaou Ioannis (International Journal of Selection and Assessment), Lucy Gilson (Group & Organization Management)

Wednesday, June 16

Workshop 5: (a) How to have better conversations when making authorship decisions; (b) Transparency and openness guidelines, preprints, and our publishing model

Panelists: Steven Rogelberg (Journal of Business & Psychology), Christian Resick (Journal of Organizational Behavior), Ingo Zettler (Journal of Personnel Psychology)

Reading List

Answers to 18 Questions about open science practices (Banks et al., 2018)
Opening up: The Industrial-Organizational Psychologists column dedicated to all things open science. Some select postings (2019–present).

Registration Instructions – NO REGISTRATION FEE!

Login as a Website User to your CARMA account. (If you do not have a CARMA account, please click )
Once you login, in the middle section of your User Area, you will see an option to “Register for Live Events”. (If you have not registered your device yet, please register your device first. Then, click “User Area”.)
Select “SIOP/CARMA Open Science Virtual Summer Series – 2021” and checkout.
You will receive an e-mail to confirm your registration that will provide more information about the events.

CARMA Recordings Related to Open Science

In support of Open Science, CARMA is pleased to make four recordings from the CARMA Video Library available free of charge. To access these four recordings, visit the CARMA Open Science Portal using the link below. NOTE: These recordings are NOT part of the SIOP-CARMA Open Science Summer Series.