Short Courses 2020-2021
To view past short course information, click on its corresponding tab below.
North America Region Quantitative
June 7-24, 2021 – Three Sessions, Seventeen Course Options
Sponsored by Wayne State University
Session 1: June 7-10, Six Course Options | Session 2: June 14-17, Six Course Options | Session 3: June 21-24, Six Course Options
Short Course Sessions and Groupings
We offer three sessions which allows course participants the opportunity to take three back-to-back-to-back courses that complement one another. All courses in a session are taught concurrently, so a participant can take only one course per session.
Complete Course Listing
| Session 1 (Choose One) | Session 2 (Choose One) | Session 3 (Choose One) |
| Mon. June 7 through Thur. June 10 | Mon. June 14 through Thur. June 17 | Mon. June 21 through Thur. June 24 |
| 1. “Introduction to R and Data Analysis” – Dr. Scott Tonidandel, University of North Carolina-Charlotte |
1. “Advanced Data Analysis with R” – Dr. Justin DeSimone, The University of Alabama |
1. “Introduction to Bayesian Analysis” – Dr. Steve Culpepper, University of Illinois |
| 2. “Introduction to Multilevel Analysis with R” – Dr. James LeBreton, Pennsylvania State University |
2. “Advanced Multilevel Analysis with R” – Dr. Gilad Chen, University of Maryland |
2. “Advanced Multilevel and Longitudinal Analysis using R Mixed-Effect Models” – Dr. Paul Bliese, University of South Carolina |
| 3. “Introduction to SEM with LAVAAN” – Dr. Robert Vandenberg, University of Georgia |
3. “Intermediate SEM, Model Evaluation” – Dr. Larry Williams, Texas Tech University |
3. “Advanced SEM I: Measurement Invariance, LGM, and Recursive Models” – Dr. Robert Vandenberg, University of Georgia |
| 4. “Statistical Analysis of Text with R” – Dr. Jeff Stanton, Syracuse University |
4. “Machine Learning in R: Prediction and Clustering” – Dr. Fred Oswald, Rice University | 4. “Web Scraping: Data Collection and Analysis” – Dr. Richard Landers, University of Minnesota |
| 5. “Questionnaire Design” – Dr. Lisa Schurer Lambert, Oklahoma State University |
5. “Theory, Methods, and Analysis for Research with Dyads” –Dr. Janaki Gooty, University of North Carolina Charlotte | 5. “Alternatives to Difference Scores: Polynomial Regression, and Response Surface Methodology” – Dr. Jeff Edwards, University of North Carolina |
| 6. “Systematic Reviews and Meta-Analysis in R” – Dr. Ernest O’Boyle, Indiana University | 6. “Introduction to Python for Research”– Dr. Jason T. Kiley, Oklahoma State University |
CARMA Workshop: Basics of R (included free with the short course registration)
This four-hour Workshop provides information on the package R to prepare attendees for follow-up training in CARMA Short Courses that use R. By attending this online workshop, participants will learn basic skills for using the R Studio interface to: load and activate R packages, import and manage data, and create and execute syntax. Having these basic skills will allow Short Course participants to more easily learn about use of R for data analysis and will enable Short Course instructors to better plan and deliver their content. This Workshop is free of charge and only available to those who will be attending one of the CARMA Short Courses. It will be available on-line.
During this Basics of R Workshop, attendees will learn:
1. Using R through the R Studio interface
2. Importing data into R
3. R data sets (a.k.a data frames and tibbles)
4. Data types
5. Subsetting columns of data and selecting cases
6. Recoding data and dealing with missing data
7. Merging data (columns and rows)
8. Output objects
9. User defined functions
10. Getting help
Session 1: June 7-10, Six Course Options (Choose One)
Option #1: “Introduction to R and Data Analysis” – Dr. Scott Tonidandel, University of North Carolina-Charlotte
This course will provide a gentle introduction to the R computing platform and the R-Studio interface. We will cover the basics of R such as importing and exporting data, understanding R data structures, and R packages. You will also learn strategies for data manipulation within R (compute, recode, selecting cases, etc.) and best practices for data management. We will work through examples of how to conduct basic statistical analyses in R (descriptive, correlation, regression, T-test, ANOVA) and graph those results. Finally, we will explore user-defined functions in R and lay the groundwork for understanding how to perform more complex analyses presented in other CARMA short courses.
Required Software: R (download here), R Studio (download here)
Option #2: “Introduction to Multilevel Analysis with R” – Dr. James LeBreton, Pennsylvania State University
The CARMA Introduction to Multilevel Analysis short course provides both (1) the theoretical foundation, and (2) the resources and skills necessary to conduct basic multilevel analyses. Emphasis will be placed on techniques for traditional, hierarchically nested data (e.g., children in classrooms; employees in teams). The first part of the course introduces issues related to multilevel theory (e.g., multilevel constructs; principles of multilevel theory building; cross-level inferences and cross-level biases). The second part of the course discusses issues related to multilevel measurement (e.g., aggregation; aggregation bias; composition and compilation models of emergence; estimating within-group agreement). The last part of the course focuses on the specification of basic 2-level models (e.g., children nested in classrooms; soldiers nested in platoons; employees nested within work teams) analyzed via multilevel regression (i.e., random coefficient regression; hierarchical linear model; mixed effects model). The R software package will be introduced, explained, and emphasized during this short course in preparation for the advanced short course offered in Session II. Participants who prefer HLM, SAS, SPSS, or MPlus (and have expertise with these programs) have the option of completing some assignments with these programs. Participants are encouraged to also bring datasets to the course and apply the principles to their specific areas of research. The course is best suited for faculty and graduate students who are familiar with traditional (i.e., single-level) multiple regression analysis, but have little (if any) expertise related to conducting multilevel analyses.
- Module 1: Multilevel Theory: Constructs, Inferences, and Composition Models
- Module 2: Multilevel Measurement: Aggregation, Aggregation Bias, & Cross-Level Inference
- Module 3: Multilevel Measurement: Estimating Interrater Agreement & Reliability
- Examples using R
- Examples using SPSS Software (time permitting)
- Module 4: Multilevel Measurement and Multilevel Modeling: A Simple Illustration of Analyzing Composite Variables in Hierarchical Linear Models
- Examples using R
- Examples using SPSS Software (time permitting)
- Module 5: Review of the 2-Level Model and Final Q & A
- Other topics (only if time permits) might include:
- Extension of the 2-level model to the study of growth and change (i.e., growth model)
- Different centering/scaling stragies (e.g., group-mean centering vs. grand-mean centering)
Required Software: R (download here), RStudio (download here)
Option #3: “Introduction to SEM with LAVAAN” – Dr. Robert Vandenberg, University of Georgia
This introductory course requires no previous knowledge of structural equation modeling (SEM), but participants should possess a strong understanding of regression AND have understanding about the basic data handling functions using R. All illustrations and in-class exercises will make use of the R LAVAAN package, and participants will be expected to have LAVAAN installed on their laptop computers prior to beginning of the course. No course time will be spent going over basic R data handling and installing the LAVAAN package. The course will start with an overview of the principals underlying SEM. Subsequently, we move into measurement model evaluation including confirmatory factor analysis (CFA). Time will be spent on interpreting the parameter estimates and comparing competing measurement models for correlated constructs. We will then move onto path model evaluation where paths representing “causal” relations are placed between the latent variables. Again, time will be spent on interpreting the various parameter estimates and determining whether the path models add anything above their underlying measurement models. If time permits, longitudinal models will be introduced.
Required Software: R installed with LAVAAN package
Option #4: “Statistical Analysis of Text with R” – Dr. Jeff Stanton, Syracuse University
Text mining refers to the discovery of patterns in natural language text – particularly in large data sets of short text segments, such as one might find in social media, web pages, or news articles. Text mining techniques can support theory development by uncovering patterns that would be challenging to find with traditional techniques. Text mining can also be used alongside standard confirmatory statistical techniques such as regression and classification. In this CARMA short course, we will use R and R-Studio to get started with text mining and various related methods for statistical analysis of text.
We will begin by briefly reviewing the basics of R, add on packages, and text analysis essentials. I recommend that you take CARMA’s basic R introductory R course if you have no prior familiarity with programming languages. We will discuss the conceptual steps involved in text mining, and then use R to put some of those concepts to work on open data sets I will provide. Students are welcome to bring their own data sets as well, but this is not required. We will examine the creation of document feature matrices, dictionary based sentiment analysis, exploratory topic modeling, structural topic modeling, and word embedding. We will test some predictive techniques, using features of text documents as predictors. Time permitting we will examine the processing steps in traditional natural language processing as well as some newer methods such as BERT.
Students who participate successfully in this short course can expect to learn enough about text mining to begin experimenting with these tools in research. The ideal participant will have an interest in improving their skill with R, knowledge of basic descriptive and inferential statistics, and curiosity about exploring empirically driven strategies for analysis of large data sets containing text. No prior knowledge of text mining or natural language processing is needed.
Option #5: “Questionnaire Design, Scale Development, Construct Validity, and Data Management and Preparation” – Dr. Lisa Schurer Lambert, Oklahoma State University
This introductory course will help you develop your model, develop and select measures, design survey instruments and execute your data collection. Topics include designing your project (developing a model, selecting variables, sampling requirements). Because it is necessary to establish adequate construct validity before testing hypotheses, we cover a wide variety of procedures for assessing construct validity (including EFA/CFA). Then we will apply this understanding of up-to-date construct validity practices to scale development techniques by creating new measures or revising existing measures that can pass the hurdles posed by tests of construct validity. We draw from research on how respondents interpret surveys to reveal principles for how to design your questionnaire to obtain high quality data. Finally, we will cover procedures for managing the data collection and for cleaning your data (missing data, outliers, identifying careless responders). If you wish, bring your research ideas because there will be opportunities to advance your own project within the workshop.
Option #6: “Systematic Reviews and Meta Analysis in R” – Dr. Ernest O’Boyle, Indiana University
Meta-analyses have now become a staple of research in the organizational sciences. Their purpose is to summarize and clarify the extant literature through systematic and transparent means. Meta-analyses help answer long-standing questions, address existing debates, and highlight opportunities for future research. Despite their prominence, knowledge and expertise in meta-analysis is still restricted to a relatively small group of scholars. This short course is intended to expand that group by familiarizing individuals with the key concepts and procedures of meta-analysis with a practical focus. Specifically, the goal is to provide the necessary tools to conduct and publish a meta-analysis/systematic review using best practices. We will cover how to; (a) develop research questions that can be addressed with meta-analysis, (b) conduct a thorough search of the literature, (c) provide accurate and reliable coding, (d) correct for various statistical artifacts, and (e) analyze bivariate relationships (e.g., correlations, mean differences) as well as multivariate ones using meta-regression and meta-SEM. The course is introductory, so no formal training in meta-analysis is needed. Familiarity with some basic statistical concepts such as sampling error, correlation, and variation is sufficient.
Required Software: R (download here), RStudio (download here)
Session 2: June 14-17, Six Course Options (Choose One)
Option #1: “Advanced Data Analysis with R” – Dr. Justin DeSimone, The University of Alabama
This short course will begin with an introduction to linear regression analysis with R, including models for single/multiple predictors and model comparison techniques. Particular attention will be paid to using regression to test models involving mediation and moderation, followed by consideration of advanced topics including multivariate regression, use of polynomial regression, logistic regression, and the general linear model. Exploratory factor analysis and MANOVA will also be covered. For all topics, examples will be discussed and assignments completed using either data provided by the instructor or by the short course participants.
Required Software: R (download here), R Studio (download here)
Option #2: “Advanced Multilevel Analysis with R” – Dr. Gilad Chen, University of Maryland
This CARMA Advanced Multilevel Analysis short course provides both (1) the theoretical foundation, and (2) the resources and skills necessary to conduct basic and advanced multilevel analyses. The course covers both basic models (e.g., 2-level mixed and growth models), and more advanced topics (e.g., 3-level models, multilevel moderated-mediation models, and multiple-unit multilevel models). Practical exercises, with real-world research data, are conducted in R and Mplus. Participants are encouraged to bring datasets to the course and apply the principles to their specific areas of research. The course is best suited for faculty and graduate students who have at least some foundational understanding of conducting multilevel analyses.
Module 1: Basic mixed effects (2-level) models, testing in R and Mplus
Module 2: Longitudinal studied in R and Mplus: within-person experiential sampling methods and growth models
Module 3: Complex multilevel models part 1: 3-level models in R and moderated-mediation models in Mplus
Module 4: Complex multilevel models part 2 (plus open discussion and consultations): Multiple unit memberships in R (using lme4 package)
Required Software: R (download here), R Studio (download here)
Option #3: “Intermediate SEM, Model Evaluation” – Dr. Larry Williams, Texas Tech University
This course is aimed at faculty and students with an introductory understanding of structural equation methods who seek a better understanding of the challenging process of making judgments about the adequacy of their models. Those who attend should have experience in fitting structural equation models with software such as LISREL, MPlus, EQS, AMOS, or LAVAAN. This experience requirement can be met by completion of graduate coursework or Introduction to SEM Short Course. Attendees will be expected to use their own laptop computers installed with their SEM software, and they should also know how to import data from an SPSS/Excel/CSV save file into their SEM software program. Attendees will learn out to interpret and report results from SEM analyses, and how to conduct model comparisons to obtain information relevant to inferences about their models, as well as advantages and disadvantages of different approaches to model evaluation. Attendees are encouraged to bring their own data for use during parts of the short course.
The course will consist of five sections, with each section having a lecture and lab component using exercises and data provided by the instructor:
• Review of model specification and parameter estimation
• Overview of model evaluation
• Logic and computations for goodness-of-fit measures
• Analysis of residuals and latent variables
• Model comparison strategies
Required Software: Your preferred SEM software package
Option #4: “Machine Learning in R: Prediction and Clustering” – Dr. Fred Oswald, Rice University
Organizational research and practice has made great advances in understanding the world of work by applying traditional statistical methods to their research questions, whether it is through simple predictive modeling (e.g., linear regression and ANOVA), factor analysis (e.g., EFA and CFA), or through more extensive modeling (e.g., SEM and latent transition analysis). However, these models could be so simple that underlying complex relationships in the data get overlooked; or alternatively, these models could be too complex for the data where they look like they fit well, but really they have been capitalizing on chance (i.e., the models would not work well if they were applied to an independent data set).
To overcome these latter potential limitations, a variety of machine learning methods that make serious attempts at not underfitting the data (e.g., mining for complexity where it exists) yet not overfitting the data as well (e.g., cross-validating models on new data). Machine learning methods generally focus on clustering approaches (e.g., k-means, dbscan, agglomerative clustering), and predictive approaches (e.g., random forests, LASSO regression, and support vector machines). These models can usefully supplement traditional approaches in organizational research — or in some cases they may supplant them, even out of necessity (e.g., when the number of variables exceeds the number of cases).
This CARMA short course is a hands-on experience, where you will use R and RStudio to analyze and interpret these clustering and predictive models. [If you are not familiar with the basics of how to navigate and use R, then you are strongly recommended to take CARMA’s introductory R course.] We will use openly available data sets, R code that has already been developed, and we will discuss, run, interpret a wide variety of important machine learning models together. Time permitting, we will explore methods for comparing the performance of these statistical learning models against one another.
This course will equip workshop attendees with the skills to perform their own clustering and predictive modeling using machine learning, where they can then apply these skills in their research, practice, and teaching.
Required Software: R (download here), R Studio (download here)
Option #5: “Theory, Methods, and Analysis for Research with Dyads” – Dr. Janaki Gooty, University of North Carolina Charlotte
Multi-level research in the organizational sciences (e.g., OB, strategy, entrepreneurship) has become fairly mainstream in the last few decades. Despite this attention to levels issues in general, dyads and the dyadic level of analyses remains a “forgotten level” ( Kenny, Kashy & Cook, 2006) relative to individuals, teams and organizations. This trend is unfortunate as relationships (one-one associations in organizations such as supervisor-subordinate, coworkers, firm-firm) are the building block of all phenomena that pervades organizational life. This course introduces 1) the importance of dyadic research, 2) the pitfalls of ignoring the dyadic level (both conceptually and statistically) and 3) a six step model building exercise for dyads as a unique level of analysis conceptually and empirically. This last component includes a focus on how to build dyad level theories, conceptualizing constructs and their emergence at this level, research design choices with a focus on nesting vs. cross-classification and data analyses. Students who participate successfully in this short course can expect to leave with a toolbox of conceptual and empirical knowledge and hands on skills to develop and test dyadic models in their research. The presenter will demonstrate cross-classified modeling via HCM (available in the HLM software) but the same principles could be applied via R as well.
Option #6: “Introduction to Python for Research”– Dr. Jason T. Kiley, Oklahoma State University
Python is a general purpose programming language that includes a robust ecosystem of data science tools. These tools allow for fast, flexible, reusable, and reproducible data processes that make researchers more efficient and rigorous with existing study designs, while transparently scaling up to big data designs. This short course focuses on the foundational skills of identifying, collecting, and preparing data using Python. We will begin with an overview, emphasizing the specific skills that have a high return on investment for researchers. Then, we will walk through foundational Python skills for working with data. Using those skills, we will cover collecting data at scale using several techniques, including programmatic interfaces for obtaining data from WRDS, application programming interfaces (APIs) for a wide range of academic and popular data (e.g., The New York Times), web scraping for quantitative and text data, and computer-assisted manual data collections. From there, we will assemble and transform data to produce a ready-for-analysis dataset that is authoritatively documented in both code and comments, and which maintains those qualities through the variable additions, alternative measure construction, and robustness checks common to real projects.
By the end of the course, you will have the skills—and many hands–on code examples—to conduct a rigorous and efficient pilot study, and to understand the work needed to scale it up. The course design does not assume any prior training, though reasonable spreadsheet skills and some familiarity with one of the commonly–used commercial statistical systems is helpful. In particular, no prior knowledge of Python is required, and we will cover a general introduction to Python in the beginning of the course content.
Session 3: June 21-24, Six Course Options (Choose One)
Option #1: “Introduction to Bayesian Analysis” – Dr. Steve Culpepper, University of Illinois
This short course introduces the concepts and methodology of Bayesian statistics. Topics include Bayes’ rule, likelihood functions, prior and posterior distributions, Bayesian point estimates and intervals, Bayesian hypothesis testing, and prior specification. Additional topics include Bayesian regression, model selection, prediction, diagnostics, Bayes factors, and exploratory factor analysis. We also review practical implementations of Markov chain Monte Carlo and hierarchical models using R and JAGS and discuss conceptual differences between the Bayesian and frequentist paradigms.
Option #2: “Advanced Multilevel and Longitudinal Analysis using R Mixed-Effect Models” – Dr. Paul Bliese, University of South Carolina
The CARMA “Advanced Multilevel and Longitudinal Analyses using R Mixed-Effects Models” short course provides the (1) theoretical foundation, and (2) resources and skills necessary to conduct a variety of advanced multilevel and longitudinal analyses using the R mixed-effect modeling packages nlme and lme4. The course briefly reviews basic models (e.g., 2-level mixed and growth models) before addressing more advanced topics (econometric fixed-effect models for panel data, discontinuous growth models, consensus emergent models, and multilevel models for dichotomous outcomes). Practical exercises, with real-world research data are provided. Participants are encouraged to bring datasets to the course and apply the principles to their specific areas of research. The course is best suited for faculty and graduate students who have a foundational understanding of mixed-effects models.
Module 1: Two-Level Mixed-Effect and Growth Model Review
Exercises and examples using lme in R
Module 2: Econometric Fixed-Effects Models vs Mixed-Effects Models
Exercises and examples using lme in R
Module 3: Discontinuous growth models for more complex longitudinal data
Exercises and examples using lme in R
Module 4: Bayes Estimates
Exercises and examples using lme in R
Module 5: Three-level models and consensus emergence models
Exercises and examples using lme and lmer (lme4) in R
Module 6: Generalized Linear Mixed-Effects Models for Dichotomous Outcomes
Exercises and examples using glmer (lme4) in R
Option #3: “Advanced SEM I: Measurement Invariance, LGM, and Recursive Models” – Dr. Robert Vandenberg, University of Georgia
The short course covers three advanced structural equation modeling (SEM) topics: (a) testing measurement invariance; (b) latent growth modeling; and (c) evaluating reciprocal relationships in SEM. The instructor lectures about half of the time with the remaining time devoted to having participants run examples with actual data provided by the instructor. Participants go home with usable examples and syntax. The measurement invariance testing section focuses on the procedures as outlined in the Vandenberg and Lance (2000) Organizational Research Methods article. Namely, we will cover the 9 invariance tests starting with the tests of equal variance-covariance matrices and ending with tests of latent mean differences. We will use a multi-sample approach in undertaking the invariance tests, and you will be shown how to test latent mean differences using the latent means of the latent variables within each group. The workshop then advances to operationalizing latent growth models within the SEM framework. Essentially, this is how to use one’s longitudinal data to actually capture the dynamic processes in one’s theory by creating vectors of change across time. The participant will also be exposed to modeling how the change in one variable impacts change in another. We will also use mixed modeling. And at the end of it, I introduce the participants to latent profile modeling with latent growth curves. The final piece is the testing of models with feedback loops via an SEM-Journal article by Edward Rigdon (1995). We will go through his 4 different models and what they mean. In doing so, we will extensively cover model identification as it is particularly important to testing reciprocal effects.
While the instruction will be carried out using the R-package LAVAAN, participants are welcome to use another SEM package. If you do so, you should have strong familiarity with that package and its functionality as the instructor will not be able to provide assistance in its use.
Required Software: R installed with LAVAAN package (R (download here), RStudio (download here))
Option #4: “Web Scraping: Data Collection and Analysis” – Dr. Richard Landers, University of Minnesota
In this course, you will learn how to create novel datasets from information found for free on the internet using only R and your own computer. First, after a brief introduction to data source theory, web architecture, and web design, we will explore the collection of unstructured data by scraping web pages directly through several small hands-on projects. Second, we will explore the collection of structured data by learning how to send queries directly to service providers like Google, Facebook and Twitter via their APIs. Third, we will briefly explore natural language processing as an analytic approach for analyzing scraped data. Finally, we will walk through the various ethical and legal issues to be navigated whenever launching a web scraping project.
Option #5: “Alternatives to Difference Scores: Polynomial Regression, and Response Surface Methodology” – Dr. Jeff Edwards, University of North Carolina
For decades, difference scores have been used in studies of fit, similarity, and agreement in organizational research. Despite their widespread use, difference scores have numerous methodological problems. These problems can be overcome by using polynomial regression and response surface methodology to test hypotheses that motivate the use of difference scores. These methods avoid problems with difference scores, capture the effects difference scores are intended to represent, and can examine relationships that are more complex than those implied by difference scores.
This short course will review problems with difference scores, introduce polynomial regression and response surface methodology, and illustrate the application of these methods using empirical examples. Specific topics to be addressed include: (a) types of difference scores; (b) questions that difference scores are intended to address; (c) problems with difference scores; (d) polynomial regression as an alternative to difference scores; (e) testing constraints imposed by difference scores; (f) analyzing quadratic regression equations using response surface methodology; (g) difference scores as dependent variables; and (h) answers to frequently asked questions.
Required Software: SPSS, Stata, R (download here) with RStudio (download here)
Europe/Asia May 2021
May 17-20, 24-27, 2021 – Two Sessions, Eight Course Options
Session 1: May 17-20, Four Course Options | Session 2: May 24-27, Four Course Options
Short Course Sessions and Groupings
We offer two sessions which allows course participants the opportunity to take two back-to-back-to-back courses that complement one another. All courses in a session are taught concurrently, so a participant can take only one course per session.
Complete Course Listing
Session 1 (Choose One) Session 2 (Choose One)
|
|
Session 1: May 17-20, Four Course Options (Choose One)
Option #1: “Advanced Regression and Interactions” – Dr. Jeremy Dawson, Sheffield University
This short course will begin with an introduction to linear regression analysis with R, including models for single/multiple predictors and methods to compare models. Particular attention will be paid to using regression to test models involving mediation and moderation, including nonlinear and higher order interactions. Further advanced topics will include the general linear model, generalized linear models including logistic regression and Poisson regression, and polynomial regression. For all topics, examples will be discussed and assignments completed using either data provided by the instructor or by the short course participants.
Required Software: R (R (download here) and RStudio (download here))
Option #2: “Introduction to Multilevel Analysis” – Dr. Vicente González-Romá, University of Valencia
Option #3: “Case Study Methods” – Dr. Catherine Welch, The University of Sydney
Option #4: “Introduction to Structural Equation Methods”– Dr. Jonas Lang, Ghent University
The Introduction to Structural Equation Methods Short Course provides (a) introductory coverage of latent variable techniques, including confirmatory factor analysis and structural equation methods with latent variables, (b) discussion of special issues related to the application of these techniques in organizational research, and (c) a comparison of these techniques with traditional analytical approaches. This Short Course will contain a balance of lecture and hands-on data analysis with examples and assignments, and emphasis will be placed on the application of SEM techniques to organizational research problems. Participants will:
- develop skills required to conduct confirmatory latent variable data analysis, based on currently accepted practices, involving topics and research issues common to organizational research.
- learn the conceptual and statistical assumptions underlying confirmatory latent variable analysis.
- learn how to implement data analysis techniques using software programs for confirmatory modeling. Special emphasis will also be placed on the generation and interpretation of results using LAVAAN and Mplus.
- learn how latent variable techniques can be applied to contemporary research issues in organizational research.
- learn how the application of current latent variable techniques in organizational research differs from traditional techniques used in this literature
- complete in-class exercises using LAVAAN and Mplus.
Required Software: R installed with LAVAAN package (R (download here), RStudio (download here)) or Mplus
Session 2: May 24-27, Four Course Options (Choose One)
Option #1: “Interpretive Methods” – Dr. Jane Le, WHU Otto Beisheim School of Management
Option #2: “Advanced Multilevel Analysis” (*) – Dr. Gilad Chen, University of Maryland
This CARMA Advanced Multilevel Analysis short course provides both (1) the theoretical foundation, and (2) the resources and skills necessary to conduct basic and advanced multilevel analyses. The course covers both basic models (e.g., 2-level mixed and growth models), and more advanced topics (e.g., 3-level models, multilevel moderated-mediation models, and multiple-unit multilevel models). Practical exercises, with real-world research data, are conducted in R and Mplus. Participants are encouraged to bring datasets to the course and apply the principles to their specific areas of research. The course is best suited for faculty and graduate students who have at least some foundational understanding of conducting multilevel analyses.
Module 1: Basic mixed effects (2-level) models, testing in R and Mplus
Module 2: Longitudinal studied in R and Mplus: within-person experiential sampling methods and growth models
Module 3: Complex multilevel models part 1: 3-level models in R and moderated-mediation models in Mplus
Module 4: Complex multilevel models part 2 (plus open discussion and consultations): Multiple unit memberships in R (using lme4 package)
Option #3: “Grounded Theory Method & Analysis” – Dr. Tine Koehler, The University of Melbourne
The purpose of this workshop is to introduce researchers to the underlying tenets of the grounded theory approach and to aid them in designing and conducting a grounded theory study. In the course, we will cover the following three major topics: (a) Understanding the approach and different methodological traditions, (b) designing a grounded theory study, (i.e., data collection methods, purposive sampling, gaining access, sources, triangulation), and (c) analyzing data following the grounded theory method (i.e., different approaches to coding, constant comparison, memoing, triangulation, theoretical saturation, etc.). Furthermore, the workshop will provide specific examples of practical challenges and strategies to manage them. No software is necessary for this course. Participants are invited to bring samples of their own data to the course.
Option #4: “Meta Analysis” – Dr. Mike Cheung – National University of Singapore
When there are more and more publications and research findings, it is challenging to comprehend these results scientifically. The systematic review provides well-accepted procedures to identify and extract information relevant to the problems. On the other hand, meta-analysis is the de facto statistical technique to synthesize research findings in educational, social, behavioral, and medical sciences.
This workshop provides a practical introduction of systematic review and meta-analysis using the open-source R statistical platform. We will also cover advanced techniques such as multivariate meta-analysis and meta-analytic structural equation modeling (MASEM).
This course attempts to achieve the following objectives: (1) learn essential ideas of systematic review; (2) learn basic and advanced techniques in the meta-analysis; (3) know how to conduct and interpret meta-analysis in R. Participants are expected to have basic knowledge in regression analysis. Proficiency in R is not required.
April 12-23, 2021 – Two Sessions, Two Courses
Sponsored by University of South Australia
Session 1: April 12-16 | Session 2: April 19-23
We offer two sessions which allows course participants the opportunity to take two back-to-back courses.
| Session 1
Monday April 12, Tuesday April 13, Thursday April 15, Friday April 16 |
Session 2
Monday April 19, Tuesday April 20, Thursday April 22, Friday April 23 |
|
|
Session 1: April 12-16
“Introduction to SEM with LAVAAN” – Dr. Robert Vandenberg, University of Georgia
This introductory course requires no previous knowledge of structural equation modeling (SEM), but participants should possess a strong understanding of regression AND have understanding about the basic data handling functions using R. All illustrations and in-class exercises will make use of the R LAVAAN package, and participants will be expected to have LAVAAN installed on their laptop computers prior to beginning of the course. No course time will be spent going over basic R data handling and installing the LAVAAN package. The course will start with an overview of the principals underlying SEM. Subsequently, we move into measurement model evaluation including confirmatory factor analysis (CFA). Time will be spent on interpreting the parameter estimates and comparing competing measurement models for correlated constructs. We will then move onto path model evaluation where paths representing “causal” relations are placed between the latent variables. Again, time will be spent on interpreting the various parameter estimates and determining whether the path models add anything above their underlying measurement models. If time permits, longitudinal models will be introduced.
Required Software: R installed with LAVAAN package
Session 2: April 19-23
“Model Evaluation with Your Data: Intermediate SEM” – Dr. Larry Williams, Texas Tech University
This course is aimed at faculty and students with an introductory understanding of structural equation methods. It is especially appropriate for those who have a data set and project for which they seek a better understanding of the challenging process of making judgments about the adequacy of their models. Those who attend should have experience in fitting structural equation models with software such as LISREL, MPlus, EQS, AMOS, or LAVAAN. This experience requirement can be met by completion of graduate coursework, our Introduction to SEM Short Course, or from their own research efforts. Attendees will be expected to use their computers installed with their SEM software, and they should also know how to import data from an SPSS/Excel/CSV save file into their SEM software program. Attendees will learn out to interpret and report results from SEM analyses, and how to conduct model comparisons to obtain information relevant to inferences about their models, as well as advantages and disadvantages of different approaches to model evaluation. Attendees are strongly encouraged to bring their own data for use during the short course. If needed, a data set can also be provided by the instructor.
The course will consist of five sections, with each section having a lecture and lab component in which they apply content from the section to the data from their project:
• Review of model specification and parameter estimation
• Overview of model evaluation
• Logic and computations for goodness-of-fit measures
• Analysis of residuals and latent variables
• Model comparison strategies
Required Software: Your preferred SEM software package
Live Online Short Courses – January 6-8, 2021
Sponsored by University of South Carolina
Short Course Sessions and Groupings
All courses in are taught concurrently, so a participant can take only one course.
Complete Course Listing
|
CARMA Workshop: Basics of R
This four-hour Workshop provides information on the package R to prepare attendees for follow-up training in CARMA Short Courses that use R. By attending this online workshop, participants will learn basic skills for using the R Studio interface to: load and activate R packages, import and manage data, and create and execute syntax. Having these basic skills will allow Short Course participants to more easily learn about use of R for data analysis and will enable Short Course instructors to better plan and deliver their content. This Workshop is only available to those who will be attending one of the CARMA Short Courses. It will be available on-line.
During this Basics of R Workshop, attendees will learn:
1. Using R through the R Studio interface
2. Importing data into R
3. R data sets (a.k.a data frames and tibbles)
4. Data types
5. Subsetting columns of data and selecting cases
6. Recoding data and dealing with missing data
7. Merging data (columns and rows)
8. Output objects
9. User defined functions
10. Getting help
Option 1: “Introduction to R and Data Analysis” – Dr. Scott Tonidandel, University of North Carolina-Charlotte
This course will provide a gentle introduction to the R computing platform and the R-Studio interface. We will cover the basics of R such as importing and exporting data, understanding R data structures, and R packages. You will also learn strategies for data manipulation within R (compute, recode, selecting cases, etc.) and best practices for data management. We will work through examples of how to conduct basic statistical analyses in R (descriptive, correlation, regression, T-test, ANOVA) and graph those results. Finally, we will explore user-defined functions in R and lay the groundwork for understanding how to perform more complex analyses presented in other CARMA short courses.
Required Software: R (download here), R Studio (download here)
Option 2: “Advanced Multilevel Analysis with R” – Dr. Paul Bliese, University of South Carolina
The CARMA Advanced Multilevel Analysis short course provides both (1) the theoretical foundation, and (2) the resources and skills necessary to conduct advanced multilevel analyses. The course covers both basic models (e.g., 2-level mixed and growth models), and more advanced topics (e.g., 3-level models, discontinuous growth models, and multilevel models for dichotomous outcomes). Practical exercises, with real-world research data, are conducted in R. Participants are encouraged to bring datasets to the course and apply the principles to their specific areas of research. The course is best suited for faculty and graduate students who have at least some foundational understanding of conducting multilevel analyses.
- Module 1: 2-Level Mixed Models Review
- Module 2: Basic growth models for examining longitudinal data
- Exercises using lme in R
- Module 3: Discontinuous growth models for more complex longitudinal data
- Exercises using lme in R
- Module 4: Bayes Estimates
- Exercises using lme in R
- Module 5: Three-level models, emergence models, multilevel mediation, Multiple Imputation, and other extensions
- Examples with MICE
- Examples with mediation package
- Module 6: Dichotomous Outcomes; Generalized Linear Mixed-Effects Models
- Exercises using glmer (lme4) in R
Required Software: R (download here), RStudio (download here)
Option 3: “Introduction to SEM with LAVAAN” – Dr. Robert Vandenberg, University of Georgia
This introductory course requires no previous knowledge of structural equation modeling (SEM), but participants should possess a strong understanding of regression AND have understanding about the basic data handling functions using R. All illustrations and in-class exercises will make use of the R LAVAAN package, and participants will be expected to have LAVAAN installed on their laptop computers prior to beginning of the course. No course time will be spent going over basic R data handling and installing the LAVAAN package. The course will start with an overview of the principals underlying SEM. Subsequently, we move into measurement model evaluation including confirmatory factor analysis (CFA). Time will be spent on interpreting the parameter estimates and comparing competing measurement models for correlated constructs. We will then move onto path model evaluation where paths representing “causal” relations are placed between the latent variables. Again, time will be spent on interpreting the various parameter estimates and determining whether the path models add anything above their underlying measurement models. If time permits, longitudinal models will be introduced.
Required Software: R installed with LAVAAN package (download here), RStudio (download here)
Option 4: “Statistical Analysis of Big Data with R” – Dr. Jeff Stanton, Syracuse University
Data mining refers to the process of uncovering patterns in data. Text mining refers to the same process, but applied to textual data instead of numeric data. These techniques support both prediction and explanation by discovering connections among variables that would be challenging to find with conventional techniques such as multiple regression. In this CARMA short course, we will use R and R-Studio to learn several techniques for analyzing numeric data sets, data sets with text data, and data sets containing both kinds of data.
On the first morning we will discuss the conceptual steps involved in data mining; after that we will use R to analyze several example data sets that I will provide. Students are also welcome to bring their own data, but this is not required or expected. We will learn data reduction, feature extraction, feature elimination, classifiers, and association rules mining. In the area of text mining, we will use R to extract text from websites, we will construct term-document matrices, and we will do analysis on those data structures using topic modeling, structural topic models, word embedding, penalized regression, and other text mining techniques.
If you have never used R, I recommend that you take CARMA’s introduction to R, but the data/text mining short course does not require extensive math or programming skills. You can expect to learn enough about data and text mining to begin working with these tools in research and/or teaching. The ideal participant will have an interest in improving their skills with R, knowledge of basic descriptive and inferential statistics, and curiosity about exploring alternative analytical strategies for working with complex data sets.
Required Software: R (download here), R Studio (download here)
Option 5: “Intermediate SEM, Model Evaluation” – Dr. Larry Williams, Texas Tech University
This course is aimed at faculty and students with an introductory understanding of structural equation methods who seek a better understanding of the challenging process of making judgments about the adequacy of their models. Those who attend should have experience in fitting structural equation models with software such as LISREL, MPlus, EQS, AMOS, or LAVAAN. This experience requirement can be met by completion of graduate coursework or Introduction to SEM Short Course. Attendees will be expected to use their own laptop computers installed with their SEM software, and they should also know how to import data from an SPSS/Excel/CSV save file into their SEM software program. Attendees will learn out to interpret and report results from SEM analyses, and how to conduct model comparisons to obtain information relevant to inferences about their models, as well as advantages and disadvantages of different approaches to model evaluation. Attendees are encouraged to bring their own data for use during parts of the short course.
The course will consist of five sections, with each section having a lecture and lab component using exercises and data provided by the instructor:
• Review of model specification and parameter estimation
• Overview of model evaluation
• Logic and computations for goodness-of-fit measures
• Analysis of residuals and latent variables
• Model comparison strategies
Required Software: Your preferred SEM software package
Option 6: “Open Science and R: Principles and Practices” – Dr. George Banks, University of North Carolina Charlotte
The open science revolution continues to gain momentum across the social and natural sciences, and in particular, the organizational sciences. This movement is driven in part by a crisis in confidence of scientific research. However, open science offers so much more to scholars and stakeholders of scientific work. Open science can serve to accelerate science, facilitate large scale collaboration, and aid individual research teams in conducting more rigorous and relevant work. This short course is intended to introduce open science concepts across the life cycle of research. After taking this course you will be able to engage in open science practices during the full research process and successfully leverage such practices in future journal submissions to demonstrate exceptional methodological rigor. We will cover (a) questionable research practices and publication bias, (b) study preregistration, registered reports, results-blind reviews, preprints, and how to use badges, (c) open data, proper annotation of analytic R code, reproducibility of analyses and transparency checklists, (d) Do’s and Dont’s for replication studies, (e) how to navigate open science platforms, such as the open science framework, large scale project collaboration in management, and finally (f) authorship and contributorship agreements. The course is introductory. Familiarity with some basic statistical concepts, such as null hypothesis significance testing is sufficient.
Option 7: “Advanced Data Analysis with R” – Dr. Ron Landis, Illinois Institute of Technology
This short course will begin with an introduction to linear regression analysis with R, including models for single/multiple predictors and model comparison techniques. Particular attention will be paid to using regression to test models involving mediation and moderation, followed by consideration of advanced topics including multivariate regression, use of polynomial regression, logistic regression, and the general linear model. Exploratory factor analysis and MANOVA will also be covered. For all topics, examples will be discussed and assignments completed using either data provided by the instructor or by the short course participants.
Required Software: R (download here), R Studio (download here)
Option 8: “Systematic Reviews and Meta-Analysis in R” – Dr. Ernest O’Boyle, Indiana University
Meta-analyses have now become a staple of research in the organizational sciences. Their purpose is to summarize and clarify the extant literature through systematic and transparent means. Meta-analyses help answer long-standing questions, address existing debates, and highlight opportunities for future research. Despite their prominence, knowledge and expertise in meta-analysis is still restricted to a relatively small group of scholars. This short course is intended to expand that group by familiarizing individuals with the key concepts and procedures of meta-analysis with a practical focus. Specifically, the goal is to provide the necessary tools to conduct and publish a meta-analysis/systematic review using best practices. We will cover how to; (a) develop research questions that can be addressed with meta-analysis, (b) conduct a thorough search of the literature, (c) provide accurate and reliable coding, (d) correct for various statistical artifacts, and (e) analyze bivariate relationships (e.g., correlations, mean differences) as well as multivariate ones using meta-regression and meta-SEM. The course is introductory, so no formal training in meta-analysis is needed. Familiarity with some basic statistical concepts such as sampling error, correlation, and variation is sufficient.
Required Software: R (download here), RStudio (download here)
November 9-20, 2020 – Two Sessions, Two Courses
Sponsored by University of South Australia
Session 1: November 9-13 | Session 2: November 16-20
We offer two sessions which allows course participants the opportunity to take two back-to-back courses.
| Session 1
Monday November 9 (time), Tuesday November 10 (all day), Thursday November 12 (time), and Friday November 13 (time) |
Session 2
Monday November 16 (time), Tuesday November 17 (all day), Thursday November 19 (time), and Friday November 20 (time) |
|
|
Session 1: November 9-13
“Doing Grounded Theory Research” – Dr. Glen Kreiner, The University of Utah
We will explore the process of conducing a grounded theory study. We will discuss generating research questions and interview protocols; collecting data (e.g., participatory, interview, secondary); the coding process; other data analytic processes beyond coding; generating a grounded model; and navigating the review process. We will examine how to ensure trustworthiness and rigor in grounded theory research, and consider challenges of conducting such research when you’ve been trained primarily in quantitative research. Our approach will be a mixture of readings discussion (exemplar and how-to articles) and hands-on exercises.
Session 2: November 16-20
“Mixed Methods and Qualitative Comparative Analysis”– Dr. Thomas Greckhamer, Louisiana State University
This course begins with an overview of mixed methods research designs, including sequential explanatory, exploratory, and transformational versions, as well as concurrent triangulation, nested, and transformative alternatives. Next, Qualitative Comparative Analysis (QCA) is introduced as an increasingly popular approach in management research that is relevant for qualitative and quantitative researchers alike. The course includes hands-on application of QCA, Crisp- and Fuzzy-Set analyses, the interpretation of QCA results, and the potential of using QCA as part of mixed methods research designs.