Socratizer

Online learning platform

Advanced statistical methods and models in experimental design

Bartosz Maćkiewicz

Course page for Cognitive Science students

Course Overview

  1. Syllabus
  2. List of topics
  3. R troubleshooting, or how to overcome most common problems
  4. How to Submit Assignments - Quarto (.qmd) Basics
  5. How to install R and RStudio? Instructions for Windows/Mac/Linux
  6. Tooling (R, RStudio, Quarto)
  7. Attendance rules
  8. Assessment and grading
  9. Presentation
  10. Policy on Academic Integrity and Use of AI Tools
  11. Exercise datasets
  12. Install R packages
  13. Assignment example
    14. homework_ex.qmd
    Quarto worksheet (.qmd)
    Due date: TBA

Week 01: Foundations & Reproducibility

  1. Presentation
  2. In-class lab
    3. walsh.csv
    Dataset for the lab
    week01_lab.qmd
    Quarto worksheet (.qmd)
    Due: end of lab.
  3. Readings

Week 02: Foundations & Reproducibility

  1. Presentation (Review)
    2. adams1996.csv
    Data from Adams et al. (1996) study
    compas1994.csv
    Data from Compas et al. (1994) study
    katz1990.csv
    Data from Katz et al. (1990) study
    unahborger2001.csv
    Data from Unah & Borger (2001) study
    wagner1988.csv
    Data from Wagner et al. (1988) study on stress and mental health
  2. Presentation (New statistics)
  3. In-class lab
    4. hoaglin1983.csv
    Hoaglin, Mosteller, & Tukey (1983): beta-endorphin before/after stress
    hout1987.csv
    Hout, Duncan, & Sobel (1987): married couples sexual satisfaction ratings
    kaufman1962.csv
    Kaufman & Rock (1962): moon illusion ratios
    week02_practice.qmd
    Quarto worksheet (.qmd)
    weinberg1986.csv
    Weinberg & Gladen (1986): cycles-to-pregnancy by smoking status
    Due: end of lab.
  4. Readings
  5. Interactive apps (Quarto + Shiny): confidence intervals & power
    6. Download the .qmd and run it locally (RStudio: Run Document / Terminal: quarto serve) to explore CI coverage and power via simulation.
  6. In-class lab 2
    7. infmort.xlsx
    Sub-Saharan Africa country-level dataset for correlation practice
    week02_lab2_correlation.qmd
    Quarto worksheet (.qmd)
    Due: end of lab.

Week 03: GLM Revisited (Regression)

  1. Presentation
    2. guber1999.csv
    Data from Guber (1999) study on state-level education spending and SAT outcomes
    wagner1988.csv
    Data from Wagner, Compas, and Howell (1988) study on stress and mental health
  2. In-class lab
    3. entailment_fc_items_rt.csv
    Data drom entailment forced-choice linguistics experiment (anonymized item-level summary): mean log RT, word counts, follow rates, domains
    week03_lab_regression_entailment_fc.qmd
    Quarto worksheet (.qmd)
    Due: end of lab.
  3. Readings

Week 04: GLM Revisited (ANOVA, Coding, Interactions)

  1. Presentation
    2. giancola2007.csv
    Data from Giancola et al. (2007) study
    hassles.csv
    Daily hassles, symptoms, and social support dataset used for interaction examples
  2. In-class lab
    3. entailment_fc_controls_items_follows.csv
    Exp7 entailment forced-choice (anonymized control items): follows rate by control type and validity
    entailment_fc_items_rt.csv
    Exp7 entailment forced-choice (anonymized item-level summary): mean log RT, word counts, follow rates, domains
    week04_lab_anova_interactions_entailment_fc.qmd
    Quarto worksheet (.qmd)
    Due: end of lab.
  3. Readings
  4. Homework 1: GLM fundamentals
    5. eysenck1974.csv
    Eysenck (1974) dataset
    hw01_glm_fundamentals.qmd
    Quarto worksheet (.qmd)
    Covers Weeks 3-4. Due date: 1.04.2026

Week 05: Diagnostics & Robustness (Assumptions, Outliers)

  1. Presentation
    2. guber1999.csv
    Data from Guber (1999) study on state-level education spending and SAT outcomes
  2. In-class lab
    3. week05_lab_diagnostics.qmd
    Quarto worksheet (.qmd)
    Due: end of lab.
  3. Readings

Week 06: Curvilinear Relationships & Transformations

  1. Presentation
    2. week06_practice_completion.csv
    Synthetic data: cumulative practice hours and task completion time
    week06_training_retention.csv
    Synthetic data: weekly training hours and skill retention
  2. In-class lab
    3. week06_lab_curvilinear_transformations.qmd
    Quarto worksheet (.qmd)
    week06_lab_queue_waiting.csv
    Synthetic dataset: queue length and waiting time
    week06_lab_router_speed.csv
    Synthetic dataset: router distance and download speed
    week06_lab_temperature_proofreading.csv
    Synthetic dataset: room temperature and proofreading score
    Due: end of lab.
  3. Readings

Week 15: Final Project Workshop

  1. Presentation
  2. Presentation checklist
  3. Readings
  4. Final project
    5. final_project_template.qmd
    Quarto template (.qmd)
    Final project (40% of course grade). Due date: TBA

Project Topic Bank (Optional)

  1. Project Topic Bank (Optional)
  2. Topic idea: Replication of Rochon et al. (2012)
    3. rochon2012.pdf
    Paper: Rochon et al. (2012) (PDF) — Simulation study on preliminary normality testing and the consequences for Type I error control.
  3. Topic idea: Replication of Weber & Sawilowsky (2009)
    4. weber2009.pdf
    Paper: Weber & Sawilowsky (2009) (PDF) — Simulation study comparing the power of Wilcoxon rank-sum, permutation t-test, and Student’s t-test under non-normality.
  4. Topic idea: Replication of Schucany & Ng (2006)
    5. schucany2006.pdf
    Paper: Schucany & Ng (2006) (PDF) — Simulation study arguing against formal pretests (e.g., Shapiro–Wilk) and recommending graphical diagnostics / robust alternatives.
  5. Shiny version of G-star-Power
  6. How To Not Be Confused About Documenting Data and Data Reuse
    7. arslan2019.pdf
    Paper: Arslan (2019) (PDF) — Paper on data documentation and codebooks in psychological science; a starting point for a documentation-focused project idea.
Copyright Mobbyn. All rights reserved.