Goal

Produce a fully reproducible statistical report, in R, that demonstrates your mastery of the techniques we have covered during the classes.

You are free to choose any empirical dataset or study as long as the data allow you to apply (and justify) at least two of the advanced methods (see below).

How to Choose Your Dataset

• Public data repositories

  • Sources: Open Science Framework, Zenodo, Figshare, ICPSR, Kaggle, NIH/NASA archives

• Your own or lab data

  • Sources: Datasets maintained by your research lab; data from your experiments - current or old (perhaps re-analysing data from your BA project?)

• Published articles

  • Sources: Any journal related to cognitive science (look for papers with supplementary materials)

What to look for:

Datasets with more than 2 levels (e.g., students nested in schools), repeated measures, or multiple variables suitable for a complex linear model.

Minimum Statistical Content

• Classical tests
  • at least 1 hypothesis test (t, χ², binomial, or correlation) with effect size and power analysis
• Generalised Linear Models
  • at least one model with multiple nominal and continuous predictors. Report assumptions and model diagnostics
• Complex designs
  • Linear mixed-effects or hierarchical model
• Meta-analysis
  • Mini meta-analysis of at least 5 effect sizes relevant to some topic (you may combine public studies with those you conducted yourself or as part of your research lab)

Report Structure

1. Introduction
   • Background & theory
   • Clear specification of dependent/independent variables and structure of the dataset
   • Clear hypotheses that will be tested (it does not matter whether exploratory or confirmatory)
2. Methods
   • Pre-processing steps (handling of missing data, transformations)
3. Results
   • at least 5 tables (descriptives, model summaries, etc.)
   • at least 3 figures (diagnostic plots, interaction plots, forest plot, etc.)
   • Precise reporting of statistics (estimates, CI, p, effect size)
4. Discussion
   • Interpretation in light of hypotheses
   • Discussion of the statistical methods that were used