Skip to main content
All Reviews
PsychologyMust Read
intermediate

Investigating Variation in Replicability

Richard A. Klein et al. (2014)

Published
May 1, 2014
Journal
Social Psychology · Vol. 45 · No. 3
DOI
10.1027/1864-9335/a000178

At a GlanceAI

36 labs, 6,344 participants, 13 effects — and the answer depends more on the effect than on who tests it.

SummaryAI

The first "Many Labs" project. 13 classic and contemporary effects replicated across 36 independent samples. In aggregate: 10 of 13 effects replicated consistently, 1 showed weak support, and 2 (flag priming, currency priming) did not replicate at all. Crucially, variation in effect size across labs was small — replicability depended on the effect itself, not the sample or setting. Lab-vs-online and US-vs-international differences were negligible.

Method Snapshot

multi-lab replication

Background

Basic statistics

A good start for understanding the context. The first replications were on well-known experiments and effects and showed very good results.

ES