Findings on Summer Learning Loss Often Fail to Replicate, Even in Recent Data
Joseph Workman; Paul von Hippel; Joseph J. Merry · 2023 · Sociological Science
WASTE classifies this as Replication Failure · AI classification, approximate
A previously reported effect did not replicate here — verify it holds before you build on it.
Abstract
It is widely believed that (1) children lose months of reading and math skills over summer vacation and that (2) inequality in skills grows much faster during summer than during school. Concerns have been raised about the replicability of evidence for these claims, but an impression may exist that nonreplicable findings are limited to older studies. After reviewing the 100-year history of nonreplicable results on summer learning, we compared three recent data sources (ECLS- K:2011, NWEA, and Renaissance) that tracked U.S. elementary students' skills through school years and summers in the 2010
Abstract by Joseph Workman; Paul von Hippel; Joseph J. Merry, Sociological Science (2023) — licensed CC BY 4.0.
About to run something similar?
Run an AI Precheck on your own design to catch failure modes like this one before you spend the time. Your first desk check is free.
Related failures
Investigating Variation in Replicability
Negative / Null Result ReportMany Labs 2: Investigating Variation in Replicability Across Samples and Settings
Failed Experiment ReportGetting Ahead in the Communist Party: Explaining the Advancement of Central Committee Members in China
Negative / Null Result ReportReducing implicit racial preferences: II. Intervention effectiveness across time.
Negative / Null Result ReportTHE IMPACT OF IMMIGRATION ON THE STRUCTURE OF WAGES: THEORY AND EVIDENCE FROM BRITAIN
Negative / Null Result ReportRevisiting the Marshmallow Test: A Conceptual Replication Investigating Links Between Early Delay of Gratification and Later Outcomes
WASTE indexes this work — it does not host or republish it. Failure-type classification is automated and approximate.
Metadata source: OpenAlex · DOI 10.15195/v10.a8