e-ISSN: Pending
Negative / Null Result ReportOpen accessMedicine

Born to fail: flaws in replication design produce intended results

Abraham D. Flaxman; Riley Hazard; Ian Riley; Alan D. Lopez; Christopher J. L. Murray · 2020 · BMC Medicine

WASTE classifies this as Negative / Null Result Report · AI classification, approximate

The study found no significant effect — useful as a negative control or null benchmark for your own design.

The finding, in one line

The developers of this software claim to have failed to replicate our results and appear to have also failed to locate our replication archive for this work.

Abstract

Abstract We recently published in BMC Medicine an evaluation of the comparative diagnostic performance of InSilicoVA, a software to map the underlying causes of death from verbal autopsy interviews. The developers of this software claim to have failed to replicate our results and appear to have also failed to locate our replication archive for this work. In this Correspondence, we provide feedback on how this might have been done more usefully and offer some suggestions to improve future attempts at reproducible research. We also offer an alternative interpretation of the results presented by

Abstract by Abraham D. Flaxman; Riley Hazard; Ian Riley; Alan D. Lopez; Christopher J. L. Murray, BMC Medicine (2020) — licensed CC BY 4.0.

About to run something similar?

Run an AI Precheck on your own design to catch failure modes like this one before you spend the time. Your first desk check is free.

WASTE indexes this work — it does not host or republish it. Failure-type classification is automated and approximate.

Metadata source: DOAJ · DOI 10.1186/s12916-020-01517-w