Audit reproducibility of your published papers
Web page · https://agentusecases.ai/use-case/audit-reproducibility-of-your-published-papers
Done with Claude. A researcher used Claude to check the code and data of every journal paper they authored in the last five years and found significant reproducibility issues.
First seen by Oriel on .
AI summary
A researcher used Claude to audit five years of publicly available paper code and data, uncovering significant computational reproducibility issues despite open materials.
- Mike Frank audited every journal paper he had co-authored during the previous five years using Claude.
- The audit required publicly available code and data, but the page does not explain the mechanics, findings, or specific reproducibility failures.
- The page provides no counts, cost figures, or time estimates, directing readers to the linked blog post for details.
- A suggested workflow asks Claude to recreate environments, run analyses, compare figures and tables, and classify papers as reproduced, partially reproduced, or failed.
- The proposed report should identify causes including missing files, hardcoded paths, and unpinned dependencies while preserving original files.
#claude #reproducibility #research software #computational research
Generated by gpt-5.6-sol. Check the original for details.
Aliases
| Source | External ID | URL |
|---|---|---|
| Agent Use Cases | https://agentusecases.ai/use-case/audit-reproducibility-of-your-published-papers | https://agentusecases.ai/use-case/audit-reproducibility-of-your-published-papers Read discussion |