Oriel — AI & technology worth noticing, every day.

Audit reproducibility of your published papers

Web page · https://agentusecases.ai/use-case/audit-reproducibility-of-your-published-papers

Done with Claude. A researcher used Claude to check the code and data of every journal paper they authored in the last five years and found significant reproducibility issues.

First seen by Oriel on .

AI summary

A researcher used Claude to audit five years of publicly available paper code and data, uncovering significant computational reproducibility issues despite open materials.

  • Mike Frank audited every journal paper he had co-authored during the previous five years using Claude.
  • The audit required publicly available code and data, but the page does not explain the mechanics, findings, or specific reproducibility failures.
  • The page provides no counts, cost figures, or time estimates, directing readers to the linked blog post for details.
  • A suggested workflow asks Claude to recreate environments, run analyses, compare figures and tables, and classify papers as reproduced, partially reproduced, or failed.
  • The proposed report should identify causes including missing files, hardcoded paths, and unpinned dependencies while preserving original files.

#claude #reproducibility #research software #computational research

Generated by gpt-5.6-sol. Check the original for details.

Aliases

SourceExternal IDURL
Agent Use Caseshttps://agentusecases.ai/use-case/audit-reproducibility-of-your-published-papershttps://agentusecases.ai/use-case/audit-reproducibility-of-your-published-papers Read discussion