Last Witness: an AI detective for a dead 1999 website, graded on its ghosts
Web page · https://sergei-parfenov.com/blog/last-witness-ai-detective-dead-1999-website
This is a submission for the Hacktoberfest Open-Source AI Challenge Week 4: Ghost in the Machine ...
First seen by Oriel on .
AI summary
Last Witness is an open-source detective game and experiment in which locally running Gemma 4 reconstructs a fictional 1999 website’s disappearance from damaged archives, with sealed truth exposing unsupported claims and citation errors.
- The investigator reads only documents the player opens, cites sentence IDs with exact quotes, and must defend or withdraw claims after an Objection.
- A seeded archive-destruction process preserves fair evidence while hiding the sealed history; one of ten reconstruction questions is deliberately unanswerable.
- With the archive and thinking disabled, gemma4:e4b averaged 5.67 of 9 answerable questions correctly, never answered incorrectly, and produced no ghosts in the final form.
- Thinking raised gemma4:e4b to 7.33 of 9 but increased median response time from 101 to 586 seconds; gemma4:e2b made 1.33 wrong answers per run.
- The MIT-licensed implementation uses Python, FastAPI, SQLite FTS5, React, and TypeScript, comprising about 4,700 lines plus a 151-file fictional website.
#gemma #ollama #ai evaluation #citation checking
Generated by gpt-5.6-sol. Check the original for details.
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained
Reactions
Total public reactions reported by the source; distinct from points and likes.
- DEV Community: 22, latest observation ; +7 over observed period since
Comments
Comment count reported by the source.
- DEV Community: 6, latest observation ; +3 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| DEV Community | 4935157 | https://sergei-parfenov.com/blog/last-witness-ai-detective-dead-1999-website/ Read discussion |