Oriel — AI & technology worth noticing, every day.

Last Witness: an AI detective for a dead 1999 website, graded on its ghosts

Web page · https://sergei-parfenov.com/blog/last-witness-ai-detective-dead-1999-website

This is a submission for the Hacktoberfest Open-Source AI Challenge Week 4: Ghost in the Machine ...

First seen by Oriel on .

AI summary

Last Witness is an open-source detective game and experiment in which locally running Gemma 4 reconstructs a fictional 1999 website’s disappearance from damaged archives, with sealed truth exposing unsupported claims and citation errors.

  • The investigator reads only documents the player opens, cites sentence IDs with exact quotes, and must defend or withdraw claims after an Objection.
  • A seeded archive-destruction process preserves fair evidence while hiding the sealed history; one of ten reconstruction questions is deliberately unanswerable.
  • With the archive and thinking disabled, gemma4:e4b averaged 5.67 of 9 answerable questions correctly, never answered incorrectly, and produced no ghosts in the final form.
  • Thinking raised gemma4:e4b to 7.33 of 9 but increased median response time from 101 to 586 seconds; gemma4:e2b made 1.33 wrong answers per run.
  • The MIT-licensed implementation uses Python, FastAPI, SQLite FTS5, React, and TypeScript, comprising about 4,700 lines plus a 151-file fictional website.

#gemma #ollama #ai evaluation #citation checking

Generated by gpt-5.6-sol. Check the original for details.

Metric trends

Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained

Reactions

Total public reactions reported by the source; distinct from points and likes.

  • DEV Community: 22, latest observation ; +7 over observed period since

Comments

Comment count reported by the source.

  • DEV Community: 6, latest observation ; +3 over observed period since

Aliases

SourceExternal IDURL
DEV Community4935157https://sergei-parfenov.com/blog/last-witness-ai-detective-dead-1999-website/ Read discussion