926 Steps, Two Lobotomies, and Zero Nudges: Flight-Testing the Commitment Machine Across Gemini, Claude, and GPT-OSS
A 2026 Harvard study of 718 companies found that AI agents write 30% more code and close zero additional tickets because review times jump 49%. Here is what happened when I put my 1986 Commitment Machine into live production across Gemini, Claude, and GPT-OSS.
First seen by Oriel on .
AI summary
The author reports that a file-backed, Makefile-driven AI coding workflow reduced stale-ticket work and caught review issues in production runs, survived model context resets and a Claude-to-Gemini swap, but failed with GPT-OSS 120B.
- A read-only codebase archaeologist checked tickets against repository history, leading to one obsolete ticket being closed without code and another ticket's scope being cut in half.
- For TICKET-482, a pre-commit critic and widget test caught a Flutter post-await ScaffoldMessenger bug that flutter analyze missed; the workflow also consolidated 14 bot comments into one PR triage table.
- Numbered Markdown state files let the agent resume TICKET-227 after two context resets and let Gemini 4 continue a 960-step run after Claude Sonnet 4.6 hit a quota limit.
- The article says GPT-OSS 120B failed in the same workflow during a 791-step test, but the supplied text ends before detailing the test results.
#ai coding agents #llm agents #software engineering #code review
Generated by gpt-5.6-sol. Check the original for details.
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained
Reactions
Total public reactions reported by the source; distinct from points and likes.
- DEV Community: 34, latest observation ; +24 over observed period since
Comments
Comment count reported by the source.
- DEV Community: 49, latest observation ; +43 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| DEV Community | 4901412 | https://dev.to/gde/926-steps-two-lobotomies-and-zero-nudges-flight-testing-the-commitment-machine-across-gemini-55ca Read discussion |