Oriel — AI & technology worth noticing, every day.

926 Steps, Two Lobotomies, and Zero Nudges: Flight-Testing the Commitment Machine Across Gemini, Claude, and GPT-OSS

Post · https://dev.to/gde/926-steps-two-lobotomies-and-zero-nudges-flight-testing-the-commitment-machine-across-gemini-55ca

A 2026 Harvard study of 718 companies found that AI agents write 30% more code and close zero additional tickets because review times jump 49%. Here is what happened when I put my 1986 Commitment Machine into live production across Gemini, Claude, and GPT-OSS.

First seen by Oriel on .

AI summary

The author reports that a file-backed, Makefile-driven AI coding workflow reduced stale-ticket work and caught review issues in production runs, survived model context resets and a Claude-to-Gemini swap, but failed with GPT-OSS 120B.

  • A read-only codebase archaeologist checked tickets against repository history, leading to one obsolete ticket being closed without code and another ticket's scope being cut in half.
  • For TICKET-482, a pre-commit critic and widget test caught a Flutter post-await ScaffoldMessenger bug that flutter analyze missed; the workflow also consolidated 14 bot comments into one PR triage table.
  • Numbered Markdown state files let the agent resume TICKET-227 after two context resets and let Gemini 4 continue a 960-step run after Claude Sonnet 4.6 hit a quota limit.
  • The article says GPT-OSS 120B failed in the same workflow during a 791-step test, but the supplied text ends before detailing the test results.

#ai coding agents #llm agents #software engineering #code review

Generated by gpt-5.6-sol. Check the original for details.

Metric trends

Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained

Reactions

Total public reactions reported by the source; distinct from points and likes.

  • DEV Community: 34, latest observation ; +24 over observed period since

Comments

Comment count reported by the source.

  • DEV Community: 49, latest observation ; +43 over observed period since

Aliases

SourceExternal IDURL
DEV Community4901412https://dev.to/gde/926-steps-two-lobotomies-and-zero-nudges-flight-testing-the-commitment-machine-across-gemini-55ca Read discussion