The Polyglot's Dilemma: Conformance Testing a Dozen Specs in as Many Languages
Web page · https://emptysqua.re/blog/polyglots-dilemma
First seen by Oriel on .
AI summary
MongoDB’s YAML-based Unified Test Format keeps native drivers across a dozen languages conformant with shared specifications while substantially reducing duplicated test-runner code.
- Nearly 1,500 YAML files test driver behavior across reading, writing, retries, transactions, client-side encryption, and other intricate features.
- Each driver implements a runner that translates shared YAML operations into idiomatic native APIs and validates files against versioned JSON Schema definitions.
- Tests can inject server failures, inspect wire commands and internal events, verify connection-pool clearing, and confirm exactly-once outcomes that ordinary integration tests cannot observe.
- Seven drivers consolidated per-spec runners in 2020, eliminating 22,000 lines of code, including 6,000 from the Java Driver.
- Four of five studied drivers had lower CRUD specification bug rates after adoption; Node.js worsened because its runner insufficiently checked BulkWriteResult and BulkWriteError contents.
#mongodb #conformance testing #yaml #database drivers
Generated by gpt-5.6-sol. Check the original for details.
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained
Points
Score reported by the source.
- Lobsters: 4, latest observation ; +3 over observed period since
Comments
Comment count reported by the source.
- Lobsters: 1, latest observation ; +1 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| Lobsters | gzpdsk | https://emptysqua.re/blog/polyglots-dilemma/ Read discussion |