Discussion about this post

User's avatar
Olga Ostrovskiy's avatar

The "fragile success trap" is the part I'd underline twice. I lead engineering on a product built by a small org of AI agents, and the two worst defects we caught this week were both GREEN tests, not red ones. One suite asserted that a component was imported — the gate it was guarding never actually rendered, and every check passed. An e2e spec tolerated two possible destinations and asserted on only one, so it passed while asserting nothing at all.

Neither was a model failure. Both were harness failures — which is exactly why your 10/90 split rings true. The fix wasn't a better prompt; it was rewriting the acceptance criteria as assertable negatives, so that "green" has to mean something before it's allowed to mean anything. That's the quiet argument for trajectory-aware evaluation: in both cases the final output looked fine. Only the path was wrong.

Nicolo' Caiti's avatar

Thank you for this brilliant update! Your breakdown of the shift from "vibe coding" to Spec-Driven Development is incredibly insightful. The concept of solving "Context Rot" through Agent Skills and progressive disclosure really stood out to me, as did the push for open protocols like MCP. It is exactly the kind of standardization the industry needs right now to move these systems from experiments to production.

I also curate a blog, and I am a big believer in supporting fellow writers in this fast-paced space. I would love for us to grow together—would you be open to exchanging subscriptions so we can keep up with each other's work?

Looking forward to the next issue (and best of luck with the AI Engineer interview prep)!

No posts

Ready for more?