#Testing
55% of the improvements an agent proposed for its own harness fixed one failure and broke something that worked. A PHP tutorial for a self-improving harness with the piece that makes it engineering: the regression gate. Git-versioned rules, failure mining, minimal rules, protected cases, provisional promotion and pruning.
Across 54 cycles, the agent said it improved every time. In 56%, nothing changed or it got worse. The progress mirage measured in a paper, why a bigger LLM judge doesn't fix it, and how to build a Laravel loop with an external verification gate: checkable exit, hard budget, and a guard that stops the agent from editing its own exam.
Vibe coding with an agent in Laravel works until the feature has business rules. Then the agent makes things up. Spec-Driven Development fixes that by turning the specification into the source of truth. In this post we walk through the PRD, spec, plan, tasks, code and tests cycle on a feature that looks silly: exporting a sales report as a PDF. PHP stack, Claude Code and Spec Kit, from scratch.