Can your AI-generated test actually fail?

by

I built Code Factory after losing time to AI-generated tests that passed but failed in real use. The front door is now deliberately simple: run `factory first-proof --root .` and see a safe demonstration of whether a test can actually reject a known failure. It stays local and does not change your project.

For a solo developer or vibe coder, that is the whole starting value. For a team, `factory wrap` records the exact file delta from an admitted agent run, runs the validators the team declared, and leaves a reviewable receipt without retaining prompts or raw model output. Platform and assurance teams can evaluate the deeper policy and evidence controls in a pilot, but this beta does not claim an SLA, certification, customer references, or procurement readiness.

Version 0.44.3 also compares declared and observed product journeys, preserves the failed step in a bounded evidence capsule, checks state and cleanup, and audits the repairing agent separately. Human approval, apply, merge, release, credentials, and deployment remain outside Code Factory's authority.

Try it:

Source and release:

2 views

Add a comment

Replies

Be the first to comment