We scanned 1,868 AI-built apps for production readiness, and audited our scanner
This is the post behind every number we publish about AI-built code. It has two halves, and the second one is the uncomfortable one. First: what we found scanning 1,868 public apps built with AI coding tools.
- ▪This is the post behind every number we publish about AI-built code.
- ▪It has two halves, and the second one is the uncomfortable one.
- ▪First: what we found scanning 1,868 public apps built with AI coding tools.
Opening excerpt (first ~120 words) tap to expand
This is the post behind every number we publish about AI-built code. It has two halves, and the second one is the uncomfortable one. First: what we found scanning 1,868 public apps built with AI coding tools. Second: how we audited our own scanner to make sure those numbers are honest, including the part where we discovered we'd been over-counting. The short version: most scanners never publish their false-positive rate. We measured ours on a representative sample of our critical findings, and it was about 42%. We fixed the classes behind it, re-scanned all 1,868 apps, cut the rate to about 25%, and the corrected numbers are below. If you arrived from a headline, this is where it has to defend itself.
…
Excerpt limited to ~120 words for fair-use compliance. The full article is at PathToShip.