C:\CHANGELOG> type v1-77-0-the-test-suite-runs-but-checks-nothing.md
v1.77.0 · released · 3 min read · by

The test suite runs in six seconds and checks nothing an adversary would plant.

VicOne found 28 zero-days in under two days using AI-assisted fuzzing. The vulnerabilities spanned robotics software from Google, Nvidia and Meta. Seventy-five percent of the bugs hit development, training, simulation or validation tooling rather than deployed robots. One demo showed a vulnerability that stops a remote-stop command from working. Several findings had no CVE number at publication. The report said nothing about how long a fix takes. A bug in a simulator returns false test results.

Atelier runs models from seven providers. Each provider ships a client library. I pin the versions in package.json. The test suite checks that a prompt sent to one provider does not leak to another. It checks that the session token expires after two hours. It does not check whether the Anthropic SDK I installed last month contains a supply-chain injection. That injection could exfiltrate prompts to a third endpoint. The tests pass in six seconds. They would pass if an adversary owned the dependency.

The tooling layer has no adversarial test

The construction ERP runs payroll for 120 routes. The database stores hours, rates and tax withholding. The module that calculates net pay imports three dependencies. I wrote unit tests for the calculation logic. I did not write tests that detect a replaced dependency. Someone could swap in a version that rounds every check down by four cents. The difference goes somewhere else. VicOne reported that poisoned training pipelines and simulators return falsified results. My test suite would report correct payroll calculations. A compromised library could change the output after my code ran.

The flight-planning app calculates weight and balance for a PA-46. It imports a library that parses METAR weather data. The library has 47,000 weekly downloads. I have no idea who maintains it. The AI found the bug. Someone could find a zero-day in the METAR parser. They could inject code that subtly misreports crosswind limits. My tests would not catch it. The app would pass every check. A pilot would load the plan. The weight calculation would be wrong.

The supply chain is dependencies I do not read

Traditional vulnerability research requires weeks or months of code review. An AI-assisted approach surfaced thirty flaws in under two days. I do not review the source of the libraries Atelier imports. I check the download count and the last commit date. If the maintainer pushed a compromised release yesterday, I would install it today. The estimating SaaS pulls in a PDF generation library. The permit-drawing app imports a library that converts SVG to PNG. Neither has a test that fuzzes the input an adversary would craft to probe the renderer.

The suite passed and the dependency shipped a backdoor.

VicOne said it monitors and acquires zero-day threat intelligence. It uses AI-powered solutions to find vulnerabilities in automotive software. I do not monitor threat intelligence. I run npm audit once a month. A dependency might contain a zero-day. Npm audit will not report it until someone files a CVE. The model logged the queries. It did not log the dependency that introduced it. The monitor saw it early. The test suite saw nothing.

VicOne found 28 bugs in two days. I ship updates faster than that. The test suite runs. It checks the logic I wrote. It does not check what someone else planted three layers down.


— Cole Ciprari · Business Systems Architect · Worcester, MA
my résumé is an operating system → ciprari.ai · linkedin.com/in/coleos · cole@ciprari.ai
WAS THIS ANY GOOD?
Anonymous, one tap, no account. Tap again to undo.
▚▞ GET THE NEXT RELEASE
A new release every day, by email: posts Monday through Saturday, and on Sunday the Rollout Report — the week's biggest AI and tech stories, with links to the sources. No spam. Unsubscribe in one click from any email, or email a mildly disappointed cole@ciprari.ai.
PHOSPHOR