Black vs PDF Insight

A black-box evaluation of how AI-generated tests find functional bugs in live APIs.

This is what PDF Insight does to a real client's pile: it reads, classifies and merges every slip into one correctly-ordered file.

About Black

A black-box evaluation of how AI-generated tests find functional bugs in live APIs. The harder question is whether those tests find bugs. Each system receives only a JSON schema and one valid sample payload, then must generate API test cases that expose failures in a live reference API. The evaluation uses APIEval-20 v1.0, a black-box benchmark contributed by KushoAI. Because KushoAI is also one of the evaluated systems, this report includes the methodology, workflow definitions, repeated-run setup, and robustness checks so readers can understand where the performance difference comes from.

About PDF Insight

This is what PDF Insight does to a real client's pile: it reads, classifies and merges every slip into one correctly-ordered file. The full run happens on your own machine, so client files never leave your computer. Self-employed: turn a year of receipts and statements into one clean PDF to send your accountant. PDF Insight reads and classifies every document, even scanned pages, orders them your way, lets you review, and exports one clean merged file.