Black vs ExpenseSpy

A black-box evaluation of how AI-generated tests find functional bugs in live APIs.

ExpenseSpy automatically reads your receipts and exports them to Excel, CSV or PDF. Available on iOS and Android.

About Black

A black-box evaluation of how AI-generated tests find functional bugs in live APIs. The harder question is whether those tests find bugs. Each system receives only a JSON schema and one valid sample payload, then must generate API test cases that expose failures in a live reference API. The evaluation uses APIEval-20 v1.0, a black-box benchmark contributed by KushoAI. Because KushoAI is also one of the evaluated systems, this report includes the methodology, workflow definitions, repeated-run setup, and robustness checks so readers can understand where the performance difference comes from.

About ExpenseSpy

ExpenseSpy automatically reads your receipts and exports them to Excel, CSV or PDF. Available on iOS and Android. When you need more than 10 receipts in a month, that's when a subscription makes sense. You stay in control of every field before anything is saved. You can choose a summary view or a detailed line-by-line breakdown for each export, so the file is ready to hand to a client, an accountant, or your own spreadsheet.