Benchmark
Fewer confident mistakes. No leaked personal data.
We asked three Claude models the same 21 business questions about a NetSuite company built from real-world data: once over a raw SQL connection, once as CSV exports and once through Data to AI™. Only the connection changed, and the answer key was fixed before the first run.
21 questions, 3 runs each. 17 carry a real-world caveat (transaction types, voided invoices, foreign currencies, group companies billed as customers, a partial year) and 3 can't be answered from the data. Ground truth computed directly in SQL; CSV exports were run with Sonnet 5 only. Run date: 26 October 2026.