WHITEBOXX / TEMPLATE
AI agent vendor
due diligence.
A free questionnaire for procurement, IT, security and risk teams buying an AI agent product. It has 32 questions in seven sections, the evidence to request for each, what a strong answer includes, and a scoring sheet for comparing up to three vendors.

What should you ask an AI agent vendor?
Start by checking that the product is really an agent: ask for a live run on your data and what happens when a step fails. Then ask about records, limits, data handling, testing, exit terms and compliance.
In June 2025, Gartner estimated that only about 130 of the thousands of vendors claiming agentic AI offered real agents. The same questions for every vendor make the answers comparable.
SECTIONS
The seven sections.
| Section | Questions | What it checks |
|---|---|---|
| A. Is it really an agent? | 5 | Whether the product completes tasks on its own |
| B. Records and auditability | 6 | Whether a reviewer can reconstruct each run |
| C. Control and limits | 5 | Per-agent limits, approvals and a stop control |
| D. Data and security | 5 | Where data goes and whose permissions are used |
| E. Testing and quality | 4 | How accuracy is measured and monitored |
| F. Commercials and exit | 4 | Usage pricing and what you keep if you leave |
| G. Compliance | 3 | Support for the EU AI Act and human oversight |
HOW TO USE IT
How do you use the questionnaire?
- 01
Send it to each shortlisted vendor
Ask for the evidence listed against each question.
- 02
Score each answer
2 for a direct answer with evidence, 1 for partial, 0 for vague or none.
- 03
Compare by section
Low scores on records or control matter most if the agent will act in your systems.
- 04
Keep the answers
Attach the written answers to the contract.
Download the questionnaire.
Free Excel template with scoring formulas for three vendors, and a 12-page PDF. No form to fill in.
Excel template (.xlsx) ↗PDF (12 pages) ↗