WHITEBOXX / TEMPLATE

AI agent vendor
due diligence.

A free questionnaire for procurement, IT, security and risk teams buying an AI agent product. It has 32 questions in seven sections, the evidence to request for each, what a strong answer includes, and a scoring sheet for comparing up to three vendors.

Cover of the document
PDF · 12 pages · Free, no form
By Gautam Mehra · Published · Updated

What should you ask an AI agent vendor?

Start by checking that the product is really an agent: ask for a live run on your data and what happens when a step fails. Then ask about records, limits, data handling, testing, exit terms and compliance.

In June 2025, Gartner estimated that only about 130 of the thousands of vendors claiming agentic AI offered real agents. The same questions for every vendor make the answers comparable.

SECTIONS

The seven sections.

SECTIONS
SectionQuestionsWhat it checks
A. Is it really an agent?5Whether the product completes tasks on its own
B. Records and auditability6Whether a reviewer can reconstruct each run
C. Control and limits5Per-agent limits, approvals and a stop control
D. Data and security5Where data goes and whose permissions are used
E. Testing and quality4How accuracy is measured and monitored
F. Commercials and exit4Usage pricing and what you keep if you leave
G. Compliance3Support for the EU AI Act and human oversight

HOW TO USE IT

How do you use the questionnaire?

  1. 01

    Send it to each shortlisted vendor

    Ask for the evidence listed against each question.

  2. 02

    Score each answer

    2 for a direct answer with evidence, 1 for partial, 0 for vague or none.

  3. 03

    Compare by section

    Low scores on records or control matter most if the agent will act in your systems.

  4. 04

    Keep the answers

    Attach the written answers to the contract.

Download the questionnaire.

Free Excel template with scoring formulas for three vendors, and a 12-page PDF. No form to fill in.

Excel template (.xlsx) ↗PDF (12 pages) ↗