EVALUATE · You deploy AI in your business processes
Check of a third-party AI
Before signing or while you already use it: the supplier's AI, LLM assistants and agents included, against the use you give it or will give it.
ISO/IEC 23894
It is a starting point: the recipe is adapted to your company.

Evaluate
Verify and validate its safety and impact: what can go wrong, who it affects and whether the controls work.
You get
What it meets, what it does not and what to ask the supplier.
What sets it apart
We test it with cases from your real use; we do not stop at what the provider declares.
What we evaluate, by type of system
Models that predict or classify
Performance, robustness, bias and fairness across groups.
Language models
Hallucinations, toxicity, prompt injection and data leakage.
Agents
What they can do and with which permissions, whether every step can be reconstructed, and whether oversight stops them in time when errors are planted on purpose.
Human oversight →
And whatever your use requires.
How we work
Your intended use
EVALUATE · first step
What you will use the supplier's AI for, on whom and in which decisions.
What the supplier declares
EVALUATE · with its documentation
Instructions for use, known limitations, the data it was trained on and what it claims to meet.
Check against your use
EVALUATE · with your cases
We test the system with cases from your real use and look for the risks your use adds.
Is it a customer-facing chatbot? We test it against what it promises.
What Article 50 requires →What to ask the supplier
GOVERN · before signing or in use
What it meets, what it does not and what to require by contract: information, notice of changes and incidents. Buying it, keeping it or switching is your call.
What we leave running
Your intended use, in writing
What you use the provider's AI for, on whom and in which decisions.
The check with your cases
With your real cases, by type of system.
What to ask the provider
Information, notice of changes and incidents, ready for the contract.
What changes for your team
Stays the same
- The provider you choose
- The way you buy
Changes
- The AI is checked against your use before signing
- The contract asks for what your use needs
- You know what to watch once you use it
Other starting points
You deploy AI in your business processes