For when
“Our pilot works in a demo but is not ready for staff.”
Usually commissioned by: CTO, product owner, engineering lead.
What you get
- Evaluation results on your own examples, with the errors observed and their causes
- Integration, security and data-flow gaps
- Risk register with an owner and a proposed control for each risk
- Prioritised remediation backlog with effort estimates
- Go / fix-then-go / stop recommendation with the evidence behind it
Acceptance condition
The buyer understands what blocks deployment, the next investment required, and the evidence that would justify it.
How it runs
- 1
Agree the deployment decision the review must inform and the acceptance threshold
- 2
Build an evaluation set from real examples with the business owner
- 3
Run the evaluation, review the architecture and trace the data flows
- 4
Readout: findings, backlog and recommendation
It may conclude…
Stop the pilot, or replace it with a simpler approach. We do not recommend rebuilding everything by default — the value is identifying the minimum justified intervention.
Not included
- Implementing the remediation (available separately)
- Penetration testing
- Legal opinion
Read before you decide
Free guides that cover the same ground. Plenty of teams get what they need from these alone.
What should require human approval for AI agents?
Decide which AI agent actions need human approval by mapping reversibility, blast radius and confidence, then choosing an approval pattern and controls.
Why does our internal knowledge assistant give bad answers?
Diagnose a poor internal knowledge assistant: classify failures, build an evaluation set from real questions, and apply the cheapest fixes before rebuilding.
Can staff use AI with internal documents?
How to decide whether staff may use AI with internal documents: approve a workflow's data flow, match information classes to tool tiers, and check the contract.
Why AI pilots stall — and what production-ready actually requires
The common reasons AI pilots never reach production, a production-readiness checklist, and how to decide go, fix-then-go or stop.
Discuss a Pilot Readiness Review
Send a short project brief. A person reads it and replies with whether this engagement fits, a different one would, or none is needed.