Skip to content
Menu

Evidence & methods

Honest numbers, or none

An AI business case is only as good as its evidence. This is how we measure outcomes, how we label claims, and what we will and won't publish.

Reviewed · Dipankar Sarkar

What every outcome record contains

We record each engagement's results in the same five parts, so outcomes can be compared and challenged.

PartWhat it captures
BaselineEffort, quality, cycle time and error rate before any change, measured on real work for long enough to be representative.
InterventionExactly what changed: tool, configuration, process step, review step, training. Including what we chose not to do.
Measured outcomeThe same measures after the change, over a comparable period, with the size of the sample.
LimitationsWhat the numbers don't show: small samples, seasonal effects, novelty effects, self-reported time.
Maintenance burdenOngoing review time, licence and run costs, evaluation re-runs and the owner responsible.

How we label claims

Every material statement in a brief, assessment or case study carries a source, a date and one of these labels. The labels stop weak signals from being turned into made-up demand, and stop demos from being mistaken for results.

Vendor claims are not test results

A vendor's benchmark tells you what a product can do under its maker's conditions. A test result tells you what it did on your work, judged against your threshold. We report the two separately and never combine them into one figure.

Hours released are not cash saved

Hours released are not cash savedIllustrative bars: effort before the change, effort after including review time, and how the released hours split into cash realised and capacity that is not cash.BeforeAfterReleased+ reviewcash realisednot cashIllustrative — not client data

If a workflow redesign frees up staff time, that capacity has value only once it's used. A business case has to say what happens to it: less overtime, a hire avoided, more throughput, better service — or nothing. Running costs come off the total: review time, licences, support and change management. The workflow economics calculator keeps these figures separate.

Worked examples (hypothetical)

These examples are illustrative. They are not client results. They show the method, not a benchmark.

Example A: 120 staff-hours a month

A redesigned reporting workflow releases an estimated 120 staff-hours a month at a loaded cost of £45 an hour. That time is worth £5,400 a month, but it is not cash.

Example B: the margin on a £20,000 implementation

For a principal-delivery engagement, the gap between the customer fee and a specialist's quote is not profit.

ItemAssumed amount
Customer fee£20,000
Specialist delivery−£9,000
Diagnosis, oversight and acceptance work−£3,000
Tooling and rework allowance−£1,000
Acquisition and presales−£2,000
Contribution before overhead and tax£5,000

We publish this example so buyers can see what they are paying for: the delivery, plus the accountability for whether it is accepted.

Published case studies

None yet. We publish case studies only with the client's written permission, with the five-part record above, and with their limitations stated. Until then we would rather show our method than make up a track record.

What we won't do

Want this rigour applied to your workflow?

An Opportunity Sprint produces a baseline, honest economics and a recommendation that may be 'don't build anything'.

Disclosure:Paid engagements are contracted and delivered by Neul Labs, which Dipankar Sarkar founded and leads. Playbook recommendations stay vendor-agnostic, and we do not publish supplier rankings.