The Howcroft Index · Field note
thomashowcroft.com
A one-page diagnostic
The AI pilot checklist.
The model is rarely the hard part. Ownership, acceptance criteria, failure handling and adoption decide whether a pilot becomes a dependable system or quietly dies. Sixteen questions. Score yours.
Tick every box that is honestly true today, not the ones you intend to fix. Empty boxes are your work list. The score updates as you go, and it prints clean if you would rather run it on paper.
01
Ownership
Who is accountable when it is wrong?
02
Acceptance criteria
How do you know it is good enough?
03
Failure handling
What happens when it breaks?
04
Adoption
Will people actually use it?13–16
Dependable.
You have a system, not an experiment. Scale it, and keep the empty boxes on the roadmap.
8–12
Fragile.
It works until it does not. Close the empty boxes before you put more weight on it.
0–7
Still a toy.
Impressive demo, no safety net. Do not put it in front of a customer yet.
From experiment to operating system
Most pilots stall on two or three of these boxes.
That gap is the work: defining ownership, evidence, failure controls and adoption around one valuable workflow until it is dependable. That is what I help leadership teams do.
Based on the essay Why AI experiments fail to become dependable systems.