The Howcroft Index · Field note thomashowcroft.com

A one-page diagnostic

The AI pilot checklist.

The model is rarely the hard part. Ownership, acceptance criteria, failure handling and adoption decide whether a pilot becomes a dependable system or quietly dies. Sixteen questions. Score yours.

Tick every box that is honestly true today, not the ones you intend to fix. Empty boxes are your work list. The score updates as you go, and it prints clean if you would rather run it on paper.

0 / 16 true
Start tickingBe honest. Intentions do not count.
01

Ownership

Who is accountable when it is wrong?
02

Acceptance criteria

How do you know it is good enough?
03

Failure handling

What happens when it breaks?
04

Adoption

Will people actually use it?
13–16
Dependable.
You have a system, not an experiment. Scale it, and keep the empty boxes on the roadmap.
8–12
Fragile.
It works until it does not. Close the empty boxes before you put more weight on it.
0–7
Still a toy.
Impressive demo, no safety net. Do not put it in front of a customer yet.

From experiment to operating system

Most pilots stall on two or three of these boxes.

That gap is the work: defining ownership, evidence, failure controls and adoption around one valuable workflow until it is dependable. That is what I help leadership teams do.

Based on the essay Why AI experiments fail to become dependable systems.