The Real Cost of an AI Pilot That Never Ships
When an AI pilot fizzles, the accounting is usually one line: we spent $X on licenses, it didn't pan out, lesson learned. Cheap tuition, everyone moves on.
That accounting is wrong by roughly an order of magnitude. The license fee is the smallest and least important number in a failed pilot, and because it's the only number anyone writes down, organizations keep concluding that failed pilots are cheap. They aren't.
What follows is an illustrative tally, not survey data. The assumptions: fifteen participants plus a project lead, a ten-week pilot, a blended $60 an hour. Swap in your own numbers; the shape survives.
The visible number
Say a mid-sized operations team pilots an AI tool: fifteen seats for three months at $40 a seat. $1,800. That's the number in the postmortem, and if it were the real cost, running loose pilots would be a perfectly rational strategy. Spray, pray, and shrug.
Now the numbers that don't make the postmortem.
The invisible numbers
Staff hours. A pilot consumes people even when it's failing. Especially when it's failing, because ambiguity generates meetings. Vendor evaluation and demos, a kickoff, training sessions, the weekly check-in that runs for ten weeks, the IT and security review, the manager quietly nudging people to "give the tool a chance," and the individual hours spent fumbling with a workflow that has both an old path and a new path. Tally it honestly for fifteen participants plus a project lead and you land somewhere between 250 and 400 person-hours. At the blended $60, that's $15,000 to $24,000, which with the licenses puts the true cost of the pilot in the neighborhood of twenty thousand dollars, not eighteen hundred. Paid, worse, in the most constrained currency an operations team has: its people's attention.
Opportunity cost. These are the same hours as above, viewed from the other side: not what they cost, but what they could have produced instead. Count them once in your total; feel them twice. Pointed at a well-chosen workflow, three months of that attention is enough to fully automate one intake process or one reporting cycle. If the workflow you didn't fix wastes ten hours a week, the stall cost you roughly 130 recovered hours per quarter, every quarter, going forward. That number compounds while the license fee doesn't.
The credibility spend. This is the expensive one, and it never appears in any ledger. A failed pilot teaches your team a lesson, and the lesson is: AI initiatives here don't go anywhere. That lesson has a half-life measured in years. The next time someone proposes an AI project, the fifteen people from the last pilot are the skeptics in the room, reasonably, based on evidence you handed them. Attempt two now needs a champion with more political capital, a better tool, and a cleaner rollout just to reach the level of goodwill attempt one got for free. I have watched organizations still paying interest on a botched rollout five years later. I saw it repeatedly in the Microsoft 365 era, and the AI version is the same debt at a higher rate, because "we tried AI" generalizes across every AI proposal that follows.
Why this changes the strategy, not just the accounting
If failed pilots cost $1,800, the right strategy is to run many and see what sticks. If they cost twenty-some thousand dollars and a multi-year credibility debt, the right strategy inverts: run fewer pilots, choose them carefully, and design each one so it cannot end ambiguously.
Ambiguity is the actual killer. Most pilots don't fail loudly; they trail off, undecided, which means the organization pays full cost and receives no verdict. Even a clean kill would have been a win by comparison: a real answer, delivered before the invisible costs compound.
The question that protects the budget
Before your next pilot starts, ask the sponsor one question: what happens on day 31?
If the answer is specific ("we compare against the baseline and the ops manager decides"), you're about to spend money on an experiment, which is fine. If the answer is "we'll see how it's going," you're about to spend twenty-odd thousand dollars and a year of credibility to learn nothing, and the license fee will take the blame.
Structuring pilots so they can't end that way is usually what my first engagement with a client is. If yours starts this quarter, the cheap time to talk is before it kicks off.