CaseIntermediateShipping & Model Lifecycle / Pilot design and POC-to-production / #11

How do you avoid a pilot that runs indefinitely?

The direct answer
Before a pilot starts, put a real end date on the calendar, tied to something that actually happens on that date, and name one person on each side who signs off go or no-go when it arrives. Any extension past that date has to be a new, written, dated decision, never a default. That doesn't guarantee the pilot ends in the right call. It only guarantees a call gets made, instead of the pilot just quietly continuing because stopping is the one step nobody was ever forced to do.
Do this, in order
  1. Put a real end date on the calendar before the pilot starts, and name one owner on each side who signs off that day.Why: without both, extending it never needs anyone's permission, and only ending it does.
  2. Tie the date to something real, a budget cycle, a renewal, an order deadline, not a rough guess like "about six weeks."Why: a soft date drifts the exact same way a missing one does.
  3. Make every extension a new, written, dated decision, never a quiet default.Why: a default costs nobody anything to choose; a written decision costs somebody a sentence they have to say out loud.
  4. Track what the pilot is actually costing while it runs past its date.Why: the real bill stays invisible until somebody stumbles onto it, and by then it's already large.
  5. Skip bolting a hard date onto a pilot that already has one built in.Why: a trial that expires on its own, or one tied to an existing contract date, doesn't need a second calendar reminder.

How to answer this, stage by stage

Seven moves. Name what a fixed date can and can't buy you before the story, or the answer sounds like a scheduling tip instead of a decision.

1
Scope it to one pilot and one open question
Say it like this
"Let's make this concrete. Isabel Petrakis runs product for Beaconwell, a tool that scores every public mention of a brand for how likely it is to turn into a real PR problem. Halfmoon, a skincare and home-fragrance brand, is piloting it with their four-person communications team. The question in front of Isabel is what stops that pilot from just running forever."
Why this works
A question about indefinite pilots stays abstract until it's tied to one real pilot with a real, missing end date.
2
Say your structure out loud
Say it like this
"I'll walk this through LEAD. L is the real outcome a fixed timeline actually protects. E is the early signal, a hard end date and a named decision-maker, set before day one. A is how that date gets gamed when nobody wrote it down. D is what even a real date still can't promise you."
Why this works
Naming the four letters up front tells the interviewer you're about to make a call, not describe a project timeline.
3
Reframe what the question is actually checking
Say it like this
"This sounds like a question about scheduling. It's really asking what makes 'stop' cost something. Without a forced moment to decide, continuing is always the easier answer, because nobody ever has to say it out loud."
Why this works
This moves the answer from "set a timeline" to naming exactly what an indefinite pilot is missing: a moment where continuing has a price.
4
Give the decision straight
Say it like this
"Here's the answer. Before the pilot starts, put a real end date on the calendar, tied to something that actually happens on that date, and name one person on each side who signs off go or no-go when it arrives. That doesn't guarantee the right call gets made. It guarantees a call gets made at all."
Why this works
This names exactly what the date buys and doesn't buy, instead of a vague "set clear timelines."
5
Prove it with the number that shows the drift
Say it like this
"Here's why that matters. Halfmoon and Beaconwell planned a six-week pilot with forty engineering hours budgeted. It ran for twenty-two weeks. It cost three hundred and ten hours. Nobody ever said no. Nobody ever said yes either. Four separate times, someone said 'let's do one more month,' and every single time, that sounded completely reasonable."
Why this works
One real number that kept climbing quietly does more work than a paragraph about the importance of deadlines.
6
Name the gaming path
Say it like this
"Nobody was stalling on purpose. Halfmoon's team kept saying 'we're still finalizing budget' and 'we just had a leadership reshuffle,' and every reason was true. That's exactly how a pilot without a hard date gets gamed. Extending it never needs anyone's permission. Only stopping does."
Why this works
Naming the exact mechanism, true reasons that never add up to a decision, is what separates this from a generic "set deadlines" answer.
7
Close on the hard limit and the artifact together
Say it like this
"And here's the limit, worth saying out loud. A hard end date doesn't mean Halfmoon says yes. It just means somebody has to say something. So if I could change one thing about how Isabel ran this: at kickoff, a dated invite, six weeks out, tied to Halfmoon's own budget cycle, with one name attached to who decides that day. Not because a pilot needs paperwork. Because 'we'll know when we know' is how five months disappear without anyone deciding a thing."
Why this works
Naming the boundary and closing on the artifact together gives the interviewer both the honest limit and something they could actually go build.

Let's learn

What happens to a pilot that never gets a real end date?

Say a company builds a tool that reads every public post and comment about a brand and scores how likely each spike in complaints is to turn into a real story, before a journalist ever calls.

Knowledge spark: what's a brewing PR problem? A handful of angry posts is normal for any brand, most days. A brewing PR problem is different: the same complaint, spreading fast, from accounts that don't usually talk to each other. That pattern, not the raw number of posts, is what a risk score is trying to catch early.

Before the pilot, Halfmoon's four-person communications team spent about ninety minutes every morning combing through saved searches by hand. They usually caught a real problem about a day after it started, once thirty or more comments had already piled up.

With Beaconwell running, the tool scored every public mention in real time and flagged a likely brewing problem about fourteen hours earlier on average. The morning scan dropped from ninety minutes to about ten. By week six, nobody on either side was arguing about whether the tool worked. It clearly did.

Here's the turn. Whether the tool worked was never really the open question. The open question, whether Halfmoon would actually buy, still hadn't been answered five months later, because nobody had ever written down when someone had to decide.

We didn't lose five months to a hard question. We lost it to a question nobody ever had to answer out loud.

At its worst, that gap doesn't just waste time. Every week the pilot ran unresolved, it looked, from the outside, like an active enterprise deal in progress. Beaconwell's sales team quietly deprioritized two other prospective customers because "we're deep in a complex pilot already." The pilot cost real customers who were never part of the story.

Weeks since Halfmoon's pilot last had a real go-or-no-go decision, tracked across five months nobody was watching
Nobody's job to notice this line was climbing +0 wks +4 wks +8 wks +12 wks +16 wks Week 6, planned end Week 10 Week 14 Week 18 Week 22, Booker asks
Every point on this line looked reasonable by itself, "just one more month." Nobody was tracking the line. Somebody only noticed the drift when Beaconwell's new director of engineering, Booker Sennett, asked in a resourcing meeting whether Halfmoon was actually a customer yet.

The cost that line was quietly predicting only became visible once somebody finally added it up.

Engineering hours spent on the Halfmoon pilot, budgeted against actual by week 22
40
Budgeted at kickoff, for a six-week pilot
310
Actual, by week 22, with no decision either way
Almost eight times the budgeted hours, spent keeping a pilot alive that nobody had agreed to extend on paper even once.
A hand-sketch comparison diagram titled Same pilot, stamped again. On the left, a page icon labeled Stamped again, captioned one more month, times four, each one reasonable alone. On the right, a small figure labeled Quietly gone, captioned 310 engineer hours, two other customers. A hand-lettered VS sits between them.
Four reasonable stamps on the left. Real customers and real hours quietly gone on the right. Nobody signed off on either.
The choice I'd take back At kickoff, when Halfmoon's VP of communications asked what happens at the end of six weeks, Isabel said, "let's run it about six weeks and see how it feels, we'll know when we know." It sounded careful, not careless. I'd take it back and replace it with a real date, tied to Halfmoon's own budget cycle, and one name on each side who signs off that day.

What I'd leave alone. A free trial that technically expires on its own when the license runs out doesn't need this. Neither does a one-person internal test with no external customer waiting and no other prospect's time being spent instead. The ceremony only earns its place where a real decision, and real resources, are quietly waiting on somebody to say something.

The lesson. A pilot with no end date doesn't fail to reach a decision. It just spends month after month being decided by default, in the one direction that never needs anyone's signature: keep going.

Now here is the same thing as a story

Use this version when you've got a few minutes. The short version is above. This is for when the decision needs to survive more than one meeting.

For five months, Isabel's answer to "how's the Halfmoon pilot going" was always the same word: fine.

She'd run eleven pilots in three years at Beaconwell, and she was good at the parts everyone worries about, tuning a model's sensitivity, writing a rollout plan, keeping a prospect's engineering team from going quiet on her. Halfmoon was supposed to be an easy one. A four-person communications team, a clear use case, a VP of communications, Elian Farrant, who asked smart questions in the first meeting.

At kickoff, in a small conference room, Isabel and Elian set up a recurring thirty-minute calendar invite titled "Halfmoon x Beaconwell check-in." Elian asked the one real question anyone asked that day. "So what happens at the end of six weeks?" Isabel said, "let's run it about six weeks and see how it feels, we'll know when we know." Elian nodded. It sounded reasonable, even careful.

The first month was genuinely good. Full readouts every two weeks, Halfmoon's whole comms team in the room, real numbers on the screen. Then the readouts thinned to monthly, just Isabel and Elian. By week ten, the recurring invite mostly ran itself, three bullet points copied forward from the week before, nobody prepping anything new for it.

Week six arrived, the day the invite had quietly been standing in for a decision. Elian said, "we're still finalizing budget on our side, can we do one more month?" Isabel said sure. It felt like nothing.

Week ten. "We just had a leadership reshuffle, give us another month." Sure.

Week fourteen. "There's a product launch we need to get through first, let's revisit after." Sure.

Week eighteen. Nobody even framed it as a question anymore. The invite just kept recurring.

Nobody was stalling on purpose. Every single reason Elian gave was true. That's exactly how a pilot with no hard date gets gamed, not by anyone lying, but by nobody ever having to justify continuing.

Week twenty-two. Beaconwell's new director of engineering, Booker Sennett, sat in his first resourcing meeting and asked a question that wasn't meant to be pointed. "Wait, is Halfmoon a customer or not?" Isabel opened her mouth to answer and realized she couldn't. Not with a date. Not with a name. Just "we're still in pilot," the same sentence she'd been saying since week six.

She pulled the numbers that afternoon. Forty hours had been budgeted for a six-week pilot. The actual number, by week twenty-two, was three hundred and ten. Two prospective customers had been quietly told Beaconwell's engineering team was tied up in "a complex enterprise pilot" during exactly those months.

Two months earlier, at kickoff, Elian had actually asked the right question. "So what happens at the end of six weeks?" Isabel remembers answering, "let's run it about six weeks and see how it feels, we'll know when we know," and the room nodded, because it sounded reasonable, even generous. Nobody circled back to pin it down. It just quietly became the plan.

I would take that back. I'd have said, in that same kickoff meeting, "before we start the clock, I want a real date on the calendar, tied to your next budget cycle, and I want to know now who on your side signs off go or no-go when that date arrives. If we need more time later, that's a new, dated ask, not a default."

Here's the replay. Same six-week plan, but this time the recurring invite carries an actual date tied to Halfmoon's quarterly budget lock, with Elian named as the sign-off owner on Halfmoon's side and Isabel's VP of sales named on Beaconwell's. Week six arrives, and the invite that day isn't a check-in. It's a decision meeting. Elian either signs, or she doesn't, or she asks for a new, dated extension in writing. The total engineering cost stays close to the forty hours planned, because nobody quietly refills the tank four separate times without anyone noticing.

One design let the pilot answer for itself by never ending. The other made a person answer, on a date they'd agreed to six weeks in advance.

And the thing I'd tell myself, back in that kickoff room: "we'll know when we know" isn't patience. It's agreeing in advance that nobody has to decide.

LEAD, so a pilot can't just quietly keep going

This sounds like a question about scheduling. Underneath, it's still asking what makes "stop" cost something. That's LEAD, run on a pilot's own calendar instead of a dashboard.

L, link. The real outcome a fixed timeline protects. Not the model's performance in isolation. Whether a real decision gets made at all, freeing resources in either direction, instead of the pilot just continuing by default. → Here, that's whether Halfmoon's yes or no gets said on a real date, not left open for five months.
E, early signal. A hard end date and a named decision-maker on each side, set before the pilot starts, not decided informally as it goes. → A calendar date tied to Halfmoon's own budget cycle, with Elian named as the owner who signs off that day, agreed at kickoff, not discovered later.
A, abuse. How the end date gets gamed without pre-agreement. Extending it "just one more month," over and over, because nobody ever has to formally justify stopping. → Four separate one-month extensions, each backed by a true and reasonable-sounding reason, none of them written down as a real decision.
D, decision. What a fixed end date genuinely cannot guarantee. That the decision made at that date will be the right one, only that a decision gets made. → Even a hard date on week six wouldn't have guaranteed Halfmoon says yes. It would only have guaranteed somebody said something, instead of the silence that actually happened.
The check that proves the date is real Ask both sides, at kickoff: "if today were the end date, would you make the call right now?" If either side says "we'd need more time," the date isn't a real deadline yet, it's just a target.

And if you want to be sure it really works, try it somewhere else

Featherstone Growers Collective is a cooperative of about forty small farms in one growing region. Behrouz Obuya leads product for Halversen, a tool that reads field images and sensor feeds to flag crop-disease risk early enough for a grower to spray before an outbreak spreads. Featherstone agreed to an eight-week pilot across the region.

L. Whether Featherstone actually decides, commit before next season's seed and fungicide orders lock in, or free Halversen's one field agronomist to work with a different co-op, instead of the pilot just quietly ending when the growing season does.
E. A hard end date tied to Featherstone's own planting-order deadline, a real date that happens whether or not anyone decides about the tool, with the co-op's general manager named as the one who signs off.
A. Without that, "let's just get through harvest and then decide" rolled forward across three separate check-ins, each one sounding sensible, until the growing season simply ended.
D. A hard date tied to the planting deadline wouldn't guarantee Featherstone picks Halversen over doing it by eye next year. It would only guarantee somebody actually says which one, instead of the co-op going quiet.
Knowledge spark: what's a planting-order deadline? Every spring, a farm has to order its seed and fungicide supply for the whole year, in one batch, weeks before planting starts. That date happens whether or not anyone has decided about a new tool. It's a real deadline sitting there already, free for a pilot to borrow.

Featherstone's pilot was budgeted for twenty-five agronomist hours across eight weeks. By the time the growing season ended, twenty-six weeks in, it had cost a hundred and forty hours, and there was still no decision either way. Not a yes. Not a no. The co-op's calls just got shorter and further apart until they stopped.

A hand-sketch comparison diagram titled Which one rings first. On the left, a gauge dial with a grey needle barely moved, labeled Waiting to go quiet, captioned no decision, hands barely move. On the right, an identical dial with an amber needle swept much further round, labeled Pre-agreed decision date, captioned already ringing, weeks ahead. A hand-lettered VS sits between them.
Waiting for a co-op to go quiet never rings at all. A pre-agreed decision date rings on schedule, whatever the answer turns out to be.

Swap the trigger and it still runs

  • The pilot gets cheaper to keep running. Doesn't help. A pilot that costs nothing to extend still needs someone to decide. Cost was never the actual reason it needed an end date.
  • The setup takes longer than planned. Doesn't help either. A longer setup just means the date should sit further out, not disappear.
  • The model genuinely keeps improving the longer it runs. Still needs the same hard date. "It's still getting better" is the best excuse a pilot ever has for never deciding, which is exactly why it needs a date written down in advance.

Where people run it wrong

  • Setting a soft target like "about six weeks" instead of a real date tied to something external.
  • Agreeing on a date but never naming who actually has to say yes or no on it.
  • Treating "one more month" as free, when every extension adds real hours and real opportunity cost that nobody is tracking.

How to use it live

Say the split out loud, early. "Before we talk about how long this runs, I want to pin two things: the actual date it ends, and who says yes or no on that date." That's not stalling. It names the two things a pilot actually needs to stop drifting, and it buys you a beat to build the rest of the answer around a decision instead of a wish list.

Flashcards (click a card to flip it)

1 · THE FRAMEWORK
Which framework fits this question, and what does each letter stand for here?
Tap to flip
ANSWER
LEAD. L is the real outcome, a decision that actually gets made. E is the early signal, a hard end date and a named decision-maker set before day one. A is how it gets gamed, "one more month," repeated. D is what it can't settle, whether the decision made is the right one.
2 · THE PERSON
Who is this answer about?
Tap to flip
ANSWER
Isabel Petrakis, who runs product for Beaconwell, a PR-risk flagging tool, and ran a pilot with Halfmoon, a skincare and home-fragrance brand, that had no hard end date agreed at kickoff.
3 · THE HABIT
What kept the pilot running for five months?
Tap to flip
ANSWER
Four separate "let's do one more month" requests, each backed by a true reason, none of them written down as a real decision, because nobody had to formally justify continuing.
4 · THE EARLY SIGNAL
What's the E step here, in one line?
Tap to flip
ANSWER
A hard end date, tied to something real like a budget cycle, and a named decision-maker on each side, both agreed and written down before the pilot's first day.
5 · THE OLD DECISION
What decision would you take back?
Tap to flip
ANSWER
Saying at kickoff, "let's run it about six weeks and see how it feels, we'll know when we know." Replace it with a real date and a named owner, agreed before day one.
6 · THE NUMBER
Halfmoon's pilot was budgeted at ______ engineering hours for six weeks. By week 22, it had actually cost ______ hours.
Tap to flip
ANSWER
40 hours budgeted. 310 hours actual. Nobody had agreed on paper to a single one of the four extensions that got it there.
7 · THE REPLAY
Same six-week plan, a real date and a named owner agreed at kickoff instead. What changes?
Tap to flip
ANSWER
Week six becomes a real decision meeting instead of a check-in. Elian signs, declines, or asks for a new dated extension in writing. Total cost stays close to the 40 hours planned, instead of drifting to 310.
8 · THE TRANSFER
Section four runs this same question again for a different product. Which one, and what's its early signal?
Tap to flip
ANSWER
Halversen's crop-disease risk tool, piloted with Featherstone Growers Collective. Its early signal is a hard end date tied to the co-op's planting-order deadline, with the general manager named as the one who signs off.

Check yourself Score: 0 / 0

Multiple choice
1. Which of these is the decision Isabel says she'd take back?
  • A. Hiring a dedicated account manager to handle Halfmoon's pilot.
  • B. Tuning the model so it flagged fewer false alarms.
  • C. Saying at kickoff, "let's run it about six weeks and see how it feels, we'll know when we know," instead of writing a real date and naming who signs off.
  • D. Sending Halfmoon's team a weekly usage report.
Show hint
Look for a decision taken back about the pilot's structure, not a dial turned up on the model.
Show answer
C. The other three are dials, staffing, a tighter setting, more reporting. None of them would have stopped the drift, because none of them put a date and an owner on paper before the pilot began.
Fill in the blank
2. By the time Booker asked his question in the resourcing meeting, Halfmoon's pilot had run ______ weeks past its original six-week target, and had cost ______ hours instead of the 40 budgeted.
Show hint
The pilot ended up running until week 22.
Show answer
16 weeks. 310 hours. 22 minus 6 is 16. Every one of those extra weeks came from an extension that sounded reasonable alone and was never written down as a real decision.
True or false
3. True or false: once Beaconwell had a hard end date and a named decision owner, that alone would guarantee Halfmoon signed the contract.
  • True
  • False
Show hint
Separate "a decision gets made" from "the decision is a yes."
Show answer
False. A hard date only forces somebody to say something on schedule. It says nothing about which way they say it. Whether Halfmoon buys still depends on budget, trust, and timing. That's the D step.
Multiple choice
4. Which of these pilots genuinely doesn't need an artificial end date bolted on?
  • A. An enterprise pilot with a named prospect and a sales team waiting on the outcome.
  • B. A free trial that technically expires on its own when the license runs out.
  • C. A pilot where two other prospects are waiting on the same engineering team's time.
  • D. A pilot with no named decision-maker on the customer's side.
Show hint
Look for the one option that already has a real forcing mechanism built in.
Show answer
B. A trial that auto-expires already has its stop built into the software itself. The other three are exactly the situations where a missing date and a missing owner let a pilot drift for months.
Short answer, apply it yourself
5. Think of a trial, a probation period, or a "temporary" arrangement you've seen run on and on without a clear end. What real date could it have been tied to, and who should have owned the decision on that date?
Show hint
Look for a real event nearby, a renewal, a budget lock, a season, that the arrangement could have borrowed as its deadline.
Show answer
Model answer: "A team kept a contractor on a 'temporary' extension four separate times because nobody had to justify saying no. Tying it to the actual budget renewal date, with the hiring manager named as the one who had to say yes or no that day, would have forced a real decision the first time it came up."
Fill in the blank
6. Featherstone's pilot was originally budgeted for ______ agronomist hours over eight weeks. By the time the growing season ended with no decision either way, it had cost ______ hours.
Show hint
This is Section 4's number, not Halfmoon's.
Show answer
25 hours. 140 hours. Without a date tied to the planting-order deadline, the pilot didn't even end in a no. It just went quiet when the season did, which is the version of an indefinite pilot with no ending at all.
From U2xAI Academy

From answering questions to owning outcomes.

A live workshop where you ship a working AI agent, defend a launch decision, and walk away with a portfolio recruiters can't wave off, not just more questions to study.

  • A live AI agent you actually shipped
  • A launch decision you can defend under pressure
  • An interview-ready portfolio, not more flashcards
Know more