ConceptIntermediateResponsible AI & Advanced Practice / Internal AI tooling and enablement products / #4

What is different about PMing for internal users who cannot churn?

PICK the tradeoff: Brightcore Comfort Systems, and FieldMind, the troubleshooting copilot its field techs carry on every call

Interviewer's question: "What is different about PMing for internal users who cannot churn?" Brightcore Comfort Systems runs HVAC service calls across one metro area. Callum Bretherton has coordinated dispatch there for five years.

The direct answer
Internal users who can't churn are the higher-risk group, not the lower-risk one. An external user's silent dissatisfaction shows up as a cancellation you can measure. An internal user's silent dissatisfaction shows up as a private workaround that costs real time and never appears in a single dashboard. Optimize against the workaround, not the rare complaint, because the workaround is where the actual damage lives.
Do this, in order
  1. Assume the real risk is the workaround you can't see, not the complaint you can.Why: a captive user has no exit, so their honest reaction to a bad tool is to quietly build around it, not to complain.
  2. Watch for shadow-tool usage, not just usage counts, as your real signal.Why: a rising number of private notebooks, spreadsheets, or side-channel questions is the internal equivalent of churn.
  3. Build a one-tap way to flag a wrong output, not a multi-step ticket.Why: if reporting a problem costs more than working around it, people will always choose the workaround.
  4. Don't mistake "usage logs look fine" for "people trust it."Why: an app can stay open on a screen the whole shift while nobody's actually relying on what it says.
  5. Set a kill criterion tied to workaround signals, not to complaint volume.Why: complaint volume will stay low right up until the tool is already useless.

How to answer this, stage by stage

Nobody is grading whether you know that internal users can't churn. They're grading whether you can say what that actually changes about where you look for risk.

Stage 1
Scope it to one team, one tool
Say it like this
"I'll answer this for Brightcore's field techs and FieldMind, the troubleshooting copilot they carry on every service call."
Why this works
Keeps the answer from staying abstract about "internal users" in general.
Stage 2
Say your structure out loud
Say it like this
"I'll use PICK. Position, my actual pick. Impact, who feels each kind of error. Cost asymmetry, which one's more expensive. Kill criteria, what would change my mind."
Why this works
Signals a method before making a claim that could sound like an opinion.
Stage 3
State your position, before any reasoning
Say it like this
"Internal, captive users are higher-risk than external ones, not lower. I know that sounds backwards, but I'll show you why."
Why this works
Commits to an answer immediately instead of hedging with "it depends."
Stage 4
Name who feels each kind of error
Say it like this
"An external customer's silent churn shows up as a cancellation, visible on a dashboard the next day. A tech's silent workaround shows up nowhere at all."
Why this works
Names both sides concretely instead of asserting the asymmetry without evidence.
Stage 5
Give the cost asymmetry
Say it like this
"A customer complaint costs one email and one ticket. A crew of techs quietly building their own private notebook costs a little bit of judgment on every single call, forever, and nobody's counting it."
Why this works
This is the direct answer's foundation: the hidden cost is bigger than the visible one.
Stage 6
Give the kill criteria, and close
Say it like this
"If I saw private workaround notebooks spreading between crews, I'd know the captive-user assumption was already wrong, whatever the usage logs said."
Why this works
Shows the position is falsifiable, not just asserted and defended forever.

Let's learn

FieldMind is a tablet app that suggests likely fixes to a field technician mid-call, based on the unit type, the symptoms entered, and past service history.

Before it, a Brightcore tech would call dispatch or a senior tech for a second opinion on an unfamiliar unit, sometimes waiting ten or fifteen minutes for someone to pick up. With FieldMind, a suggestion appears in under a minute.

Estimated monthly cost: visible complaints versus the hidden workaround
$15,000 $7,500 $0 $800 Visible complaints $14,000 Hidden workaround
The visible number is what shows up in an inbox. The hidden one is an estimate, and it's the one that actually moves the business.

The turn: Brightcore didn't have a FieldMind complaint problem. Complaints stayed low the entire time. What it had was a slow, quiet migration of real troubleshooting knowledge out of FieldMind and into private notebooks nobody at dispatch ever saw.

Hand sketched comparison diagram titled The asymmetry, drawn. Left panel, a question mark box icon labeled Customer complaint, caption rare, visible, one ticket filed. Right panel, a box icon labeled Tech's private notebook, caption silent, invisible, costs every job after.
One of these lands in an inbox. The other lands in a glovebox, and nobody at dispatch ever opens it.
The decision that mattered Flagging a wrong FieldMind suggestion required opening a support ticket, a five-field form, after the job was done. That felt like reasonable process at launch. It meant the easiest response to a bad suggestion was never to report it, just to quietly stop trusting it.

At its worst: a whole crew of six techs keeps a shared paper notebook of "what actually works" for tricky rooftop units, updated by hand, carried between trucks, completely unknown to dispatch, who believe FieldMind usage is healthy because the app stays open on every tablet, every shift.

Hand sketched labeled parts diagram titled What's inside a tech's private notebook. Center document icon labeled The Notebook, with four callouts: real fixes that worked, skips FieldMind entirely, shared only with trusted coworkers, never shown to dispatch.
None of this was ever the plan. It's what fills the gap the moment reporting a problem costs more than working around it.

What I would leave alone: FieldMind's suggestions on simple, customer-present jobs, a filter swap, a thermostat reset, don't need this level of concern. A wrong suggestion there gets caught immediately, by the tech or the customer, in seconds.

The lesson: a captive user's silence is not consent. It's usually the sound of someone quietly building a way around you, because leaving was never on the table to begin with.

Now here is the same thing as a story

The short version above is what you'd say defending this position to Brightcore's operations director. Read this one for how the notebook actually started.

Callum Bretherton has coordinated Brightcore's dispatch desk for five years. He can tell which tech is a good fit for a tricky commercial job before he's finished reading the ticket.

For its first several months, FieldMind mostly earned trust the ordinary way: techs used it, it was usually right, and word got around. Techs would even mention it on their job notes, "FieldMind flagged a capacitor issue, confirmed," proud of the fast diagnosis.

Then came a solo call on a commercial rooftop unit, no customer around to double-check anything. FieldMind suggested a fix for a symptom that looked identical to one it had seen a hundred times before, but wasn't. The tech followed it, the fix didn't hold, and the customer called back furious two days later during a heat wave.

Hand sketched flow diagram titled Where trust quietly left. Four steps: good call, bad call customer watching, stops mentioning it, builds private notebook highlighted.
The fourth step never shows up in a usage log. It's the only one that actually mattered.

Word of that call spread through the crew within a day, the way bad calls always do. Nobody filed a formal complaint about FieldMind itself, since the tech didn't want to look like he'd blindly followed a suggestion. But three other techs, on their own, quietly started keeping a shared notebook of rooftop-unit symptoms and the fixes that had actually worked, cross-checked against, not instead of, FieldMind.

We didn't lose one tech's trust that week. We lost the crew's willingness to say out loud when FieldMind was wrong, which meant we stopped finding out.

Here's the decision I'd take back: making "flag this suggestion as wrong" a five-field support ticket instead of a single tap. That felt like reasonable process when the team wanted structured data on every report. It stopped making sense the moment filing a ticket took longer than just quietly not trusting the tool anymore.

Replayed with a one-tap flag: the same rooftop misfire happens. The tech taps "wrong" right there in the app, in three seconds, no form. Dispatch sees three flags on the same symptom pattern within a week, a real, countable signal, and fixes the underlying rule before a fourth tech ever has reason to start a notebook.

I built the ticket-based flagging process because I wanted good, structured data on every failure. It took a furious customer during a heat wave to see that structure nobody actually used told me nothing at all.

PICK, mapped onto one bad callNot a debate about who's harder to please. PICK is what tells you which silence is actually the expensive one.

P
Position. The pick, before any reasoning.
Internal, captive users are higher-risk than external ones, not lower.
The hardest step: committing to a position that runs against the obvious intuition.
I
Impact. Who feels each kind of error.
A customer's silent churn is visible, measured, and quick. A tech's silent workaround is invisible and slow, and costs real judgment on every call after.
Names both sides concretely instead of asserting the asymmetry.
C
Cost asymmetry. Which one is actually expensive.
Visible complaints cost about $800 a month. The hidden workaround is estimated at $14,000, and nobody was measuring it at all.
This is the direct answer's foundation: optimize against the number nobody was counting.
K
Kill criteria. What would flip the position.
A rising rate of shadow-tool usage, private notebooks, side-channel questions, would mean the captive assumption was already wrong.
Makes the position falsifiable, not just a stance defended forever.
Hand sketched icon list titled Signs the captive assumption is wrong. Three items: a document icon labeled private workaround notebooks spreading crew to crew, a person icon labeled techs asking each other instead of asking the tool, a box icon labeled more radio calls asking dispatch for a second opinion.
Any one of these outranks a quiet usage dashboard. All three showed up at Brightcore within a month.
Hand sketched quadrant titled Sorting jobs by where a wrong suggestion hides. Axes job complexity and chance a wrong call goes unnoticed. Filter swap and thermostat reset, both customer present, sit low complexity low risk, bottom left. Attic unit and commercial rooftop unit, both solo calls, sit high complexity high risk, top right.
The top-right corner is exactly where a wrong suggestion has nobody around to catch it.

The recap, one line per letter: position is that captive users carry more risk, not less; impact is visible cancellation versus invisible workaround; cost asymmetry is the workaround's real, uncounted cost; and kill criteria is shadow-tool usage spreading between crews.

Share of techs keeping a private workaround notebook, by month
60% 30% 0% flip line, 40% Month 1 Month 3 Month 5 10% 28% 45%
By month five, more techs kept a private notebook than didn't. Usage logs showed FieldMind open the whole time.

And if you want to be sure it really works, try it somewhere elseSame four letters, a chain of veterinary clinics instead of an HVAC crew. Nothing about the two jobs is alike.

Oakhollow Animal Hospital Group gave its vet techs a triage-note assistant that drafts intake summaries from a quick verbal description. Priya Rajan has worked as a vet tech there for six years.

Mapped onto PICK: position is the same, vet techs can't churn from their job over a flawed note-taking tool the way a pet owner could churn from a clinic. Impact: an owner's silent dissatisfaction shows up in a lost repeat booking; a tech's silent workaround shows up as private shorthand scrawled on a paper chart, invisible to the practice's own systems. Cost asymmetry: after the tool missed a real allergy flag in one note, techs didn't file a complaint, they just started double-writing everything by hand as a backup, which quietly erased most of the time the tool was meant to save. Kill criteria: a rising rate of techs keeping paper backups alongside the digital tool would mean the captive-user assumption had already failed, regardless of what the login logs showed.

Hand sketched timeline titled How the vet techs' private shorthand spread. Four milestones: tool rolled out clinic wide, one bad note missed a real allergy flag, techs swap shorthand unofficial tech to tech highlighted, usage looks fine logs show it's still open all shift.
A different shape of picture than Section 2 used: a timeline instead of a step-by-step flow. The pattern underneath is identical.

Swap the trigger and it still runs.
Speed: an interviewer caps you at sixty seconds. Say "internal users are higher-risk because their silent reaction is a workaround, not a cancellation, so watch for shadow tools, not complaint volume," and stop.
Cost: if tracking shadow-tool usage directly isn't possible, ask techs informally once a quarter whether they keep a personal backup system, and treat a rising yes as the real signal.
The model gets better, for real: even if FieldMind's accuracy improves company-wide, a crew that already built a private notebook after one bad call may keep using it out of habit, so trust lost once doesn't automatically come back when the tool does.

Where people run it wrong.
They treat low complaint volume as proof an internal tool is trusted, without ever asking whether people quietly stopped relying on it instead.
They count an app staying open as usage, without checking whether anyone's still acting on what it says.
They make reporting a problem harder than working around it, then wonder why nobody reports anything.

How to use it live. When someone asks what's different about internal users, ask yourself one question: if this tool quietly stopped working, would I find out from a complaint, or would I have to go looking for the workaround myself? If it's the second one, that's where the real risk always lives.

Flashcards (tap any card to flip it)

1 · THE FRAMEWORK
What framework fits "what's different about internal users who can't churn"?
Tap to flip
ANSWER
PICK: position, impact, cost asymmetry, kill criteria. The position here runs against the obvious intuition: captive users carry more risk, not less.
2 · THE PERSON
Who is this answer about?
Tap to flip
ANSWER
Callum Bretherton, a five-year dispatch coordinator at Brightcore Comfort Systems, who can match a tech to a tricky job before finishing the ticket.
3 · THE HABIT
What did techs stop doing after the bad rooftop call?
Tap to flip
ANSWER
They stopped mentioning FieldMind's suggestions in their job notes, even when they still glanced at them privately.
4 · THE FLIP
What's the two-setting switch in this story?
Tap to flip
ANSWER
Openly crediting FieldMind's suggestions in job notes, versus concealing their use of it and cross-checking against a private notebook instead. It didn't drift back on its own.
5 · THE OLD DECISION
What decision would you take back?
Tap to flip
ANSWER
Making "flag this suggestion as wrong" a five-field support ticket instead of a single tap, which made silence cheaper than reporting.
6 · THE NUMBER
Fill in the blank: the hidden workaround was estimated to cost about $___ a month, versus $800 for visible complaints.
Tap to flip
ANSWER
$14,000. Nobody was measuring it until someone went looking for it directly.
7 · THE REPLAY
Same rooftop misfire, one-tap flag design. What changes?
Tap to flip
ANSWER
The tech flags it in three seconds. Dispatch sees three flags on the same pattern within a week and fixes the rule before a fourth tech ever starts a notebook.
8 · CROSS PRODUCT TRANSFER
Section 4 answers this again for a different product. Which one, and what's the workaround there?
Tap to flip
ANSWER
Oakhollow Animal Hospital Group's triage-note assistant. The workaround there is vet techs double-writing paper backups after the tool missed an allergy flag.

Check yourself Score: 0 / 0

Multiple choice
1. Why does this answer treat internal, captive users as higher-risk than external ones?
  • A. Internal users file more support tickets on average.
  • B. Internal tools are technically harder to build.
  • C. A captive user's dissatisfaction shows up as an invisible workaround instead of a measurable cancellation.
  • D. Internal users are paid to use the tool, so they resent it more.
Show hint
Look at the position and impact steps.
Show answer
C. The risk isn't about resentment or ticket volume, it's that the honest reaction to a bad tool, when you can't leave, is a silent workaround nobody measures.
True or false
2. True or false: FieldMind's usage logs correctly showed that trust in the tool was dropping after the bad rooftop call.
  • True
  • False
Show hint
Look at the highlight about "usage logs showed it open the whole time."
Show answer
False. The app stayed open on every tablet the whole shift. The logs looked healthy while trust was quietly draining into a private notebook.
Fill in the blank
3. Fill in the blank: by month 5, ___% of techs kept a private workaround notebook, crossing the 40% line that would mean the captive-user assumption was wrong.
Show hint
Look at the line chart.
Show answer
45%. It had already crossed the flip line the answer set in advance as its kill criterion.
Short answer, where it wouldn't matter
4. Name a FieldMind use case where this whole concern barely applies.
Show hint
Look at the quadrant diagram's bottom-left corner.
Show answer
Model answer: A simple filter swap or thermostat reset with the customer standing right there, where a wrong suggestion gets caught immediately by someone in the room.
Short answer, apply it yourself
5. Pick an internal tool you've used at work that you can't opt out of. What workaround, if any, have you or a coworker quietly built around it?
Show hint
Think about a personal spreadsheet, notes app, or shortcut that exists only because the official tool didn't quite work.
Show answer
Model answer: Many people keep a personal notes file alongside a mandatory internal system, exactly the kind of shadow-tool signal this answer says to watch for.
Short answer, name the reversal
6. What old decision does this answer take back, and why did it make sense when it was made?
Show hint
Look at "the decision I would take back."
Show answer
Model answer: Requiring a five-field ticket to flag a wrong suggestion. It made sense when the team wanted structured failure data; it broke once filing the ticket cost more than silently working around the tool.
Before you close the answer
Why this works
Tests whether you'll default to the obvious intuition, external users are riskier because they can leave, or actually think through where an internal user's dissatisfaction goes when leaving isn't an option.
Follow-up traps
"Isn't a customer complaint still worse, since it can become public?" Response: a single public complaint is bounded and visible; a silently spreading workaround is unbounded and invisible, which is exactly why it costs more over time.

"Couldn't you just survey the techs directly instead of watching for shadow tools?" Response: you can, and should, but a survey only catches what people are willing to admit; shadow-tool usage is the behavior itself, which is harder to hide by accident.
If pressed
Brightcore's actual fix paired the one-tap flag with a monthly, anonymous "do you keep a personal backup system" check-in, since the tap alone only catches flags on suggestions people already noticed were wrong, not ones they quietly stopped trusting without ever being sure why.
From U2xAI Academy

From answering questions to owning outcomes.

A live workshop where you ship a working AI agent, defend a launch decision, and walk away with a portfolio recruiters can't wave off, not just more questions to study.

  • A live AI agent you actually shipped
  • A launch decision you can defend under pressure
  • An interview-ready portfolio, not more flashcards
Know more