Compare stakeholder management for an AI launch versus a standard feature launch.
Coursewright is Kestrelbrook Learning Systems' tool for turning a company's own policies, SOPs, and expert interviews into a finished training course. Ferike Cravenholt owns it. Ionna Marrowbend runs L&D at Vaultmere Financial, and she is the one who has to stand in front of Suhail Vantrellis, Vaultmere's Chief Compliance Officer, every time a mandatory course goes out to the company's 4,000 employees.
- Replace the single "shipped" milestone with a pre-launch accuracy brief plus a recurring post-launch update.Why: an AI feature's output is a rate, not a finish line, and one announcement can't stand for a number that keeps moving.
- Name the known accuracy rate and its known failure mode in writing, before launch, not after the first error.Why: an error nobody was warned about reads as a broken promise; the same error, already named, reads as expected.
- Sort every flagged error by real consequence before reporting it, never by whether it happened.Why: a wrong compliance number in the same bucket as a typo either causes panic on the small ones or numbness to the large ones.
- Set a target and a trend for the improvement plan, never a date the model reaches "perfect."Why: a perfection promise is the one commitment nobody can keep, and breaking it costs more trust than the original error did.
- Reject silently patching flagged errors without reporting them in the recurring update.Why: real alternative considered here; a fix discovered later reads as concealment, and concealment costs more trust than a disclosed error ever does.
- Leave the old single-announcement cadence alone for genuinely low-stakes, optional AI content.Why: the brief and the biweekly cadence only earn their cost where a wrong number actually reaches someone who depends on it.
How to answer this, stage by stage
Nobody is grading whether you can say "communicate proactively." They're grading whether you can name the actual design that survives an AI feature's first real mistake, and the one thing you refuse to promise while you're at it.
Let's learn
Coursewright turns a company's own policies, SOPs, and expert interviews into a finished training course, script, slides, and quiz, ready to load straight into an LMS.
Before it existed, Ionna Marrowbend built every mandatory course at Vaultmere by hand: read the policy, write a script Compliance would sign off on, build the slides, load it, test it. A single course took about six weeks.
With Coursewright, a first draft lands in about three days. Ionna and Compliance spend the rest of a two-week window reviewing instead of writing from a blank page. Three courses shipped that way in Coursewright's first year at Vaultmere: Data Privacy Basics, the Anti-Harassment Refresher, and, in month nine, a course on reporting thresholds under anti-money-laundering rules.
For an ordinary feature launch, an LMS certificate template, say, Ionna's playbook never changed: one pre-launch briefing to the steering committee, one go-live email, and a checkbox on the project tracker that says SHIPPED. Nobody expects a status update after that, because a template doesn't produce new mistakes on its own once it's approved.
Ionna ran the AML course launch through that exact same playbook. One briefing. One go-live email. SHIPPED, on the tracker, same as always.
Here's the turn. The wrong number itself was never really the problem, one bad figure inside a 25-minute course. The real problem was that nobody at Vaultmere had ever been told a wrong figure was possible, so there was no design left standing to catch it, and no channel built to make it feel routine once it finally showed up.
What it cost at its worst: Suhail pulled the AML course from all 4,000 employees' completion records the same afternoon he heard about it, and ordered a manual line-by-line re-check of Data Privacy Basics and the Anti-Harassment Refresher too, about 40 hours of compliance and paralegal review time. The next planned course, on data-retention policy, slipped six weeks behind schedule while the audit ran.
What I would leave alone: Coursewright also drafts a weekly "skill nudge" email, optional microlearning tips nobody's compliance record depends on. No brief, no biweekly update, no machinery. If a nudge email is wrong, the cost is a shrug, not a pulled course.
The lesson: a launch playbook built for something that becomes true once will always look like it's working, right up until it meets something that's still moving.
Now here is the same thing as a story
The short version above is what you actually say in the room. Read this one when you want to feel exactly what a fourteen-month-old memo did to a Tuesday afternoon.
Ionna Marrowbend can tell which paragraph in a draft course will make Compliance flinch before she's finished reading it. Nine years running L&D at Vaultmere Financial will do that. She built every mandatory course by hand until last year: read the policy, draft it, get it signed off, load it, test it, six weeks a course, and she never once shipped one Compliance had to walk back.
Coursewright arrived in the spring. For the first two courses, Data Privacy Basics and the Anti-Harassment Refresher, it was everything the pitch promised. A three-day draft instead of a blank page. Ionna would still read every line the first time, out of habit, checking each fact against the source document the way she always had.
Both drafts came back clean. So did the second review. By the third pass on the harassment course, she'd stopped opening the source PDF at all, just skimming for tone. Nobody had ever pushed back on a Coursewright fact, so there was nothing left, in her mind, to double-check.
The AML course landed in month nine. Coursewright drafted it from an internal policy memo on cash-transaction reporting, the kind of document a bank keeps filed and rarely reopens. The memo said the reporting threshold was $15,000. It had said that for fourteen months, since before a routine regulatory update quietly moved it to $10,000, a change the memo itself was never revised to reflect. Coursewright didn't invent the number. It read a real document and reported exactly what was on the page.
Ionna skimmed the draft for tone. It read fine. She sent it up the chain the way she always did. Suhail Vantrellis signed off in the pre-launch briefing, the way he always did, on the strength of a track record that had never once needed a second look.
It shipped to all 4,000 employees on a Monday.
Tuesday, nothing. Wednesday, a compliance analyst working through the mandatory quiz stopped on question six. She'd sat in a regulatory update meeting eight months earlier where the new threshold was announced. Fifteen thousand didn't sound right. She hit the small "report an issue" button under the question and moved on with her afternoon, not thinking much of it.
Suhail saw the report Thursday morning. He didn't see a single flagged fact. He saw a compliance training course, sent to every employee at a bank, stating a wrong number about the exact rule the course existed to teach. Nobody had ever told him a Coursewright course could be wrong. So the only frame he had for this was the worst one: Vaultmere had just certified 4,000 people on a false statement of law, and nobody upstream had caught it.
He pulled the AML course from every employee's completion record that afternoon. Then he asked for the other two courses to be re-checked line by line before he'd trust either of them again, about 40 hours of a paralegal's and a compliance reviewer's week, gone. The data-retention course, already scheduled, slipped six weeks while the review ran.
Ionna never had a number in her head for how much to trust Coursewright. She had a feeling, built out of two clean launches in a row, and Suhail's Thursday-morning call was the first thing to put a real crack in it.
The decision she'd take back sits in a launch-readiness meeting from the spring, before the first course ever shipped. Someone on Ferike's team had floated sending the steering committee a short note on Coursewright's known accuracy rate before every launch. It got cut. The number, back then, sat around 88 percent, and nobody wanted a rollout conversation to open with a number that looked like a warning label. Two clean launches made that choice look right, right up until a fourteen-month-old memo made it look like the opposite.
Run the AML launch again, brief already in place. The pre-launch page tells Suhail plainly: 91 percent verified-correct, known weak spot is numeric figures pulled from source documents over a year old, target is 97 percent within six weeks. When the same analyst flags the same $15,000 on the same Wednesday, Suhail already has a shelf to put it on. It's logged, fixed in two days, and shows up as one line in the next scheduled update: "one threshold error, closed." The course stays live for the other 3,999 people while it's being fixed. The retention course still ships on time.
One design hands Suhail a single clean-or-not announcement and asks him to trust it forever. The other hands him a number that's allowed to move, and tells him, on a schedule, exactly where it's moving to.
What I'd tell myself, sitting in that spring meeting: the number I was protecting wasn't Coursewright's accuracy rate. It was reliability itself, the day before anyone had a real way to check it.
SPARK, when the thing you launched doesn't have a finish line
Not a way to make "communicate proactively" sound official. SPARK is what forces you to design comms around a number that keeps moving, instead of a milestone that pretends it's still.
The recap, one line per letter: today, one briefing and one email, built for something that becomes true once. The habit worth building is stakeholders reading "live" as "live and still moving," not "finished." The anchor is a pre-launch brief plus a biweekly update. The risk cuts two ways, panic on the first error or numbness to every error, and the design has to survive both. And the brief never promises a date the model turns perfect, only a target it's actually tracking toward.
Three things worth stating directly, since the real judgment sits here. Ferike's team considered keeping the standard single steering-committee sign-off and just scheduling it more often, instead of redesigning the artifact itself. It lost: a sign-off assumes a discrete pass-or-fail state to vote on, and Coursewright's output doesn't have one, it has a rate, so voting again next month produces no new information unless the vote is built to show that rate moving. The AI-specific failure worth naming by name is grounding on a stale source: Coursewright read a real, legitimate policy memo and reported exactly what was on the page, without flagging that the page itself was old enough to be wrong. The guardrail is a source-recency check on any generated numeric fact, flagging figures pulled from an aging policy document for mandatory human verification before they ship in a mandatory course. And the trade-off is real and accepted on purpose: naming an imperfect accuracy rate before launch slows the clean-launch feeling and can invite a compliance officer to push back on signing off something openly short of 100. Vaultmere accepts that friction in exchange for a course that survives its first real error without a program-wide pause.
And if you want to be sure it really works, try it somewhere else
Same five letters, a hospital reading room instead of a compliance course, and the number that moves is a missed finding instead of a dollar figure.
Isoline, built by Harrowfen Health Network, drafts the first-pass narrative for a radiology scan from the images and a technician's notes, before a radiologist reads and signs it. Reyva Pellingrove, Harrowfen's chief radiologist, and Ealasaid Duskmoor, who chairs the hospital's patient-safety committee, are the two people any Isoline rollout has to satisfy.
Mapped straight onto SPARK: the situation is a memo built for a tool that doesn't change once it ships. The payoff is radiologists reading "Isoline is live on this scan type" as "live, and its known miss-rate is worth checking against, not a guarantee." The anchor is the same shape: a pre-launch brief naming Isoline's known miss-rate on borderline findings and the plan to close it, then a weekly quality-committee update instead of one memo. The risk cuts the same two ways: an unwarned miss reads as malpractice exposure, while a warned one, reported too casually, risks a radiologist waving off a finding that actually mattered. And the keep-out is identical in spirit: no date promised for a zero-miss reading, a target and a trend instead.
Swap the trigger and it still runs.
Speed: an interviewer caps you at ninety seconds. Skip straight to it: name the known miss-rate before launch, and keep a repeating update after it, full stop.
Cost: no budget this quarter for a new reporting process. Fold the metrics into the quality-committee report that already happens monthly, don't build new infrastructure, use what's already scheduled.
The model got better, for real: say Isoline's miss-rate drops to near zero after a base-model upgrade. Keep the recurring update anyway. "We don't know when it'll be perfect" doesn't go away because today's bar improved; the next unusual case type will have the same shape.
Where people run it wrong.
They fold the accuracy number into onboarding once, then never restate it as the model actually improves or slips.
They report every flagged miss with the same urgency, so a formatting complaint sits next to a real diagnostic miss in the same list.
They let the recurring update quietly stop after the "settling in" period, right around when the case type that actually breaks it finally shows up.
How to use it live. Ask this before agreeing a launch is ready: "what's the number we're telling stakeholders today, and what's the channel where they'll hear the next one?" No answer to the second half means the plan is still a single announcement wearing a comms plan's clothes.
Flashcards (tap any card to flip it)
Check yourself Score: 0 / 0
Show hint
Show answer
Show hint
Show answer
Show hint
Show answer
Show hint
Show answer
Show hint
Show answer
Show hint
Show answer
"What stops 'launched but still tuning' from becoming an excuse for every future mistake?" Response: the biweekly update sorts flagged errors by consequence, not by whether they happened, so a compliance-grade miss still reads as urgent even after the phrase has become familiar.
From answering questions to owning outcomes.
A live workshop where you ship a working AI agent, defend a launch decision, and walk away with a portfolio recruiters can't wave off, not just more questions to study.
- A live AI agent you actually shipped
- A launch decision you can defend under pressure
- An interview-ready portfolio, not more flashcards
More on AI PM vs traditional PM vs technical PM
- #1 List four responsibilities an AI PM holds that a traditional PM does not.
- #2 Which parts of the classic PM toolkit transfer unchanged to AI products, and which do not?
- #3 Explain why an AI PM often owns the evaluation set while a traditional PM would not own a test plan.
- #4 How does the discovery phase differ when feasibility is genuinely unknown until you build?
- #5 Describe the difference between an AI PM and an ML PM at a company that has both.
- #6 Why does the AI PM role pull the PM further into the technical stack than most PM roles?