CaseAdvancedResponsible AI & Advanced Practice / AI product case study teardowns / #13

Analyze the retention mechanics of an AI product with high initial excitement.

FLIPS the product is Larchnote Notes, an AI scribe that writes up vet visits

Larchnote Notes listens during a vet visit and writes the clinical note afterward, so the vet can just talk to the animal and the owner. Cassius Drammeh runs Oldfarrow Veterinary Clinic, five exam rooms, three vets, a waiting room that's loud by 9am.

The direct answer
The excitement fades because the tool gives no way to fix a wrong note except redoing the whole thing by hand. Build a one-line "flag this note" button that a vet can tap mid-exam, and route flagged notes to a same-day correction queue, instead of asking a busy vet to spot-check a transcript on their own time.
Do this, in order
  1. Give the vet a one-tap way to flag a wrong note, right when they notice it.Why: without a small fix, a busy vet's only real option is to stop opening it.
  2. Route flagged notes to a same-day correction, not a general feedback form nobody reads.Why: a flag that goes nowhere teaches the vet that flagging is pointless too.
  3. Show a short reason when a note comes out wrong, not just the wrong text.Why: silence about what went wrong is what turns one bad note into a reason to quit the whole tool.
  4. Track opens per vet per week, not just notes generated.Why: usage can fall for weeks before anyone notices, since nothing about quiet abandonment shows up as a complaint.
  5. Leave the free-text override alone for the rare, genuinely unusual visit.Why: some visits really are odd enough that typing the note by hand is still the right call.
  6. Don't chase raw transcription accuracy past the point where habit, not accuracy, is the real problem.Why: a slightly better transcript doesn't fix a vet who's already stopped opening the app.

How to answer this, stage by stage

Seven moves, and the fourth one is the whole answer. The rest is proof.

Stage 1
Scope it to one clinic, one vet
Say it like this
"I'll walk through this with one real clinic, Oldfarrow, and one vet, Cassius, instead of talking about 'AI note-taking tools' in general."
Why this works
A concrete person makes the flip visible instead of theoretical.
Stage 2
Say your structure out loud
Say it like this
"I'll use FLIPS. Find the person, locate the habit it built, identify the flip, pinpoint the old decision behind it, then show the replay."
Why this works
Tells the interviewer you have a method for finding the real failure, not just a guess.
Stage 3
Name the habit the tool actually built
Say it like this
"Cassius stopped typing notes between patients. That's the real product. Every minute of that forty saved is downstream of that one habit."
Why this works
The time saved is a side effect. The habit is what breaks later.
Stage 4
Reframe the question: this isn't about excitement fading, it's about a flip
Say it like this
"High initial excitement fading isn't the mystery here. The mystery is the exact moment Cassius went from opening it every visit to not opening it at all, with nothing in between."
Why this works
Separates a real interview question from a vague one about "engagement dropping."
Stage 5
Give the one decision
Say it like this
"Add a one-tap flag button, routed to a same-day fix. Right now the only way to correct a note is to rewrite the whole thing, so nobody bothers, they just stop opening the app."
Why this works
Matches deliverable 0 exactly, a concrete action, not a category of action.
Stage 6
Prove it with the compressed failure
Say it like this
"Week six, the app calls a healthy dog's limp 'likely a fracture.' Cassius has no way to fix just that line, only redo the whole note by hand. Week eight, he's typing every note again, same as before the tool ever showed up."
Why this works
A four-sentence version of the real story, cut to the bone.
Stage 7
Close on what you'd measure, and stop
Say it like this
"I'd track opens per vet per week, since usage quietly falls for weeks before anyone notices, and by the time renewal comes up, it looks like the vet 'just prefers doing it by hand.'"
Why this works
Shows you're thinking past the fix, toward how you'd catch the next one.

Let's learn

Larchnote Notes runs on a small mic clipped to a vet's coat. It listens through the exam, then writes the visit note by the time the vet reaches the next room.

Before Larchnote, Cassius typed his own notes between patients, roughly seven minutes a visit, twelve visits a day. That's about 84 minutes a day gone to typing, most of it after the owner had already left.

With Larchnote, that dropped to about six minutes a day, a quick skim of each note before signing it. For six straight weeks, Cassius told anyone who'd listen that it was the best thing that had happened to his practice in years.

Knowledge spark: what's a repair affordance? A small, specific way to fix one wrong piece of an AI's output without redoing the whole thing. Circle a line, tap a flag, correct one word. Without one, the only fix left is starting over, and most people won't bother starting over.

The turn: the extra wrong notes were never really the problem. The real problem was what Cassius did the first time one showed up with no way to fix just that one line.

Daily opens of Larchnote Notes, ten weeks
12 opens 6 0 Wk1 Wk6 Wk10
Six flat, good weeks, then a quiet slide with no support ticket at any point along it.

At its worst: three months in, Oldfarrow's clinic looks like it never adopted Larchnote at all, except now the vets type slower than they used to, out of practice, and the clinic is still paying for a license nobody opens.

The decision I would take back We shipped correction as an all-or-nothing rewrite: tap edit, and the whole note goes back to a blank text box. That felt fine in testing, where every note came out clean and correction was rare. It stopped making sense the first week a vet had three wrong notes in one afternoon and no way to fix just the wrong sentence in each.

What I would leave alone: the free mic and the ambient listening itself. Vets loved not fumbling with a phone or a keyboard mid-exam, and that part of the product never caused a single complaint.

We did not lose six weeks of good notes. We lost a vet's whole reason to keep opening the app, the day fixing one wrong line meant rewriting the entire visit.

The lesson: a burst of early excitement tells you the product feels good on a clean day. It tells you nothing about what a person does the first time it hands them a mess with no easy way to clean it up.

Now here is the same thing as a story

Use the short version above when you're being timed. Read the story below when you want to feel why the flip was real, not just plausible.

Cassius has run Oldfarrow for eleven years. He can read a limping dog's gait from across the room before the owner's finished describing it.

The good months were genuinely good. Every visit, the mic caught the whole exam, and by the time Cassius reached the next room, a clean note was already sitting there waiting for a quick nod.

Hand sketched metaphor scene titled A dial you assumed, a switch that's real. Left panel, a gauge icon labeled DIAL, caption checks a little less. Right panel, a box icon labeled SWITCH, caption stops opening it.
Everyone assumed trust would fade like a dial turning down. It didn't. It clicked off.

The habit thinned in three beats nobody wrote down at the time. First, Cassius stopped reading every note word for word, just the first line. Then he stopped reading most of them at all, just signing. Then, one Tuesday, he stopped opening the app before a visit even ended.

Hand sketched timeline titled The habit thinning in three beats. Four milestones: opens daily weeks 1 to 4, skims fast weeks 5 to 6, skips some week 7, stops cold week 8 highlighted with no ticket.
Nobody filed a ticket at any of these four points. That's exactly why nobody noticed.

The trigger was small: a healthy dog's slight limp, described in the note as "likely a hairline fracture, recommend imaging." Cassius caught it before the owner saw it, since he remembered the exam. But the note offered no way to fix just that line. Edit meant rewrite the whole thing.

Hand sketched decision tree titled What happens after a wrong note. Root: notes app gets a visit wrong. Four branches: explains what it heard leads to vet fixes it and keeps using it, gives no reason at all leads to vet quietly stops opening it, vet asks a colleague leads to hears the same complaint, vet re-checks by hand leads to trust never really returns.
Only one of these four branches keeps a vet using the tool. Larchnote's design pointed straight down the other three.

He mentioned it at a regional vet meetup, half a joke, and two other clinic owners said the same thing had happened to them within a week of each other, unrelated clinics, same wrong branch of the tree.

Hand sketched labeled parts diagram titled What the co-op reporting screen never showed. Center document icon labeled Weekly Digest, four callouts: which note was wrong, a way to flag it, any run history, a repair button.
The weekly usage digest Oldfarrow's clinic manager got never named any of these four things.

By week eight, Cassius was back to typing every note by hand, the same 84 minutes a day he'd had before Larchnote ever showed up, except now the app sat unopened on his phone and nobody at the company had any idea why.

The old note-taking flow asked Cassius to trust an entire finished note or rewrite an entire note. The new one, once fixed, asked him to trust most of a note and fix the one line that was wrong.

I built the correction flow around what was fast to ship, a single rewrite box, not around what a vet would actually do at 4pm with four more patients waiting. It took hearing the same story from two other clinics, unprompted, to see it wasn't Cassius being picky. It was the design, working exactly as built.

FLIPS, five letters for a habit that clicked instead of fadedNot a dial slowly turning down. FLIPS is what finds the exact click.

Hand sketched icon list titled The five FLIPS letters. Five items: a person icon labeled Find the person, a document icon labeled Locate the habit, a gauge icon labeled Identify the flip, a box icon labeled Pinpoint the old decision, a scale icon labeled Show the replay.
Five letters, and the third one, the flip itself, is the only genuinely hard step.
F
Find the person.
Cassius Drammeh, eleven years running Oldfarrow, five exam rooms, a vet who reads a limp from across the room.
A specific person makes every later step concrete instead of generic.
L
Locate the habit.
He stopped typing notes between patients, 84 minutes a day of typing that quietly disappeared.
The habit, not the time saved, is the actual thing the product shipped.
I
Identify the flip.
Opens the app every visit, without thinking about it, versus quietly stops opening it at all. No middle setting, no ticket filed either way.
The hardest step, and the one a generic "engagement dropped" answer never finds.
P
Pinpoint the old decision.
Correction shipped as an all-or-nothing rewrite, reasonable when notes were nearly always clean in testing.
Small, reversible, and genuinely sensible the day it was made.
S
Show the replay.
Same wrong "likely fracture" note, but now a one-tap flag routes it to a same-day fix. Cassius keeps opening the app the very next visit instead of never again.
A countable ending: the app stays open, not just "trust improves."
Where a vet's 84 minutes a day went, before and after the fix
84 min 0 Before Good weeks After the flip After the fix
"After the flip," the saved time doesn't shrink gradually, it snaps straight back to zero, same as day one.

The recap, one line per letter: find the person is Cassius at Oldfarrow, locate the habit is the 84 minutes of typing he stopped doing, identify the flip is opens-every-visit versus never-opens-again, pinpoint the old decision is the all-or-nothing rewrite, and show the replay is a same-day fix that keeps the app open instead of abandoned.

And if you want to be sure it really works, try it somewhere elseSame five letters, a library instead of a clinic. A completely different flip family this time.

Kestrelwing is an AI tool that suggests subject headings and call numbers for new books at a small public library system. Amara Ffolkes heads cataloguing there, six branches, a backlog that never quite empties.

Mapped onto FLIPS, with a different flip family this time, substitution instead of abandonment: find the person is Amara. Locate the habit is trusting Kestrelwing's suggestion on every new title without a second look. Identify the flip: once the system added a small per-item review fee to fund a "priority queue," Amara didn't stop using Kestrelwing, she started saving it only for the easy, obvious titles and went back to cataloguing hard, ambiguous ones by hand, the exact cases Kestrelwing was built to help with most. Pinpoint the old decision: pricing per item, which made sense when volume was low and nobody rationed anything. Show the replay: flip the pricing to a flat monthly fee instead, and Amara runs every title through Kestrelwing again, hard ones included, since there's no per-use cost steering her away from the cases that need it.

Hand sketched comparison diagram titled Small move big snap, reused for the library example. Left panel, a gauge icon labeled Week 1 to 6, caption opens it daily still. Right panel, a box icon labeled Week 7, caption stops opening it at all.
A different flip family, but the same shape: a small pricing change, not a worse model, is what rationed her trust toward the wrong cases.

Swap the trigger and it still runs.
Speed: an interviewer caps you at sixty seconds. Say "no way to fix one wrong line, so vets stop opening it, add a one-tap flag routed to a same-day fix," and stop.
Cost: there's no budget this quarter for a same-day correction queue. Say so honestly, and start with a lighter version, a flag button that at least tells the team which notes are wrong, even without same-day fixes yet.
The model gets better, for real: if Larchnote's transcription accuracy genuinely improves, that's still not a reason to skip the repair affordance, since even a rare wrong note with no fix path can end a habit that took months to build.

Where people run it wrong.
They treat fading excitement as inevitable novelty wearing off, instead of looking for the actual moment usage clicked to zero.
They watch total notes generated instead of opens per vet, which hides a slow abandonment inside a flat-looking average.
They fix accuracy first, assuming a better model will bring the habit back, when the real gap is that there was never a way to fix one line.

How to use it live. When someone describes excitement fading, ask yourself: what's the exact action the person stopped doing, and is there a day you could point to. If you can't name a day, you don't have the flip yet, keep digging before you answer.

Flashcards (tap any card to flip it)

1 · THE FLIP FAMILY
What flip family is this?
Tap to flip
ANSWER
Abandonment flip: uses it daily, then quietly stops opening it, with no complaint or ticket along the way.
2 · THE PERSON
Who is this answer about?
Tap to flip
ANSWER
Cassius Drammeh, who has run Oldfarrow Veterinary Clinic for eleven years and can read a dog's gait across a room.
3 · THE HABIT
What did Cassius stop doing because Larchnote worked?
Tap to flip
ANSWER
Typing his own visit notes between patients, about 84 minutes a day of manual writing.
4 · THE FLIP
What's the two-setting switch here?
Tap to flip
ANSWER
Opens the app every visit versus quietly stops opening it at all, with no middle setting and no ticket filed.
5 · THE OLD DECISION
What decision would you take back?
Tap to flip
ANSWER
Shipping correction as an all-or-nothing rewrite, reasonable while notes were nearly always clean in testing.
6 · THE NUMBER
Fill in the blank: opens per day held steady at 12 for six weeks, then fell to just ___ by week ten.
Tap to flip
ANSWER
1. And no support ticket was filed anywhere along that decline.
7 · THE REPLAY
Same wrong note, redesigned correction flow. What changes?
Tap to flip
ANSWER
A one-tap flag routes the note to a same-day fix, and Cassius opens the app again the very next visit instead of never again.
8 · CROSS PRODUCT TRANSFER
Section 4 answers this again for a different product. Which product, and which flip family?
Tap to flip
ANSWER
Kestrelwing, a library cataloguing assistant. Substitution flip: a per-item fee made Amara ration it toward the easy titles instead of the hard ones.

Check yourself Score: 0 / 0

Multiple choice
1. Why did Cassius quietly stop opening Larchnote Notes instead of filing a complaint about the wrong note?
  • A. He decided AI scribes were a fad and lost interest.
  • B. The transcription accuracy had gotten measurably worse that month.
  • C. There was no way to fix just the wrong line, only rewrite the whole note, so the cheapest response was to stop opening it.
  • D. The clinic's internet connection became unreliable.
Show hint
Look at the decision tree showing what happens after a wrong note.
Show answer
C. People take the cheapest escape available. With no repair affordance, abandoning was cheaper than fixing.
True or false
2. True or false: usage dropped gradually, a little less each week, in a way the weekly digest would have caught early.
  • True
  • False
Show hint
Look at the line chart of daily opens across ten weeks.
Show answer
False. It held flat for six weeks, then fell sharply, and the digest never named which note was wrong or offered a way to flag it.
Fill in the blank
3. Fill in the blank: before Larchnote, Cassius spent about ___ minutes a day typing notes by hand.
Show hint
Look at the stacked bar chart showing where his time went.
Show answer
84 minutes. By week ten, that number had returned to almost exactly the same 84 minutes.
Short answer, name the reversal
4. What old decision does this answer take back, and why did it make sense when it was made?
Show hint
Look at "the decision I would take back."
Show answer
Model answer: Shipping correction as an all-or-nothing rewrite. It made sense in testing, where notes came out clean nearly every time and correction was rare.
Short answer, where it wouldn't matter
5. Name a part of Larchnote Notes where this same fix, adding a repair affordance, genuinely wouldn't matter.
Show hint
Look at "what I would leave alone."
Show answer
Model answer: The ambient mic and listening itself. Vets loved not touching a keyboard mid-exam, and that part never caused a single complaint.
Short answer, apply it yourself
6. Pick a product you use yourself. What's one habit it built in you that you'd stop doing if it got a little worse?
Show hint
Think about something you stopped double-checking because it was almost always right.
Show answer
Model answer: Many people stop proofreading autocomplete suggestions in email. A wrong one with no easy fix would likely make them stop trusting the feature entirely, not just proofread more.
Before you close the answer
Why this works
Tests whether you look past "excitement fades" as a vague story and find the exact, nameable moment a habit clicked off, plus whether your fix targets that click instead of the model's raw accuracy.
Follow-up traps
"Isn't the real fix just making the transcription more accurate?" Response: accuracy helps, but even a rare wrong note with no way to fix just that line will end the habit, so the repair path matters more than shaving another point off the error rate.

"Won't a same-day correction queue just be slow and annoying for busy vets?" Response: it only needs to handle the notes actually flagged, which should be a small fraction if the model's any good, so the queue stays light while still closing the one gap that mattered.
If pressed
Larchnote's real fix ended up routing flagged notes to a licensed vet tech for same-day review rather than the original vet, since asking the same busy vet to redo their own correction just recreated the original time cost in a smaller box.
From U2xAI Academy

From answering questions to owning outcomes.

A live workshop where you ship a working AI agent, defend a launch decision, and walk away with a portfolio recruiters can't wave off, not just more questions to study.

  • A live AI agent you actually shipped
  • A launch decision you can defend under pressure
  • An interview-ready portfolio, not more flashcards
Know more