CaseIntermediateResponsible AI & Advanced Practice / AI product case study teardowns / #4

Tear down the onboarding of an AI product you use and identify its weakest moment.

FLIPS the product is Tallyhatch, an AI budgeting app that reads a bank feed and drafts a monthly budget

Tallyhatch connects to your bank account, pulls transactions, and sorts them into a monthly budget with no manual entry needed. Ines Cabral runs a small bakery alone and signed up on a Tuesday night, an hour after closing, to finally stop doing her books on paper.

The direct answer
The weakest moment isn't the first screen or the sign-up form. It's the exact instant the bank connection fails and Tallyhatch has no fallback: no manual entry, no "add it yourself for now," just a blank retry button. Fix that one dead end with an on-the-spot manual entry path, and the rest of onboarding barely matters.
Do this, in order
  1. Add manual entry as a fallback the moment a bank link fails.Why: this single dead end is where most first-week abandonment actually happens.
  2. Stop promising full automation before you know the user's bank is supported.Why: a promise with no calibration means users have zero fallback plan when it breaks.
  3. Show which specific banks are unreliable, before the user tries to connect one.Why: a known gap is a warning. A silent gap is a trap.
  4. Leave the email verification step exactly as it is.Why: it's mildly annoying but nobody abandons the app over it.
  5. Track day-3 return rate split by first-attempt bank link success, not just overall signups.Why: an average retention number hides a cliff that only hits half the new users.
  6. Re-check unsupported-bank cases every quarter as more banks change their systems.Why: which banks fail isn't fixed forever, and yesterday's supported bank can silently stop working.

How to answer this, stage by stage

Nobody's grading whether you picked the "right" app. They're grading whether you can find the one moment that actually breaks trust and say why.

Stage 1
Scope it to one real product and one real user
Say it like this
"I'll take Tallyhatch, an AI budgeting app I'd use if I ran a small business, and walk through its onboarding as a sole proprietor doing her books alone."
Why this works
Locks the answer to something concrete instead of a generic "onboarding is important" ramble.
Stage 2
Say your structure out loud
Say it like this
"I'll use FLIPS. Find the person, locate the habit, identify the flip, pinpoint the old decision, show the replay."
Why this works
Signals you're finding a specific breaking point, not just narrating a screen-by-screen tour.
Stage 3
Name the habit onboarding built too fast
Say it like this
"The first successful bank sync convinced Ines the app could just handle everything. She stopped keeping her paper ledger that same week, two days before she'd actually need it as a backup."
Why this works
Shows the trust was earned fast, and fragile, which sets up why the failure hits so hard.
Stage 4
Identify the actual flip
Say it like this
"When the bank link failed with no fallback, she didn't try harder or complain. She just quietly stopped opening the app. No support ticket. No one-star review. She went back to her old ledger and never came back."
Why this works
Names the specific, silent behavior instead of a vague "she got frustrated."
Stage 5
Pinpoint the old decision
Say it like this
"Tallyhatch's onboarding promises 'connect your bank and we'll handle the rest.' That's fine for the roughly 80 percent of banks that link cleanly. It sets zero expectation for the rest, so when the link fails, the user has no idea that's even a normal outcome."
Why this works
Names a specific onboarding-copy decision, not a vague "the UX needs work."
Stage 6
Show the replay
Say it like this
"Same failed bank link, same Tuesday night. This time the screen says 'we can't reach your bank yet, add this month by hand for now,' with three fields already sitting there. Ines fills in a week of numbers in ten minutes and comes back the next night."
Why this works
Ends on something countable: she comes back, instead of vanishing.
Stage 7
Close on the one line
Say it like this
"The weakest moment in this onboarding isn't a confusing screen. It's a real failure with no second option, dressed up as a promise that everything would just work."
Why this works
Restates the flip in one breath, ready for whatever gets pushed on next.

Let's learn

Say we build a budgeting app that reads a bank feed and drafts a small business's monthly numbers with no manual entry required.

Tallyhatch is that app. Sign up, link your bank, and within a few minutes it hands you a categorized budget, no spreadsheet touched.

Knowledge spark: what's a bank link, and why does it fail? Most budgeting apps don't talk to your bank directly. They go through a middleman service that many banks support and some don't, especially smaller regional and community banks. When the middleman can't reach a bank, or the bank changes its login system, the connection just breaks, often with no clear reason shown to the user.

For the roughly 4 in 5 new users whose bank connects cleanly, onboarding is genuinely great: a working budget appears in minutes, and they stay.

Where new sign-ups drop, onboarding funnel
100% 50% 0 Sign up100% Verify email90% Attempt link84% Link succeeds52% First budget47% Active day 731%
One step loses more people than any other: bank link succeeding on the first try. It's the only red bar, and it's where onboarding actually breaks.

Then there's the other fifth. At its worst: a bank link fails, the screen offers nothing but "try again," and a new user who was ready to trust the product entirely just closes the tab.

The decision I would take back Tallyhatch's onboarding copy says "connect your bank and we'll handle the rest," with no mention that some banks don't link cleanly and no fallback path built for that moment. That was a fine, confident pitch when most early testers happened to bank with the handful of institutions the middleman service supported best. It stopped making sense the moment real small-business owners, banking with all kinds of local and regional banks, started showing up.

What I would leave alone: the email verification step. It's a small extra tap, mildly annoying, but nobody abandons a budgeting app over one verification email. Fixing it wouldn't move the number that actually matters.

The weakest moment in this onboarding isn't a confusing screen. It's a real failure with no second option, dressed up as a promise that everything would just work.

The lesson: a product that promises full automation, with nothing built for the moment automation fails, isn't offering convenience. It's offering a coin flip, and only telling the winners about it.

Now here is the same thing as a story

The short version above is what you'd say defending this teardown live. Read this one for how it actually played out over eight days.

Every night after closing, Ines Cabral used to sit at the counter with a paper ledger and a calculator, entering the day's ingredient costs and sales by hand. She'd run the bakery alone for three years and could eyeball her margin on a batch of croissants before the calculator finished.

Hand sketched flow diagram titled FLIPS, the five stops. Five boxes in order: find the person, locate the habit, identify the flip highlighted, pinpoint the decision, show the replay.
Five stops, and the third one, the flip, is the one that decides whether this whole teardown has any teeth.

She signed up for Tallyhatch on a Tuesday night, an hour after closing, hoping to finally retire the paper ledger. The sign-up took two minutes. She linked her bank the same night, and it worked on the first try.

Hand sketched timeline titled Ines's first eight days. Four milestones: signs up day 0 late, bank link fails day 2 highlighted, opens once more day 4, stops opening day 8.
Nothing dramatic happens on day eight. The real event already happened on day two, and day eight is just where it finally shows up as churn.

By day two she'd stopped reaching for the paper ledger entirely. The first sync had been clean, categorized correctly, and honestly a little magical. So when a second bank account she added, one she used for a small wholesale side line, failed to connect, she had nothing left to fall back on.

Hand sketched decision tree titled What Tallyhatch does when a bank link fails. Root: bank connection fails. Four branches: today's design leads to blank screen try again, the fix leads to manual entry same day, also considered leads to email support rejected too slow, also considered leads to auto retry only rejected silent.
Two rejected options sit next to the real fix. Email support is too slow for a nightly habit. Silent auto-retry hides the problem instead of solving it.

The screen just said "we couldn't connect to this account, try again." No manual option. No explanation. No sense of whether this was rare or common.

Hand sketched comparison diagram titled Two dead ends, day two. Left panel a question mark box icon labeled Today, caption blank screen no path. Right panel a document icon labeled Fixed, caption type it in by hand.
One extra box on the screen, a place to type the numbers in by hand, is the entire difference between these two panels.

She opened the app once more, two days later, mostly out of habit, saw the same message, and closed it. By day eight she hadn't opened it again. Her paper ledger, half-abandoned, sat under the counter, and she went back to it without ever filing a complaint or leaving a review.

Hand sketched quadrant titled Sorting onboarding moments. Axes how often it happens from rare to common, and how bad the dead end feels from mild to severe. Bank link fails sits top right, common and severe. Typo in email sits lower right, common but mild. Slow first load sits lower right too, less common. Wrong currency sits far left, rare.
Bank link failure is the only moment sitting in the dangerous corner: it happens often enough to matter, and it feels severe enough to end the relationship.

Daily active use over 14 days, by first bank-link outcome
100% 50% 0 Link worked: 60% Link failed: 2% Day 1 Day 3 Day 7 Day 14 steepest drop
Both groups start at 100% on day one. By day three, the failed-link group has already collapsed to near nothing, three days before anyone would call it a churn problem.

Nobody at Tallyhatch decided to abandon their unsupported-bank users. Somebody decided, back when the product first launched, that the onboarding copy should sound confident and simple: "connect your bank and we'll handle the rest." At the time, the handful of early testers all banked with institutions the middleman service supported perfectly. The line was true for everyone who'd ever read it.

It stopped being true the moment real small-business owners, using every kind of local, regional, and community bank, started signing up. Nobody rewrote the line, because nobody was watching the users it was now failing.

With a manual entry fallback sitting right there the moment the link failed, Ines fills in a week of transactions from memory and her register tape in about ten minutes, on the exact same Tuesday night. She comes back the next evening to check the budget it drew up, and the paper ledger stays retired for good.

I wrote "we'll handle the rest" because it sounded confident in a pitch deck, and nobody had pushed back on it yet. It took watching a real bakery owner quietly go back to paper, with no complaint and no way for us to even see it happen, to understand that a promise with no fallback isn't confidence. It's a bet we were making with her trust.

If you want to remember it easily, here is another way

F, find the person → Ines Cabral, sole proprietor, does her books alone after closing.
L, locate the habit → She retired her paper ledger within two days of one clean bank sync.
I, identify the flip → She didn't complain or retry harder. She quietly stopped opening the app for good.
P, pinpoint the old decision → Onboarding copy promised full automation with no fallback for the banks that don't link cleanly.
S, show the replay → With manual entry offered on the spot, she's back to checking her budget the very next night.

And if you want to be sure it really works, try it somewhere elseSame five letters, a different flip family: a fitness app instead of a budgeting app, and this time the person over-trusts instead of abandoning.

Formhold is a consumer fitness app that uses a phone camera to auto-detect the weight plates on a barbell and log a workout without any manual entry. A new user's first session goes smoothly: the camera reads the plates correctly, logs three sets, and the whole thing feels effortless.

Mapped onto FLIPS, with a different flip: F is a new gym member starting a strength program alone for the first time. L is that she stops double-checking the logged weight against what she actually loaded, since the first several reads were correct. I is the over-trust flip, not abandonment this time: the camera misreads a plate once, silently, and logs a weight 20 pounds lighter than what she actually lifted, and she never notices because she'd stopped checking. P is the onboarding decision to never show a "does this look right?" confirmation on the very first few logged sets, since testers found it annoying. S is the replay: with a lightweight confirm step for just the first five sessions, the misread gets caught the moment it happens, not weeks later when her program is quietly built on wrong numbers.

Hand sketched icon list titled Formhold's first-run gap. Three rows: a gauge icon labeled camera cannot read the barbell load, a question mark box icon labeled app just says try again, a document icon labeled no manual weight entry offered.
A different product, a different flip, and yet the missing piece rhymes: no visible way to catch or correct what the camera got wrong.

Swap the trigger and it still runs.
Speed: an interviewer caps you at sixty seconds. Say "the weakest moment is the bank-link dead end, not the sign-up screen, because that's the one failure with zero fallback" and stop.
Cost: no engineering time to build manual entry this quarter. Say so, and start with a single honest sentence on the failure screen naming that manual entry is coming, so at least the user knows it isn't a dead end forever.
The model gets better, for real: even if the bank-link success rate climbs from 84 percent to 95 percent, the users hitting that remaining 5 percent still get the exact same dead end. A better success rate doesn't fix a missing fallback, it just makes the gap smaller and easier to ignore.

Where people run it wrong.
They tear down the sign-up form and the first-screen copy, the parts they can see easily, and miss the one moment where a real technical failure meets zero fallback.
They measure onboarding completion as one overall number instead of splitting it by whether the core automation actually worked.
They assume a quiet drop-off means the product wasn't good enough, instead of checking whether it simply had no second option when the first one failed.

How to use it live. When asked to tear down an onboarding flow, ask yourself one question before touching a single screenshot: where does this product's core promise have a real chance of technically failing, and what happens the instant it does? That's almost always the weakest moment, not the prettiest or ugliest screen.

Flashcards (tap any card to flip it)

1 · THE FLIP FAMILY
What flip family is this?
Tap to flip
ANSWER
Abandonment flip: uses it daily for a few days, then quietly stops opening it, with no complaint or support ticket.
2 · THE PEOPLE
Who is this answer about?
Tap to flip
ANSWER
Ines Cabral, who runs a small bakery alone and used to do her books on paper after closing each night.
3 · THE HABIT
What did Ines stop doing because it worked?
Tap to flip
ANSWER
Keeping her paper ledger. She retired it within two days of one clean bank sync.
4 · THE FLIP, IN THIS STORY
What's the two-setting switch here?
Tap to flip
ANSWER
Opening the app daily, hoping it works, versus quietly never opening it again. No middle ground, and no complaint filed either way.
5 · THE OLD DECISION
What decision would you take back?
Tap to flip
ANSWER
Onboarding copy promising full automation with no fallback path for the banks that fail to link.
6 · THE NUMBER
Fill in the blank: bank link succeeds on the first try for only about ___ percent of new sign-ups.
Tap to flip
ANSWER
52 percent. It's the single biggest drop in the entire onboarding funnel.
7 · THE REPLAY
Same failed bank link, redesigned onboarding. What changes?
Tap to flip
ANSWER
Ines gets a manual entry option on the spot, fills in a week of numbers in ten minutes, and returns the very next night instead of vanishing for good.
8 · CROSS PRODUCT TRANSFER
Section 4 answers this same question again for a different product. Which product, and which family?
Tap to flip
ANSWER
Formhold, a camera-based fitness logging app, using the over-trust flip instead of abandonment.

Check yourself Score: 0 / 0

Fill in the blank
1. Fill in the blank: only ___ percent of new Tallyhatch sign-ups get their bank link to succeed on the first try.
Show hint
Look at the onboarding funnel chart.
Show answer
52 percent. It's the single largest drop in the whole funnel, bigger than sign-up or verification combined.
Multiple choice
2. Why is the bank-link failure the "weakest moment," rather than the email verification step?
  • A. Because email verification takes longer to complete.
  • B. Because more users see the email verification screen.
  • C. Because the bank-link failure is a real dead end with no fallback, while verification is a minor annoyance nobody abandons the app over.
  • D. Because the bank-link screen has worse visual design.
Show hint
Look at "what I would leave alone."
Show answer
C. A weakest moment is about consequence, not annoyance. Only one of these two ends the relationship.
True or false
3. True or false: Ines filed a support ticket or left a bad review after the bank link failed.
  • True
  • False
Show hint
Look at the abandonment flip's definition.
Show answer
False. She just quietly stopped opening the app, which is exactly what makes an abandonment flip so easy for a team to miss.
Short answer, name the reversal
4. What old decision does this answer take back, and why did it make sense when it was made?
Show hint
Look at "the decision I would take back."
Show answer
Model answer: Promising "connect your bank and we'll handle the rest" with no fallback, which was true for every early tester whose bank happened to link cleanly.
Short answer, where it wouldn't matter
5. Name a moment in Tallyhatch's onboarding where this same kind of fix wouldn't matter much.
Show hint
Look at "what I would leave alone."
Show answer
Model answer: The email verification step. It's mildly annoying but doesn't carry the same risk of a silent, permanent abandonment.
Short answer, apply it yourself
6. Pick an app you use yourself. What's one habit it built in you that you'd stop doing if the app got a little worse at its core job?
Show hint
Think about something you used to do by hand that you now trust an app to do for you.
Show answer
Model answer: A common one is checking a GPS app's suggested route. Most people stopped cross-checking it early and would quietly go back to the old way after one confident wrong turn.
Before you close the answer
Why this works
Tests whether you can find the one moment in an onboarding flow that actually costs the product a user, instead of critiquing screens by how polished they look.
Follow-up traps
"Isn't the real fix just supporting more banks?" Response: that helps over time, but it never reaches zero, and the fallback is what protects every user who hits the gap in the meantime, no matter how small that gap gets.

"Couldn't a clearer error message alone fix this, without building manual entry?" Response: a clearer message helps the user understand what happened, but it doesn't give them anything to actually do. Without a next step, a clearer dead end is still a dead end.
If pressed
The real fallback wouldn't ask for a full month of manual entry up front. It would ask for just the current week, since that's the smallest unit that lets Tallyhatch draw a first budget the same night, with the rest filled in as the user goes.
From U2xAI Academy

From answering questions to owning outcomes.

A live workshop where you ship a working AI agent, defend a launch decision, and walk away with a portfolio recruiters can't wave off, not just more questions to study.

  • A live AI agent you actually shipped
  • A launch decision you can defend under pressure
  • An interview-ready portfolio, not more flashcards
Know more