CaseIntermediateDesigning for Uncertainty & Trust / Designing for failure and graceful degradation / #10

What is the right undo experience for AI-generated changes?

PICK one undo error is cheap and loud, the other is quiet and eats your own work

Numerholt is a spreadsheet platform built for financial modeling, with an AI assistant that can restructure formulas across a model on request. Imelda Cho is an analyst who uses it daily. This is about the moment undo did more than she asked it to.

The direct answer
Undo should default to reverting only the AI's own edit, shown as a labeled, isolated change, never a full-document revert to the last save point. Keep full revert available as a separate, clearly labeled option, and fall back to it honestly whenever the AI's edit is too tangled with your manual changes to safely pull apart.
Do this, in order
  1. Make the AI's own edit its own reversible unit, separate from the manual-edit history.Why: a shared undo stack means undoing the AI's mistake can silently erase your own work done since.
  2. Show exactly what changed before offering to undo it.Why: a blind undo button asks for trust the same way the AI edit itself did, right after that trust just broke.
  3. Keep full-document revert available, but as a second, explicit choice.Why: sometimes a full revert really is what's needed, it just shouldn't be the only option on offer.
  4. Detect when an AI edit is too tangled with manual edits to isolate safely, and say so.Why: pretending every edit can be cleanly pulled apart creates a worse, silent failure than admitting it can't.
  5. Track how often undo falls back to a full revert, not just how often undo gets used.Why: a rising fallback rate means the isolation logic is breaking down before a user ever complains about it.
  6. Leave single-cell AI edits on the simplest undo path available.Why: a one-cell change was never at risk of tangling with anything, so the extra machinery buys nothing there.

How to answer this, stage by stage

Nobody is grading whether you know that undo buttons exist. They're grading whether you noticed undo can have its own kind of mistake.

Stage 1
Reframe the question as a real tradeoff
Say it like this
"This isn't really 'what's the right undo button.' It's 'full revert or scoped undo,' and I'll answer it with Numerholt, a spreadsheet tool, and an analyst named Imelda."
Why this works
Turns a vague UX question into a concrete either-or an interviewer can push back on.
Stage 2
Say your structure out loud
Say it like this
"I'll use PICK. Position, my pick up front. Impact, who feels each kind of error. Cost asymmetry, which one is worse. Kill criteria, what would change my mind."
Why this works
Shows you can commit to a position instead of listing pros and cons forever.
Stage 3
State the position before any reasoning
Say it like this
"Scoped, labeled undo of the AI's own edit, as the default. Full revert stays available, but as a second choice, not the only one."
Why this works
This is the direct answer, said first, before any justification, which is exactly what PICK tests.
Stage 4
Name the asymmetry between the two errors
Say it like this
"A full revert is cheap to click but hides its real cost, your own edits since the last save vanish with it. A scoped undo is more work to build, but nothing disappears without you seeing it first."
Why this works
This is PICK's core move: showing the two errors don't cost the same amount, or land on the same person.
Stage 5
Give the kill criteria honestly
Say it like this
"If the AI's edit touched a formula a manual edit also depends on, isolating just the AI's part could break the model. At that point, fall back to a full revert, clearly labeled, rather than pretend a clean isolation is always possible."
Why this works
Shows the pick isn't stubborn, it has a stated condition under which it would change.
Stage 6
Close on the one line
Say it like this
"Undo should cost you exactly what the AI actually changed, no more. The moment it costs you your own work too, it's not an undo button anymore, it's a second mistake wearing a safety feature's name."
Why this works
Restates the position in one breath, ready for a follow-up.

Let's learn

Picture this: you ask an AI assistant to clean up one part of a document you've been working on for an hour, and you like almost none of what it did. You click undo. What comes back?

Before Numerholt had an AI assistant, every edit to a model was manual, and undo simply stepped back through exactly what you'd typed, one keystroke or one cell at a time, in order.

Hand sketched flow diagram titled From AI edit to a safe undo. Five boxes: Manual edit made, AI edit requested, AI edit applied, Diff isolated highlighted, One click undo.
The fourth box, isolating the diff, is the whole design problem. Everything before and after it is straightforward.

Now the AI assistant can restructure a whole section of a model in one request, dozens of cells at once, in seconds.

Time to fully recover from a bad AI edit, by undo design
45 min 22 0 4 1 Small AI edit 42 3 Large AI edit
Full revert and labeled undo cost about the same on a small edit. On a large one, full revert's hidden cost, redone manual work, gets 14 times worse. Labeled undo barely moves.

Here's the turn: the AI's mistake was never the expensive part. The expensive part was that the only undo available reverted everything back to the last save, which meant any manual work done in the twenty minutes since also vanished, silently, with no warning that it was about to.

At its worst, an analyst loses an hour of hand-tuned scenario work to a single click meant to fix a much smaller problem, and doesn't notice until she needs that scenario again days later.

Hand sketched two-panel comparison titled The asymmetry, drawn. Left, a red box icon labeled Full revert, caption wipes your edits too. Right, a blue document icon labeled Labeled AI-only undo, caption protects your work.
Both panels say "undo." Only one of them costs you something you didn't ask to lose.
The decision I would take back Numerholt built one shared undo stack for both manual and AI edits, since a second, AI-specific undo layer felt like unneeded complexity back when the assistant only ever touched a cell or two at a time. That made sense at launch. It stopped making sense the day the assistant started making forty-cell edits inside the same session as real manual work.

What I would leave alone: a single-cell AI edit doesn't need any of this. It was never at risk of tangling with a manual edit made minutes before, so the simplest undo path is still the right one there.

The lesson: an undo button is a promise about scope, not just a promise to go backward. The moment it takes back more than what actually broke, it's made a new mistake instead of fixing the old one.

Now here is the same thing as a story

The short version above is what you'd say defending this design to Numerholt's product council. Read this one for the actual Thursday afternoon.

Two in the afternoon is when Imelda Cho does her best work, deep enough into the day that the model's structure is fully in her head, but early enough that she isn't rushing to close it out before a meeting.

That Thursday, she'd spent since 2:00pm hand-tuning a one-off downside scenario for a partner call, adjusting a dozen cells by hand to model a specific bad quarter. At 2:20pm, with that scenario still open in the same file, she asked Numerholt's assistant to extend the whole revenue forecast from twelve months to twenty-four.

Knowledge spark: why would an AI edit be hard to "undo cleanly"? A model can change forty cells in one pass, and some of those cells might reference a formula a person edited by hand ten minutes earlier. Undoing "just the AI's part" means the tool has to know exactly which changes were the AI's and which downstream cells now depend on them, a genuinely harder problem than stepping back through a single linear history of keystrokes.

The assistant rewrote forty cells in about a second. Three of those cells were ones Imelda had hand-tuned twenty minutes earlier for her downside scenario, now silently overwritten as part of the broader rewrite.

Hand sketched timeline titled Imelda's Thursday afternoon. Five milestones: Hand tunes a scenario 2 00pm one off case, Asks AI to extend forecast 2 20pm 24 months, AI rewrites 40 cells 2 21pm, Hits undo loses both highlighted, Isolated undo ships next release.
Twenty-five minutes from a careful one-off edit to losing it entirely, by clicking the one button meant to protect her.

She didn't like the twenty-four-month forecast, so at 2:25pm she hit undo, expecting the AI's rewrite to disappear and her afternoon's work to still be sitting there. Instead, Numerholt reverted the whole file to its last save point from before 2:00pm. The AI's forecast was gone. So was her downside scenario.

The undo button did not lie about going backward. It just never said how far back it was about to go.

She rebuilt the downside scenario from memory over the next twenty minutes, annoyed but not alarmed, since nothing on screen had told her the two were ever linked.

Hand sketched labeled parts diagram titled What a good undo card shows. A document icon at the center labeled Undo Card, with four callouts around it: cells changed, what it was, what it is now, undo just this.
None of these four existed on the old undo button. It just said "undo," full stop.

With the redesign, that same 2:21pm AI edit becomes its own labeled card: "Changed 40 cells to extend the forecast to 24 months," with a preview of before and after, and a button that undoes only those forty cells. Run the same afternoon forward: Imelda clicks undo at 2:25pm, the forecast rewrite disappears, and her downside scenario, untouched by the AI edit in the first place, is exactly where she left it.

Hand sketched quadrant titled Which AI edits get isolated undo. Axes: tangled with manual edits, clean to tangled, and size of the AI edit, small to large. Single cell fix and renamed header sit small and clean. The 24 month forecast sits large but still clean. A formula shared with a manual edit sits tangled.
Most edits, including Imelda's forty-cell rewrite, are large but still clean enough to isolate. Only the tangled corner needs the honest fallback.

The old undo asked Imelda to trust that going backward meant going back to exactly where she wanted. The new one shows her precisely what it's about to take back, and nothing more.

I approved the shared undo stack because it was simpler to build, and simple felt like the safer choice at the time. It took one lost scenario to see that simple, in this case, just meant nobody had drawn the line the AI's edit actually needed.

PICK, in one screenNot a lecture on undo history. PICK is what forces you to say which mistake you're actually optimizing against.

P
Position. The pick, stated first.
Scoped, labeled undo of the AI's own edit, as the default. Full revert stays available as a clearly separate choice.
Committing before the reasoning is what the question is actually testing.
I
Impact. Who feels each kind of error.
A too-coarse full revert costs Imelda her own manual work, silently. A too-granular undo with no summary costs her time hunting through forty changed cells one by one.
Names both sides in real terms, minutes lost and work destroyed, not just "bad experience."
C
Cost asymmetry. Which one is worse.
The full-revert error is cheap to trigger and hidden until it's too late. The tedious-diff error costs time but destroys nothing. Optimize against the hidden one.
The heart of PICK: naming which error is visible and absorbed, and which is invisible and expensive.
K
Kill criteria. What would flip the pick.
If an AI edit is genuinely tangled with a manual edit, and isolating it would break a dependent cell, fall back honestly to a full revert instead of a broken partial undo.
Shows the position has a real condition attached, not just stubbornness.
Hand sketched icon list titled What would flip this pick back. Three items: a box icon labeled AI edit tangled with a manual formula, a document icon labeled Isolating the diff breaks a dependent cell, a question mark icon labeled The model cannot reliably label its own change.
Any one of these three is a real reason to fall back to a full revert, said out loud instead of pretended around.

The recap, one line per letter: position is scoped undo as the default, impact is silent data loss versus tedious manual diffing, cost asymmetry is that silent loss is worse because it's hidden, and kill criteria is falling back to full revert when an edit is genuinely too tangled to isolate.

And if you want to be sure it really works, try it somewhere elseSame four letters, a design tool instead of a spreadsheet. The tangled thing is a shared layer, not a shared formula.

Sketchloom is a vector illustration app with an AI feature that can simplify or reflow linework across a whole file at once. Renata Kessling is a freelance illustrator who uses it on client work. Mapped onto PICK: position is the same, scoped undo on the AI's own layer changes, not a full-history revert; impact is that Sketchloom's single shared undo stack meant asking the AI to simplify linework on a client piece wiped out unrelated manual touch-ups Renata had made to a personal side project open in another tab of the same file, ten minutes she can't get back without redoing it from memory.

The cost asymmetry runs the same direction: a full revert is one click and looks safe, but it silently erases whatever else changed since the last save, wherever in the file that happened to be. The kill criteria also transfers directly: if the AI's linework simplification touched a path a manual edit also depended on, like a shared anchor point, Sketchloom's redesign says so plainly and offers a full revert instead of a broken partial one, rather than guessing.

Hand sketched two-panel comparison titled The asymmetry, drawn, reused here for Sketchloom. Left, a red box icon labeled Full revert, caption wipes your edits too. Right, a blue document icon labeled Labeled AI-only undo, caption protects your work.
Same two boxes, a different file format underneath them. The asymmetry never changes.
Share of Sketchloom's AI-edit undo actions that needed a full-revert fallback, by how tangled the edit was
100% 50 0 30% fallback line 35% entangled
Below 35 percent entanglement, isolation holds up fine. Past it, the honest move is falling back to a full revert instead of a partial undo that might quietly break something.

Swap the trigger and it still runs.
Speed: an interviewer caps you at sixty seconds. Say "scope undo to the AI's own edit by default, keep full revert as a second option, and fall back honestly when they're too tangled to separate," and stop.
Cost: there's no time to build entanglement detection this quarter. Say so honestly, and start by isolating undo for the most common case, a single AI request touching one contiguous block, before handling every tangled edge case.
The model gets better, for real: if the AI's edits get more surgical and touch fewer cells over time, that's still not a reason to go back to one shared undo stack, a smaller edit that still overlaps manual work costs the same when it's wiped by mistake.

Where people run it wrong.
They build one undo history for both AI and manual edits because it's simpler, and call the simplicity a feature.
They assume showing a diff after the fact is the same as protecting the work before undo runs, when the loss has often already happened by the time anyone reads a diff.
They wait for a support ticket about lost work to notice the fallback rate climbing, instead of watching it as a number from day one.

How to use it live. When someone asks you for the right undo experience, don't reach for "just add an undo button." Ask what undo could take back that the person never agreed to lose, and design against that specifically.

Flashcards (tap any card to flip it)

1 · THE FRAMEWORK
What framework fits an "A or B" tradeoff question?
Tap to flip
ANSWER
PICK: position, impact, cost asymmetry, kill criteria. State your pick first, then show why the two errors don't cost the same.
2 · THE PERSON
Who is this answer about?
Tap to flip
ANSWER
Imelda Cho, a financial analyst who lost twenty minutes of hand-tuned scenario work to a full-revert undo she never asked for.
3 · THE POSITION
What's the pick, stated first?
Tap to flip
ANSWER
Scoped, labeled undo of the AI's own edit as the default, with full-document revert kept as a separate, explicit option.
4 · THE ASYMMETRY
Why is a full revert worse than a tedious manual diff?
Tap to flip
ANSWER
A full revert is cheap to trigger but destroys other work silently. A tedious diff costs time but destroys nothing, so it's the safer error to accept.
5 · THE OLD DECISION
What decision would you take back?
Tap to flip
ANSWER
Building one shared undo stack for both manual and AI edits, reasonable when the AI only touched a cell or two, wrong once it started making forty-cell edits.
6 · THE NUMBER
Fill in the blank: on a large AI edit, full revert cost about ___ minutes of redone manual work, versus 3 minutes for labeled undo.
Tap to flip
ANSWER
42 minutes. The gap barely exists on a small edit and grows enormously as the AI edit gets larger.
7 · THE REPLAY
Same Thursday, redesigned undo. What changes?
Tap to flip
ANSWER
Imelda's undo reverts only the forty-cell forecast rewrite. Her downside scenario, untouched by that edit, is exactly where she left it.
8 · CROSS PRODUCT TRANSFER
Section 4 answers this again for a different product. Which product, and what's tangled there?
Tap to flip
ANSWER
Sketchloom, a vector illustration app. A shared anchor point between the AI's linework simplification and a manual edit is what can make isolation unsafe.

Check yourself Score: 0 / 0

Short answer, name the position
1. What is this answer's actual pick, stated as a single sentence?
Show hint
Look at the direct answer and the Position step.
Show answer
Model answer: Scoped, labeled undo of the AI's own edit as the default, with full-document revert kept available as a separate, clearly marked choice.
Multiple choice
2. Why is the full-revert error considered the more dangerous of the two in this answer?
  • A. It takes longer to click than a scoped undo.
  • B. It silently destroys other work done since the last save, with no warning.
  • C. It only works on large AI edits, never small ones.
  • D. It requires the AI to make a second mistake.
Show hint
Look at the Cost Asymmetry step.
Show answer
B. The hidden, silent cost is what makes it worse than a merely tedious but harmless error.
True or false
3. True or false: this answer says full-document revert should never be offered as an option.
  • True
  • False
Show hint
Look at priority list item 3.
Show answer
False. Full revert stays available, just as a separate, explicit choice rather than the only option or the default.
Fill in the blank
4. Fill in the blank: the AI edit rewrote ___ cells when Imelda asked it to extend the forecast to 24 months.
Show hint
Look at the timeline diagram.
Show answer
40 cells. Three of those overlapped a scenario she'd hand-tuned twenty minutes earlier.
Short answer, apply it yourself
5. Think of a tool you use with an undo or revert feature. If you hit undo right now, do you actually know how far back it would go?
Show hint
Ask whether the tool ever shows you a preview before undo runs, or just runs it.
Show answer
Model answer: Most people have used at least one tool where undo's actual scope was a surprise, which is exactly the gap this answer designs against.
Short answer, where it wouldn't matter
6. Name a kind of AI edit on Numerholt where this scoped-undo redesign genuinely isn't needed.
Show hint
Look at "what I would leave alone."
Show answer
Model answer: A single-cell AI edit. It was never at risk of tangling with a manual edit made minutes earlier, so the simplest undo path is already fine.
Before you close the answer
Why this works
Tests whether you'll notice that a safety feature, undo, can have its own failure mode, or whether you'll describe undo as if the only risk lives in the AI edit it's meant to fix.
Follow-up traps
"Isn't isolating just the AI's edit technically much harder to build than a simple revert?" Response: yes, genuinely harder, and that's exactly why the kill criteria exists, to fall back honestly to full revert the moment isolation can't be done safely, instead of pretending it's always possible.

"What if a user actually wanted the full revert and now has to click through an extra option?" Response: one extra click to get the destructive option is a fair price for making the non-destructive option the default, given how much more often people want to undo just the mistake, not their own work too.
If pressed
Numerholt's isolation check runs a dependency scan before offering scoped undo at all, walking the formula graph from every cell the AI touched to see if a manually-edited cell references it, and only then decides whether a clean, scoped undo is even safe to offer.
From U2xAI Academy

From answering questions to owning outcomes.

A live workshop where you ship a working AI agent, defend a launch decision, and walk away with a portfolio recruiters can't wave off, not just more questions to study.

  • A live AI agent you actually shipped
  • A launch decision you can defend under pressure
  • An interview-ready portfolio, not more flashcards
Know more