ConceptFoundationalResponsible AI & Advanced Practice / Building an AI PM portfolio / #10

Explain why a shipped prototype beats a polished deck.

FLIPS Greta Holm built a resale-fraud detection prototype for Lumen Live, a ticketing platform, to get past Warren Castellano's new rule

Warren Castellano has spent eleven years hiring AI product talent, and for most of them he read every candidate's pitch deck fully, slide by slide, before making a call. Greta Holm is applying to his team with a resale-fraud detection prototype modeled on Lumen Live, a ticketing platform where scalping bots buy up tickets in seconds. Her portfolio page leads with a link, not a slide.

The direct answer
A shipped prototype beats a deck because it survives the one thing a deck can't: someone actually clicking it. A deck asks a reviewer to imagine the product working. A prototype lets them find out in real time, including the exact moment it breaks. That difference is why experienced reviewers now open the link first and read the slides, if at all, after.
Do this, in order
  1. Ship something a reviewer can click before you polish a single slide.Why: a link gets tested in seconds; a claim in a deck can't be tested at all without one.
  2. Let the prototype run a real case, including one it gets wrong.Why: a reviewer trusts a prototype that fails visibly far more than a deck that never admits a failure exists.
  3. Keep the deck short, and only as a companion to the link, never a replacement for it.Why: a deck's job is now to add context to something already proven, not to carry the whole argument alone.
  4. Make sure the link works with zero setup, no login, no waiting.Why: a reviewer who hits friction before they hit the product treats the friction as the whole verdict.
  5. Don't over-promise in the deck what the prototype can't yet back up.Why: the gap between the two is exactly what an experienced reviewer is now trained to go looking for.
  6. Save deck-only pitches for the ideas genuinely too early to build anything real.Why: a concept-stage idea with no possible prototype yet is a different, honest situation, not an excuse.

How to answer this, stage by stage

This isn't a question about presentation skills. It's asking whether you understand why an experienced reviewer's trust in words alone has already run out.

Stage 1
Scope it to one real reviewer
Say it like this
"I'll answer this for an experienced hiring manager who's read hundreds of decks and has learned, the hard way, what a deck alone can hide."
Why this works
Grounds an abstract comparison in one real reader's actual behavior, not a general claim about "portfolios."
Stage 2
Say your structure out loud
Say it like this
"I'll use FLIPS. Find the person, locate the habit, identify the flip, pinpoint the old decision, show the replay."
Why this works
Signals you're explaining a real behavior change, not just restating a preference for demos over slides.
Stage 3
Locate the habit that used to work
Say it like this
"Warren used to read every deck fully, in order, because most of the time, the story in the deck was close enough to the truth."
Why this works
Shows the old habit was reasonable, not naive, which is what makes the later flip land.
Stage 4
Identify the flip
Say it like this
"Now he doesn't skim decks a little more carefully. He stops opening them at all if there's no working link, no exceptions, no partial credit."
Why this works
Names a real two-setting switch, not a dial being turned up.
Stage 5
Give the direct answer
Say it like this
"A prototype survives being clicked. A deck only survives being read, which is a much lower bar, and reviewers have learned that the hard way."
Why this works
This is the concrete answer to the actual question, in one breath.
Stage 6
Pinpoint the old decision
Say it like this
"Warren's team used to schedule a full thirty-minute pitch meeting before any live testing happened, back when almost nobody had a working prototype ready anyway."
Why this works
Names a specific, once-reasonable decision, not a vague sense that "things used to be different."
Stage 7
Show the replay, and close
Say it like this
"Now the application requires a working link before any meeting gets scheduled at all. Review time per candidate dropped from a thirty-minute pitch to a three-minute live test, and most decisions happen the same day."
Why this works
Ends on something countable, which is what separates a real answer from a nice-sounding one.

Let's learn

Say a hiring manager has read enough decks, over enough years, to know exactly which sentence in one usually means "we haven't built this yet."

For most of his eleven years, Warren read every deck fully, start to finish, roughly forty minutes each, before deciding whether to schedule a call.

Knowledge spark: what's a prototype, exactly? A rough, working version of a product, built to be tested rather than admired. It doesn't need to be pretty or complete. It needs to run, and to show what happens when a real case is fed into it, including a case it gets wrong.

Now, on any given week, Warren opens a link first, spends about three minutes actually testing it, and only reads the accompanying deck afterward, if the link held up at all.

How Warren spends his review time per candidate, before and after
40m 20m 0 Before, deck-first 40 min After, link-first 3 min
The time didn't just shrink. It moved from reading a story to testing a claim directly.

At its worst: a candidate with a genuinely strong idea and a beautifully written deck gets no callback at all, because there's nothing in the application for Warren to click, and by his new rule, that alone ends the review.

The decision I would take back Warren's team once scheduled a full pitch meeting for every serious application, before any live testing happened at all. That made sense back when almost no candidate had anything working to test, so a meeting was the only way to hear the idea. It stopped making sense once building a rough prototype became something most serious candidates could actually do in a weekend.

What I would leave alone: for a genuinely early-stage, concept-only idea, where no prototype could reasonably exist yet, a deck-first conversation is still the right format. The new rule isn't a ban on ideas without a build. It's a filter against ideas that could have been built and weren't.

A deck asks Warren to imagine the product working. A prototype lets him find out, in real time, whether it actually does.

The lesson: the deck was never really the problem. The problem was a review process that let a good story stand in for a working answer, for exactly as long as nobody clicked anything.

Now here is the same thing as a story

The short version above is what you'd say defending a shipped prototype in an interview. Read this one for how that reviewer actually changed.

Warren built his reputation on reading people well from a deck alone, the tone of a claim, the shape of a roadmap, the confidence in a single sentence about "what we've already built."

For years, that instinct served him fine. Decks were mostly honest, mostly close to the truth, and a forty-minute read was a fair trade for a real signal.

Hand sketched timeline titled Before, during, and after the snap. Four milestones: Reads every deck, full in order. Trust thins, skims the middle. A peer's bad hire, highlighted, the trigger. Demands a link, before reading anything.
The habit thinned quietly for months before the actual snap. Nobody, including Warren, noticed it happening in real time.

The thinning was slow: first he read every slide fully, then he started skimming the middle of a deck if the opening felt strong enough, then he stopped reading past the first five slides at all for anything that felt routine.

Hand sketched comparison diagram titled Small move, big snap. Left panel, a document icon labeled Gradual trust loss, caption reading a little less closely. Right panel, a box icon labeled The snap, caption refuses to open, no link.
A slow decline in one direction, and then, without warning, a hard stop in a completely different one.

The trigger wasn't Warren's own mistake. It happened to a close friend at another company: a hire whose deck described a "working recommendation engine," which turned out, on the job, to be an architecture diagram and nothing else, never once actually run.

Warren heard the story secondhand, over coffee, and felt something shift that had nothing to do with any deck he'd personally misjudged.

Hand sketched metaphor scene titled Switch, not dial. Left, a gauge icon labeled DIAL, caption how closely he reads. Right, a box icon labeled SWITCH, caption link, or no review.
He didn't turn a dial toward reading more carefully. He replaced the dial with a switch that has exactly two positions.

From that week on, Warren's team added one line to the application form: a working link, required, before any meeting gets scheduled at all. No exceptions carved out for a great-sounding idea.

Hand sketched flow diagram titled The redesigned review pipeline. Four boxes: Application in, Link required highlighted, 3-minute live test, Decision same day.
The link isn't step two anymore. It's the gate everything else has to pass through first.
Hand sketched icon list titled The five FLIPS letters. Five items: F find the person, L locate the habit, I identify the flip, P pinpoint the old decision, S show the replay.
Five steps, and the flip itself, the middle one, is the only one that took Warren months to fully notice in himself.

When Greta's application came in, with a live link to her fraud-detection prototype sitting above her two-paragraph summary, Warren tested it in about ninety seconds: three real ticket-purchase patterns, one of them a false alarm the tool flagged and explained honestly.

The old process asked Warren to sit through thirty minutes of narration before finding out if anything worked. The new one lets him find out in three minutes, and only spends the other twenty-seven once there's something real underneath the story.

I used to believe a well-told story was close enough to a working answer, because for years, it mostly was. Hearing what happened to my friend's hire is what showed me "mostly" was never good enough once the cost of being wrong stopped being embarrassing and started being expensive.

The five steps, if you want to remember themNot a memory trick. The actual shape of what changed in Warren, in order.

F
Find the person.
Warren Castellano, eleven years reading pitch decks, genuinely good at reading people from a page alone.
Grounds the whole story in one real reviewer's hands, not a segment of "hiring managers."
L
Locate the habit.
Reading every deck fully, in order, before deciding anything, because most decks were close enough to true.
Shows the habit was rational, not lazy, which is what makes losing it feel earned rather than arbitrary.
I
Identify the flip.
From reading every deck, no matter what, to refusing to open one at all without a working link. Two settings, no middle.
The hardest step, and the one the whole answer depends on getting right.
P
Pinpoint the old decision.
Scheduling a full pitch meeting before any live testing, back when almost nobody had a working prototype to test anyway.
Names a specific, once-reasonable choice, not a vague complaint about "how things used to be."
S
Show the replay.
Same application, redesigned process: a required link, a three-minute live test, a decision the same day instead of after a follow-up meeting.
Ends on something countable, not just a feeling that things improved.
Warren's full-read rate, deck by deck, in the months before the snap
100% 50% 0 Month 1 Month 3 Month 5 Month 6, trigger 95% 70% 40% near 0%
The decline was already well underway for months. The trigger didn't start the habit thinning, it just finished it.

The recap, one line per letter: find the person is Warren, eleven years of trusting a well-told story; locate the habit is reading every deck fully before deciding anything; identify the flip is going from full reads to no reads at all without a link; pinpoint the old decision is the pitch-meeting-before-testing format; and show the replay is the three-minute link test that now happens before any meeting gets scheduled.

And if you want to be sure it really works, try it somewhere elseSame five letters, a bespoke tailoring shop instead of a ticketing platform. A different candidate, and this time the flip belongs to a customer, not a reviewer.

Mei-Lin Chao runs pattern-fitting for a small custom-tailoring studio, and she's been testing an AI sizing tool that predicts alteration needs from a customer's photos before their first fitting appointment. Applied to FLIPS, with a different flip family: find the person is a longtime client who used to book every fitting with full trust, no questions. Locate the habit is showing up and letting the tailor adjust freely, without checking measurements beforehand. Identify the flip here is a substitution flip, not an abandonment one: after one bad sizing prediction cost her a rushed alteration before an event, she doesn't stop trusting the tool entirely, she starts saving it only for simple, low-stakes orders and reverts to an in-person fitting for anything that actually matters to her. Pinpoint the old decision: the studio priced the AI pre-fitting as a flat add-on fee regardless of garment complexity, which quietly pushed clients to ration its use toward the easiest cases. Show the replay: once the studio waived the fee for complex garments specifically, the client brought her most important order back to the tool, and the studio caught a fit issue five days earlier than the old walk-in-only process ever would have.

Hand sketched labeled parts diagram titled Anatomy of a prototype that survives a snap review. Center box icon labeled Live Prototype, with four callouts: opens in one click, runs a real case, shows a real miss, no login needed.
The same four qualities that got Greta past Warren's new rule are what would let Mei-Lin's client trust the tool again, on the order that actually mattered.

Swap the trigger and it still runs.
Speed: an interviewer wants your answer in one line. Say "a prototype survives being clicked, a deck only survives being read," and stop.
Cost: you can't afford to build anything polished before an application deadline. Ship the roughest version that still runs a real case; rough beats absent every time.
The reviewer gets more generous, for real: even if hiring slows down and reviewers have more time to read every deck again, the underlying gap doesn't close, a deck still can't be clicked, no matter how patiently it's read.

Where people run it wrong.
They polish the deck for weeks and treat the prototype as an afterthought, backwards from what actually gets tested first.
They ship a prototype that requires a login, a setup step, or a wait, all of which get treated as a failure before the product itself is even seen.
They let the deck claim more than the prototype can actually back up, which an experienced reviewer is now specifically trained to catch.

How to use it live. When asked why a prototype beats a deck, don't describe the deck's weaknesses. Describe the exact moment a reviewer clicks a link, and say what happens in the next three seconds. That's the whole answer.

Flashcards (tap any card to flip it)

1 · THE FLIP FAMILY
What flip family is this?
Tap to flip
ANSWER
Abandonment flip: Warren used to open and read every deck, and now quietly stops opening any deck with no working link at all, with no complaint or ticket, he just stops.
2 · THE PEOPLE
Who is this answer about?
Tap to flip
ANSWER
Warren Castellano, eleven years hiring AI product talent, and Greta Holm, whose fraud-detection prototype for Lumen Live is applying under his new rule.
3 · THE HABIT
What did Warren stop doing because it worked, for years?
Tap to flip
ANSWER
Reading every deck in full before deciding anything, since for most of his career, a well-told deck was usually close enough to the truth.
4 · THE FLIP, IN THIS STORY
What's the two-setting switch here?
Tap to flip
ANSWER
From reading every deck fully, regardless of what's behind it, to refusing to open any deck at all without a working, clickable link first.
5 · THE OLD DECISION
What decision would you take back?
Tap to flip
ANSWER
Scheduling a full pitch meeting for every serious application before any live testing, which made sense only while almost no candidate had a working prototype to test.
6 · THE NUMBER
Fill in the blank: average review time per candidate dropped from 40 minutes to about ___ minutes.
Tap to flip
ANSWER
3 minutes. The full-read rate on unlinked decks had already fallen from 95 percent to about 40 percent in the months before the trigger.
7 · THE REPLAY
Same bad-hire risk, new design, what changes?
Tap to flip
ANSWER
A working link is required before any meeting is scheduled at all, so a hollow claim like "we've already built this" gets caught in three minutes instead of thirty.
8 · CROSS PRODUCT TRANSFER
Section 4 answers this again for a different product, with a different flip family. Which product, and which family?
Tap to flip
ANSWER
Mei-Lin Chao's tailoring sizing tool, using a substitution flip: the client didn't abandon the tool, she rationed it toward easy orders after one bad prediction.

Check yourself Score: 0 / 0

True or false
1. True or false: Warren's flip is that he now reads decks more carefully than before.
  • True
  • False
Show hint
Look at the I step and the "switch, not dial" diagram.
Show answer
False. He doesn't read more carefully, he stops opening decks at all if there's no working link, a two-setting switch, not a dial turned up.
Multiple choice
2. Why couldn't Warren have just "read decks a bit more skeptically" instead of requiring a link?
  • A. Because skepticism is impossible to apply consistently.
  • B. Because a claim in a deck genuinely can't be tested without something to click, no matter how skeptically it's read.
  • C. Because decks are always dishonest.
  • D. Because reading skeptically takes too much extra time.
Show hint
Look at the direct answer and the tells for picking the wrong flip in flip-taxonomy.md's logic.
Show answer
B. No amount of careful reading turns an unverifiable claim into a tested one. Only something clickable does that.
Fill in the blank
3. Fill in the blank: in the months before the trigger, Warren's full-read rate on decks fell from 95 percent to about ___ percent by month 5.
Show hint
Look at the line chart of Warren's full-read rate over six months.
Show answer
40 percent. The habit had already thinned considerably before the trigger event finished the change.
Short answer, where it wouldn't matter
4. Name a case where a deck-only pitch is still the right call, even under Warren's new rule.
Show hint
Look at "what I would leave alone."
Show answer
Model answer: A genuinely early-stage, concept-only idea where no working prototype could reasonably exist yet. The rule targets ideas that could have been built and weren't.
Short answer, name the reversal
5. What old decision does this answer take back, and why did it make sense when it was made?
Show hint
Look at "the decision I would take back."
Show answer
Model answer: Scheduling a full pitch meeting before any live testing, which made sense while almost no candidate had a working prototype ready to test in the first place.
Short answer, apply it yourself
6. Pick a product you use yourself. What's one habit it built in you that you'd stop doing if it got a little worse?
Show hint
Think about something you've stopped double-checking because the product has been reliable for a while.
Show answer
Model answer: Many people would name something like trusting a map app's suggested route without a second glance, a habit built by months of the app simply being right.
Before you close the answer
Why this works
Tests whether you understand that this is a change in a reviewer's real behavior, not a style preference, and whether you can name the exact moment trust in words alone stopped being enough.
Follow-up traps
"Isn't this unfair to strong candidates with genuinely early-stage ideas?" Response: no, the rule specifically leaves room for concept-only ideas where no prototype could reasonably exist yet; it targets ideas that could have been built and weren't.

"What if the prototype is rough but the deck is brilliant?" Response: the rough prototype still wins the first three minutes, since it's the only one of the two that can actually be tested; the deck's brilliance gets its turn only after that.
If pressed
Warren's link requirement has one narrow exception, written into the application form itself: a candidate can submit a recorded screen capture of the prototype running instead of a live link, but only if they explicitly say why a live version isn't currently possible.
From U2xAI Academy

From answering questions to owning outcomes.

A live workshop where you ship a working AI agent, defend a launch decision, and walk away with a portfolio recruiters can't wave off, not just more questions to study.

  • A live AI agent you actually shipped
  • A launch decision you can defend under pressure
  • An interview-ready portfolio, not more flashcards
Know more