ConceptFoundationalModel Fluency & the AI PM Role / The AI literacy baseline every PM needs / #6

Describe what an embedding is and one product feature it makes possible.

ORDER · which embedding feature MatchPrint builds first for Esk Valley FC's recruitment and scouting staff

Thrumcap Sports Analytics builds MatchPrint, a platform that turns match footage and tracking data into embeddings, numbers that place similar plays and similar players close together in the same space. Esk Valley FC, a club in the Northshire Championship, wants two things built on top of it: a tool that finds passages of play like the one an upcoming opponent just ran, and a tool that surfaces players who play like a transfer target. Rozenn Wrycliffe, Thrumcap's Head of Product, has one engineering pod for the quarter, and a board meeting on Friday where Esk Valley's head of recruitment, Tobias Sandoway, already knows which one he wants first.

The direct answer
An embedding is a list of numbers a model gives to a thing, built so things that mean something similar land close together in that list, and things that don't land far apart. At Thrumcap, that makes Similar-play search possible: a scout drops in a clip, and gets back every passage in the club's own footage with the same shape, not the same players. Build that feature first, not the comparable-player recommender for transfers, because it runs on data the club already owns, and a wrong answer only costs a scout ten seconds, not a board's trust.
Do this, in order
  1. Build Similar-play search first.Why: it runs on Esk Valley's own complete archive today, and a wrong result costs a scout ten seconds, not a signing.
  2. Hold the comparable-player recommender until the league's coverage clears the bar.Why: it only works once enough clean, representative player data exists to embed in the first place.
  3. Run the nearest-neighbor check before either feature ships.Why: it's the cheap test that told Rozenn 83 percent versus 50 percent, before a single scout touched either tool.
  4. Never wire an unproven embedding feature straight into a fixed workflow like a board dossier.Why: that's the decision that's hardest to undo once a club's trust is spent.
  5. Track league coverage like a real dependency, not a launch checkbox.Why: it's what actually decides when the second feature is safe, not the calendar.
  6. Leave Similar-play search ungated across every client, regardless of league.Why: it depends only on a club's own footage, which is always complete, so there's nothing to wait on there.

How to answer this, stage by stage

Nobody is grading whether you can define a vector. They're grading whether you can name a real feature it unlocks, then defend which one you'd build first and which one waits.

1
Scope it to one product and one real call
Say it like this
"Let's ground this in one real decision. Thrumcap Sports Analytics runs MatchPrint for football clubs. Esk Valley FC wants two embedding features. I've got one engineering pod for the quarter. I have to pick which one goes first."
Why this works
A named product and a real deadline stop the answer from floating in the abstract.
2
Answer the actual question, in one breath, before ranking anything
Say it like this
"An embedding is just a list of numbers a model gives to something, a play, a player, a clip, built so similar things land close together in that list. That's the whole idea. It's what makes search, recommending, and grouping possible, instead of matching on exact words."
Why this works
The interviewer asked what an embedding is. Answer it in plain words before the framework starts, or the rest sounds like it's dodging the question.
3
Say your structure out loud
Say it like this
"I'll run this as ORDER. Outcome, what we're actually protecting. Reversibility, which pick is hardest to undo once it's built. Dependency, what has to already be true. Evidence, what's cheap to check first. Rank, the actual call, defended."
Why this works
Two seconds of structure tells the interviewer you have a method before you have an opinion about two features.
4
Name the outcome, so the ranking isn't a guess
Say it like this
"Both features are competing for the same thing: whether Esk Valley's football staff trust MatchPrint enough to act on what it tells them. Not 'ship more AI.' A scout skipping a bad clip because he trusts the tool, or a board approving a transfer because a comp held up."
Why this works
Naming the outcome first is what stops the ranking from being two features ordered by whoever asked loudest.
5
Give the ranked call, committed
Say it like this
"So here's the call. Build Similar-play search first. Hold the comparable-player recommender until Esk Valley's own league clears a coverage bar we can actually check."
Why this works
This is the direct answer, spoken plainly, before a single number gets in the way.
6
Prove it with the real evidence check, numbers first
Say it like this
"We ran both features' embeddings through the same test: thirty pairs a scout had already judged similar by hand, then checked whether the model's top five matches actually included the real one. Similar-play search hit 83 percent. The comparable-player recommender, tested on leagues like Esk Valley's own, hit 50 percent. A coin flip, headed for a board dossier."
Why this works
A real number from a cheap test beats an argument about which feature "feels" more ready.
7
Name the alternative you rejected, before they ask
Say it like this
"The tempting third option was auto-clustering raw footage into highlight reels first, since it demos well for the board. I rejected it. It doesn't touch a single real decision Esk Valley's staff make, so it never actually tests whether the embeddings are any good."
Why this works
Naming and rejecting the obvious alternative yourself is stronger than waiting for a follow-up to expose it.
8
Close on the one line anyone could check
Say it like this
"So: Similar-play search now, comparable-player search once the coverage bar clears, checked by the same nearest-neighbor test, not by the calendar. You'll know it's working when a bad recommendation costs a scout ten seconds instead of costing the board a signing."
Why this works
Ends on something an interviewer could actually go verify, not just a confident-sounding pick.

Let's learn

What do you actually get when a computer turns a football match into a list of numbers?

MatchPrint is Thrumcap Sports Analytics' platform for professional football clubs. It reads a club's match footage and tracking data, and turns passages of play into embeddings: a list of numbers built so that plays with the same shape land close together in that list, no matter which players ran it or what the score was. It does the same for players across a season, turning a player's passing, carrying, and defending into a second list of numbers, so players who actually play alike sit near each other, even when their headline stats don't match at all.

Knowledge spark: what does "close together" actually mean here? Every play or player gets turned into a long row of numbers, a point in space with far more than two directions. The model is trained so that two things that mean something similar end up as nearby points. A search just finds the nearest points to the one you asked about. Nothing is matched on exact words, only on how close two points sit.
Hand sketched quadrant diagram titled Similar plays land close together. X axis reads how the move builds, from slow buildup to fast counter. Y axis reads how it finishes, from low cross to cutback. Three points, labeled This clip, Denmoor 61 minutes, and Calthorpe 12 minutes, cluster tightly together in the fast counter, cutback corner. Two points, labeled Redmoor 30 minutes and Sarnwick 77 minutes, cluster together in the opposite corner, slow buildup, low cross, far from the first group.
Different matches, different minutes, different scorelines. The plays that share a shape still land in the same corner.

Before MatchPrint, Tobias Sandoway, Esk Valley FC's head of recruitment, ranked forty scouting reports by hand every week, from memory and from tape he'd watched three or four times each. He was good at it. He could watch four minutes of a winger's footage and tell you, before the ad break, whether the end product would hold up two divisions higher.

Hand sketched labeled parts diagram titled Tobias, before MatchPrint. A center figure labeled Tobias Sandoway with four labels radiating outward: Forty reports, ranked by hand. Margin notes from tape. Trusts a name he's checked twice. One winger, watched four times.
None of this was slow because Tobias was bad at it. It was slow because every judgment lived in his own head.

Now he has MatchPrint, and he wants two things built on it before the transfer window closes: Similar-play search, where an analyst drops in a clip of an upcoming opponent and gets back Esk Valley's own matches with the same shape of attack, and a comparable-player recommender, which would sit inside the club's own dossier template and auto-suggest transfer targets who play like a name the committee already likes.

Here's the turn. Both features run on the same kind of embedding. Only one of them is actually ready.

Similar-play search draws only on Esk Valley's own match archive: every game the club has played is filmed by the same broadcast feed, tagged the same way, complete from day one. The comparable-player recommender needs something bigger: enough clean, representative player data across every league MatchPrint touches, so a player's numbers actually mean the same thing wherever he plays. Right now, only 5 of Thrumcap's 14 leagues clear that bar. Esk Valley's own league, the Northshire Championship, isn't one of them yet. A data-provider swap left six weeks of matches half tagged partway through last season.

Leagues with clean, full-season data, by quarter
70% 35% 0% today Northshire projected to clear it here Q1 Q4 Q6 Q7
Percent of 14 leagues with clean, full-season data
Esk Valley's own league sits below the bar today. The climb is real, it just hasn't reached Northshire yet.

What it costs at its worst: ship the recommender now, and it starts surfacing "comparable" transfer targets straight into a boardroom dossier, built on the thinnest data MatchPrint has. Get one of those wrong in front of the committee, and Esk Valley doesn't just stop trusting the recommender. They stop trusting Similar-play search too, the one tool that was actually right.

The comparable-player recommender isn't broken. It just hasn't earned the right to be trusted yet.
The choice I would take back Eighteen months ago, when MatchPrint only served two leagues, both data-rich, Thrumcap told every new club that comparable-player search worked the same everywhere, out of the box. That was true then. It stopped being true the day the platform grew to fourteen leagues of very different data quality, and nobody built a visible flag showing which ones still qualified.

What I would leave alone: Similar-play search doesn't need any of this. It runs on a club's own footage, which is always complete the day a club signs up, so there's no coverage bar to clear before it ships to anyone.

The lesson: a feature isn't safe just because the model runs without erroring. It's only safe where the data behind it is actually good enough to trust, and that's a different map for every embedding feature you build, not one map for the whole platform.

Now here is the same thing as a story

The short version above is what you actually say in the room. Read this one for the two years it took a promise made to two leagues to catch up with a Tuesday in Northshire.

Tobias Sandoway can watch four minutes of raw tape and tell you, before the first commercial break, whether a winger's end product will hold up two divisions higher. He's run recruitment at Esk Valley FC for six years, on a laptop with a cracked hinge and a spreadsheet nobody else can read. Every Sunday night he ranks forty scouting reports by hand, in the order he trusts them, not the order they arrived.

MatchPrint arrived in the spring. For the first few months it did the small, boring thing well: an analyst could paste in a clip from an upcoming opponent and get back every match in Esk Valley's own archive with the same shape of attack, the same run down the same channel, finished the same way. Nobody's job changed. It just meant an assistant coach spent Tuesday morning watching three relevant clips instead of trawling six matches for one.

Then, at a demo in June, Rozenn Wrycliffe showed Tobias something bigger: a version of the same idea, but for players instead of plays. Type in a transfer target's name, and it would surface players from anywhere in the world who actually played like him, not just players who matched on the usual filters like age and goals per ninety.

Tobias didn't sleep well that week. Esk Valley's board meets every Friday to review transfer targets, and he'd been arguing for a winger from three leagues over that nobody else in the room had heard of. A tool that could say, in one screen, "here are four players who move like him," would have made that argument for him.

So on the Tuesday before Friday's meeting, he asked Rozenn to ship it. Not the play-search tool, that was already live and useful. He meant the player one, wired straight into the dossier template the board actually reads.

Hand sketched flow diagram titled The Tuesday the ask came early. Four steps left to right: Board meets Friday. Tobias sees the demo Monday. He asks to ship it Tuesday, emphasized in a highlighted box. The coverage check isn't done.
Three days between the demo and the meeting. Nowhere near enough time for the real question to get asked.

Rozenn said no, and had to explain why on a call with four minutes left before her next meeting.

Here's what she told him. MatchPrint's player embeddings are only as good as the event data underneath them, every pass, every carry, every defensive action, tagged consistently enough that a player's numbers mean the same thing in Northshire as they do anywhere else. Right now, that's true in five of Thrumcap's fourteen leagues. Esk Valley's own league isn't one of them. A data provider swapped systems mid-season and left six weeks of matches half tagged.

Rozenn's team had already run the cheap check, the one that should always come before a feature like this ships. Take thirty pairs of players a scout had already judged genuinely comparable by hand, drawn from leagues that vary in coverage, and see how often the model's own top five matches actually included the real one.

In the two founding leagues with full coverage, it hit 24 of 30, eighty percent. In leagues like Northshire, it hit 15 of 30. Half. A coin flip, and Tobias wanted to put a coin flip in front of his board on Friday.

We didn't just risk one bad transfer that week. We risked the one tool Tobias already trusted, the one that was actually right.

Tobias didn't take it well, not at first. He'd seen the demo. It worked in the room. What he hadn't seen was that the demo ran on Thrumcap's own two founding leagues, the two with a full year of clean data behind them, not on Northshire.

Here's the decision I'd take back, and it isn't Tobias asking for the feature early. Given what he'd seen, that was a completely reasonable ask. It's a decision from eighteen months earlier, when MatchPrint only served those first two leagues. Thrumcap's own onboarding deck told every new club that comparable-player search worked the same everywhere, out of the box, because at the time it did. Nobody built a visible flag for what happens once the platform outgrows that promise.

Run Friday's meeting again, with that flag already built. Tobias still asks Rozenn for the player tool on Tuesday. This time, MatchPrint tells him plainly: Northshire isn't covered yet, here's the honest date it will be, about two quarters out, once coverage crosses the bar the same nearest-neighbor test checks. Friday's board meeting runs on Similar-play search and Tobias's own judgment, the same as it always has. Nothing breaks. Nothing goes into a dossier that hasn't earned its place there yet.

The two designs, side by side: one hands every club the same feature list on day one and hopes the data catches up quietly. The other tells a club exactly what's ready and what isn't, and lets that honesty do the selling instead of the demo.

What I'd tell myself, watching that first onboarding deck get written: a promise that's true for two leagues doesn't stay true once you're proud enough to sell it to twelve more. Someone should have asked, the day league three signed up, whether the promise still held. Nobody did, until a Tuesday two years later made it impossible not to.

ORDER, for picking which embedding feature earns the first quarter

PICK would fit if this were only two options with an even trade. But Esk Valley wants both, eventually, and the real question is which one goes first without breaking the other. That's ORDER's job.

OOutcome. What the pick actually has to protect.
Both features are competing to do the same thing: get Esk Valley's football staff to actually act, in a real Friday meeting, on what MatchPrint tells them. Not "ship more AI." A scout skipping a bad clip because he trusts the tool, or a board approving a transfer because a comp held up under a follow-up question.
Name the outcome before ranking either feature. Skip this and the ranking is just whichever feature demoed better.
Hand sketched flow diagram titled What has to be true before what ships. Four steps left to right: Esk Valley's own archive, complete. Similar-play search ships now. Leagues cross the coverage bar, emphasized in a highlighted box. Comparable-player search earns its shot.
The third box is the one Thrumcap is still waiting on, eighteen months after the second box became true for the first two leagues.
RReversibility. Which pick is hardest to undo.
If Similar-play search gets one clip wrong, the analyst just skips it. Nothing downstream noticed it happened. The comparable-player recommender is different. Wire it into the board's own dossier template, and a bad comp isn't just a bad suggestion, it's a name the committee has already discussed, maybe already made an offer around. Untangling that costs more than an apology.
This is the step that makes the order non-negotiable, not just a preference. One mistake resets in a scout's browser tab. The other one doesn't reset at all.
Hand sketched comparison diagram titled One door swings, one is bolted. Left panel, a gauge icon, labeled Similar-play search, caption a scout skips a bad clip, nothing else changes. Right panel, a scale icon, labeled Comparable-player search, caption wired straight into the board's dossier template.
One of these you fix by ignoring a bad result. The other one is already sitting in a meeting minute by the time anyone notices.
DDependency. What has to already be true.
A comparable-player embedding is only as good as the event data underneath it, every pass and carry tagged consistently enough that a player's numbers mean the same thing in every league. Five of Thrumcap's fourteen leagues clear that bar today. Esk Valley's own league doesn't, not yet. Similar-play search has no such dependency, it runs on a club's own footage, which is complete from the day they sign up, because it's theirs alone.
This is why the order isn't a guess about which feature is "more important." One candidate's dependency is already satisfied. The other one's isn't, no matter how much anyone wants it to be.
EEvidence. What's cheap to check first.
Before committing a whole quarter to either build, Rozenn's team ran the cheap version: thirty play or player pairs a working scout had already judged similar by hand, run through the model, checked against its own top five matches. Similar-play search hit 83 percent. The comparable-player recommender hit 80 percent where the data was clean, and 50 percent where it wasn't, Esk Valley's own league included.
Cheap, and it's the number that actually settled the argument, not whoever pushed hardest for Friday.
Top-5 nearest-neighbor precision, the offline check run before committing the quarter
100% 50% 0% 83% (25 of 30) Similar-play search 80% (24 of 30) Comparable-player, data-rich leagues 50% (15 of 30) Comparable-player, Esk Valley's own league
Same test, same method, three different scores. The only thing that changes between the bars is how much clean data sat underneath the embedding.
RRank. The actual call, defended.
Build Similar-play search first, ship it to every club regardless of league. Hold the comparable-player recommender until a club's own league clears the same nearest-neighbor bar, roughly 75 percent, the point where a wrong answer stops being the common outcome. For Esk Valley, that's about two quarters out, once Northshire's backlog of half-tagged matches gets recovered.
If this rank would be identical with a different outcome in the O step, say "ship the flashiest feature no matter what," it was picked by demo, not judgment. Change the outcome to "grow fastest, trust be damned," and the rank still holds, because a wrong comp costs more trust than a late feature costs speed. That's how you know the rank is real.

Three things worth stating directly, since the real judgment sits here. The alternative worth naming and rejecting is auto-clustering raw footage into highlight reels first, since it demos well and needs less new infrastructure. It loses because it never touches a real decision Esk Valley's staff make, so shipping it would prove nothing about whether MatchPrint's embeddings are actually any good. The AI-specific failure worth naming is silent coverage drift: a model that runs, without erroring, in every league, even the ones where the underlying event data is too thin to trust, because nothing in the pipeline stops it from returning an answer. The guardrail is the same nearest-neighbor check, run per league, with results gated below the bar instead of a confidence label nobody reads under deadline pressure. And the trade-off is accepted on purpose: holding the recommender back costs Thrumcap a flashier board pitch this quarter, and costs Tobias a tool he wanted by Friday. That's slower, on purpose, in exchange for never putting a coin flip in front of a transfer committee.

And if you want to be sure it really works, try it somewhere else

Same five letters, a hospital corridor instead of a boardroom, and this time the thing nobody separated is a healthy stray marking from a real tumor.

Bracken Hollow Veterinary Diagnostics runs ScanMatch, which turns a dog or cat's ultrasound or x-ray into the same kind of embedding: an image with a similar shape and shadow pattern lands close to other images like it, so a vet reviewing a hard case can pull up the hospital's own past scans that looked the same and see what they turned out to be. Bracken Hollow's lead radiologist, Ingrun Ondiek, wants a second feature built on the same embeddings: an automatic second-opinion flag, cross-referencing rare breed-condition pairs the hospital's own case history barely covers.

Hand sketched decision tree diagram titled Same method, a scan instead of a match clip. Root box reads New scan comes in. Two branches: breed and condition well covered, leading to ScanMatch shows comparable cases, and thin history for this breed, leading to ScanMatch stays quiet, flags it.
Different hospital, different image, the same missing coverage check.

Same chart, mapped onto Bracken Hollow. Outcome: protect a vet's ability to trust a comparison enough to act on it in a real appointment, not just "add AI to radiology." Reversibility: the same-hospital comparison tool is reversible, a vet just ignores a bad match and moves on; the automatic second-opinion flag, once it starts appearing on official scan reports, is not, a wrong flag on a client's record is hard to quietly take back. Dependency: the comparison tool depends only on the hospital's own scan archive, complete and consistent since Bracken Hollow only reads its own machine's output; the second-opinion flag depends on enough labeled cases of a specific breed-condition pair existing anywhere in the hospital's history, and for most rare pairs, that number is close to zero. Evidence: the same nearest-neighbor check, run on a sample of scans a senior radiologist already diagnosed, splits cleanly, common conditions score well past 80 percent, rare breed-condition pairs barely clear a third. Rank: build the comparison tool first, ship the second-opinion flag only for condition pairs with enough labeled history to clear the bar, and say plainly, on the report itself, when a pair doesn't have enough history yet instead of guessing quietly.

Swap the trigger and it still runs.
Speed: an interviewer caps you at ninety seconds. Skip straight to it: ship the feature whose data you already fully own, hold the one that depends on data you don't have enough of yet, because a shared dependency doesn't care how excited anyone is to ship.
Cost: no budget to properly clean the thin-coverage leagues this quarter. Ship a visible coverage flag instead of the feature itself, so nobody mistakes "not ready" for "broken."
The model got better, for real: say MatchPrint's next embedding model is measurably stronger across the board. Keep the same coverage gate anyway. A better model can still be trained on the same thin data underneath one league, and better was never the same claim as ready.

Where people run it wrong.
They ship the feature that demos best, not the one whose dependency is actually satisfied.
They add a confidence label and call the coverage problem solved, when nobody under deadline pressure reads a label.
They test the nearest-neighbor check once, at launch, and never rerun it as new leagues or new case types get added.

How to use it live. Before ranking anything, ask out loud: "which of these features runs on data we already fully own, and which one needs data we're still collecting?" Whichever answer comes first is usually the order an interviewer is actually listening for.

Flashcards (tap any card to flip it)

1 · THE FRAMEWORK
Which framework fits deciding which embedding feature MatchPrint should build first?
Tap to flip
ANSWER
ORDER: outcome, reversibility, dependency, evidence, rank. Built for ranking a fixed set of candidates by what's hardest to undo and what's actually ready, which is exactly what a "which feature first" question needs.
2 · THE CAST
Who holds each role in this story, and where do they work?
Tap to flip
ANSWER
Rozenn Wrycliffe is Head of Product at Thrumcap Sports Analytics, which builds MatchPrint. Tobias Sandoway is head of recruitment at Esk Valley FC, the client club, in the Northshire Championship.
3 · THE OUTCOME
What does the pick actually have to protect?
Tap to flip
ANSWER
Whether Esk Valley's football staff trust MatchPrint enough to act on it in a real meeting, not just whether the platform "has AI." A scout skipping a bad clip, or a board approving a transfer because a comp held up.
4 · THE DEPENDENCY
What has to already be true before the comparable-player recommender is safe to ship?
Tap to flip
ANSWER
Enough clean, representative player-event data in that club's own league, tagged consistently, so the embedding means the same thing everywhere. Only 5 of Thrumcap's 14 leagues clear that bar, and Esk Valley's isn't one of them yet.
5 · THE OLD DECISION
What decision would you take back, and why did it make sense at the time?
Tap to flip
ANSWER
Telling every new club that comparable-player search worked the same everywhere, out of the box. True when MatchPrint only served two leagues; wrong once it grew to fourteen leagues of very different data quality, with no visible flag showing which ones still qualified.
6 · THE NUMBER
Fill in the blank: the nearest-neighbor check found the real match in the top five results ___ percent of the time for Similar-play search, and ___ percent of the time for the comparable-player recommender on Esk Valley's own league.
Tap to flip
ANSWER
83 percent (25 of 30). 50 percent (15 of 30), a coin flip.
7 · THE RANK
State the final rank, defended in one line.
Tap to flip
ANSWER
Similar-play search ships to every club now. The comparable-player recommender waits, per league, until that same nearest-neighbor test clears roughly 75 percent, because a wrong comp costs a board's trust and a wrong play match only costs a scout ten seconds.
8 · CROSS-PRODUCT TRANSFER
Section 4 runs ORDER again on a different product. Which one, and what plays the role of the risky, not-yet-ready feature there?
Tap to flip
ANSWER
ScanMatch, Bracken Hollow Veterinary Diagnostics' scan-comparison tool. The automatic second-opinion flag for rare breed-condition pairs plays the risky role, since most rare pairs don't have enough labeled history yet.

Check yourself Score: 0 / 0

Multiple choice
1. Why can't Similar-play search and the comparable-player recommender both ship on day one, at full trust, everywhere?
  • A. Thrumcap's engineering team is too small to build two features in one quarter.
  • B. Only one of them has a dependency, enough clean and representative data, that's already satisfied everywhere it would ship.
  • C. Esk Valley's board policy only allows one new feature request at a time.
  • D. Comparable-player search is technically impossible to build with current models.
Show hint
Check the Dependency (D) step in the ORDER recap.
Show answer
B. Similar-play search only depends on data the club already fully owns. The comparable-player recommender depends on clean data across many leagues, and most of them aren't there yet.
True or false
2. True or false: Tobias made an unreasonable ask by wanting the comparable-player recommender shipped early, right after seeing the demo.
  • True
  • False
Show hint
Check the story's paragraph about what the demo actually showed him.
Show answer
False. He reacted reasonably to what he'd actually seen. The demo ran on the two founding leagues with full coverage, not his own, and nothing told him that at the time.
Fill in the blank
3. The nearest-neighbor check found the real match in the top five ___ percent of the time for leagues with full coverage, and ___ percent of the time for leagues like Esk Valley's own, a straight coin flip.
Show hint
Check the Evidence (E) step and the bar chart underneath it.
Show answer
80 percent (24 of 30) and 50 percent (15 of 30). Same test, same method, run on two different slices of coverage.
Short answer, name the rejected alternative
4. Besides the two features already discussed, what alternative did this answer reject, and why does it lose?
Show hint
Look at the "three things worth stating directly" paragraph near the end of the ORDER recap.
Show answer
Model answer: Auto-clustering raw footage into highlight reels first. It loses because it never touches a real decision Esk Valley's staff make, so shipping it would prove nothing about whether the embeddings are actually any good.
Short answer, apply it yourself
5. Think of an AI product you use or have built where two features could both be built on the same underlying embedding. Which one should go first, and what does it depend on that the other doesn't?
Show hint
Look for the feature that runs on data you already fully own, versus one that needs data still being collected.
Show answer
Model answer: A music app's "songs like this" search versus an auto-generated "artists you'll love next" recommender wired into a subscription upsell. The search tool is reversible and depends only on the catalog's own audio features. The upsell recommender depends on enough listening history per user, thin for new accounts, so it should ship second, gated by account age.
Short answer, work the number
6. If Esk Valley's league had scored 65 percent on the nearest-neighbor check instead of 50, would the same decision to hold the comparable-player recommender still make sense? Why or why not?
Show hint
Compare 65 percent against the roughly 75 percent bar the Rank step sets, and separate the mechanism from the exact number.
Show answer
Model answer: yes, most likely. 65 percent is closer to the roughly-75-percent bar, but still below it, so the recommender would still miss more often than a boardroom decision can absorb. The mechanism, thin data means less reliable comps, doesn't change just because the number moved closer to the line. Only the timeline to closing the gap does.
Before you close the answer
Why this works
Tests whether you actually know what an embedding is, not just the word, and whether you can tell a safe use of one from a risky one before an engineer builds either. Most candidates can name a feature. Naming which one is safe to ship first, and why, is the part that shows real judgment.
Follow-up traps
"Why not just ship the recommender everywhere with a confidence label on the low-coverage ones?" Response: a label on a board dossier gets ignored the same way it would in Esk Valley's Friday meeting, under deadline pressure. The safer gate is not shipping to a league until its own check clears the bar, not hoping someone reads a footnote.

"Isn't 50 percent from just thirty pairs too small a sample to be sure?" Response: thirty labeled pairs isn't tiny for a pre-commitment check like this. The honest fix is to keep growing the sample as coverage grows, not to ship on a coin-flip number because it might improve later.
If pressed
The distance between two embeddings is measured with cosine similarity, and the real reason the same model scores so differently across leagues is that different data providers define events differently, what counts as a "progressive carry" in one league's feed isn't tagged the same way in another's. That's a data definition problem, not a training bug.
From U2xAI Academy

From answering questions to owning outcomes.

A live workshop where you ship a working AI agent, defend a launch decision, and walk away with a portfolio recruiters can't wave off, not just more questions to study.

  • A live AI agent you actually shipped
  • A launch decision you can defend under pressure
  • An interview-ready portfolio, not more flashcards
Know more