CaseAdvancedAI Opportunity & Model Strategy / When NOT to use AI / #9
Your legal team blocks an AI feature. When should you accept that and when should you push back?
PICK · Corvidale's own audit showed Black applicants flagged on arrest alone at more than three times the rate of White applicants. The next block cited nothing, and stood for thirteen weeks anyway
Corvidale Screening runs background checks for employers who hire fast and in bulk: retail chains, staffing agencies, home care providers. ScreenPulse is the model that reads every report and scores how much attention it needs. Delwyn Bircher owns it. Corvidale's general counsel, Callixtus Dalziel, blocked two different features inside one year. One block came with a rule attached. The other came with nothing. Delwyn treated them exactly the same way, and only one of those calls was right.
The direct answer
Accept a legal block the moment the lawyer names one real rule, case, or specific scenario, and build around it. Push back when all you get is a feeling, with nothing attached, even after you ask directly. The test is one question: what's the specific rule or risk here? A named answer is real. A vague one, even after you ask twice, isn't, and it shouldn't stand.
Do this, in order
Accept the block the second legal names a real rule, case, or specific risk, and redesign around it.Why: this is the whole decision, restated as the thing you actually do.
Ask, out loud, "what's the specific rule or risk here," before you accept or fight anything.Why: skip this question and you're guessing which kind of no you're facing.
Push back when the objection stays vague even after you ask a second time.Why: Verify Assist sat blocked for thirteen weeks on zero citation, and nobody had actually challenged it.
Log every legal block with its citation, or the plain fact that it doesn't have one.Why: a written record is the only thing that stops the next no from riding on how bruised you feel that week.
Weigh what a wrong call costs in each direction before you decide.Why: asking costs one conversation, guessing wrong costs either lost recruiter hours or real exposure.
Don't let one bad override turn into blanket surrender on every block after it.Why: that overcorrection is exactly what let a vague block stand unquestioned for a full quarter.
How to answer this, stage by stage
Nobody in the room is grading whether you sound respectful toward legal. They're grading whether you can name the one question that tells you which kind of no you're actually holding.
1
Put one real screening decision on the table
Say it like this
"Let's make this concrete. Corvidale Screening runs background checks for employers. ScreenPulse is the model that scores each report so a recruiter knows how much attention it needs. Corvidale's general counsel blocked two different features built on ScreenPulse, about four months apart."
Why this works
Keeps the interviewer grading one real call, not a philosophy of legal versus product.
2
Name the method before you use it
Say it like this
"I'll run this through PICK. Position: where I land, no hedging. Impact: who loses what, in each direction, if I get this wrong. Cost asymmetry: which mistake is cheap and which is expensive. Kill criteria: the one test that tells me which block I'm actually looking at."
Why this works
Two seconds of structure tells the room a method is coming, not a mood.
3
Give the position, no hedging
Say it like this
"My position: accept a block the moment legal names one real rule, case, or specific scenario, and build around it. Push back when the objection stays vague, a feeling with nothing attached, even after you ask directly what the risk is."
Why this works
This is the direct answer, said early enough the story underneath can't blur it.
4
Anchor it to the one thing only a model creates
Say it like this
"This only matters because a model is involved. A plain rule, like 'don't hire under eighteen,' either applies or it doesn't. A model scoring background checks can quietly lean on a pattern, like using an arrest with no conviction as a signal, that treats one group differently without anyone writing that choice down on purpose."
Why this works
Keeps the answer anchored in model behavior, not generic advice about handling a legal objection.
5
Bring the numbers for the block that was real
Say it like this
"Auto-Clear would have let ScreenPulse clear a report with nobody looking, partly using arrest-only flags, an arrest with no conviction attached. We pulled four straight quarters of that pattern before shipping anything. Every quarter landed around a 0.77 impact ratio, under the 0.80 line regulators use to call it adverse impact. Legal named the EEOC's own 2012 guidance on arrest and conviction records, by number. Delwyn thought it sounded like the usual caution and pushed a limited version through for one client anyway. Six weeks later a state audit at that client flagged the exact same pattern. That cost 120 hours of remediation and nearly the client."
Why this works
A real, checkable number the "this block was right" claim would fall apart without.
6
Bring the numbers for the block that wasn't
Say it like this
"Four months later, legal blocked Verify Assist too, a feature that only reformats a report into plain English, no scoring involved. The reason given: 'I'm not comfortable with AI touching hiring records.' Nothing else, then or after. Delwyn accepted it without asking twice. It sat blocked for thirteen weeks. One client's recruiters alone spent about 390 extra hours reading four separate documents by hand instead of one summary."
Why this works
The second number proves the first block being right didn't mean every block was right.
7
Weigh what's lost in both directions
Say it like this
"Accept every vague block, and you lose real, harmless work to nothing but discomfort, that's the 390 hours. Override every specific block, and you ship something actually breaking a real rule, that's the 120 hours and a client that nearly walked. Neither mistake is free. They just get paid in different currencies."
Why this works
Naming both losses stops the answer collapsing into always-trust-legal or always-fight-legal.
8
Hand over the test and close on it
Say it like this
"So here's the test I actually use. Can legal name the specific rule, case, or scenario, and does it hold up once I ask twice? If yes, that's real, and it probably reshapes the feature instead of killing it. If it stays vague, that's the one worth pushing on. Asking costs about fifteen minutes. Guessing wrong costs thirteen weeks one way, or a client's trust the other."
Why this works
Ends on something countable, and hands over a test instead of a feeling.
Let's learn
What does a lawyer's no actually tell you?
Corvidale Screening runs background checks for employers who hire fast and in bulk: retail chains, staffing agencies, home care providers. ScreenPulse reads every report that comes back and gives it a score, so a recruiter knows which ones need a close look and which ones don't. Recruiters using that score clear a clean report in about six minutes instead of twenty-two.
Both blocks stopped a feature cold. Only one of them was actually standing on something.
Delwyn Bircher owns ScreenPulse. In one year, Corvidale's general counsel, Callixtus Dalziel, blocked two different features built on top of it.
The first was Auto-Clear: let ScreenPulse clear a report on its own, no recruiter needed, once the score came in low enough. Part of that score leaned on arrest-only flags, an arrest with no conviction attached. Callixtus blocked it and named his reason: the EEOC's own 2012 guidance on arrest and conviction records, because arrest data tracks who gets stopped, not who did something wrong, and using it that way can treat one group differently without anyone deciding to on purpose. Four straight quarters of Corvidale's own data backed him up.
The second was Verify Assist, months later: a feature that just turns four separate verification documents into one plain paragraph for a recruiter to read. No score, no decision, nothing automated. Callixtus blocked that too. His reason: "I'm not comfortable with AI touching hiring records." No rule, no case, no scenario. Just that.
One block came with a citation. The other came with a feeling. Delwyn treated them exactly the same way.
That's the actual mistake, not which lawyer was right which time. Auto-Clear's block deserved full respect the first time it landed, and it took a client's audit to teach Delwyn that the hard way. Verify Assist's block deserved a direct question, and it took a new hire noticing the gap to get one asked at all.
Knowledge spark: what's an impact ratio?
Compare how often two groups pass a screen. Divide the smaller passing rate by the bigger one. Regulators treat anything under 0.80, the "four-fifths" line, as a real warning sign, worth a hard look at what's causing it. Auto-Clear's own numbers sat at 0.77, every quarter, for four quarters running.
The choice I would take back
Corvidale never had a standing rule that every legal block gets a written reason attached, checked against something specific, before it's treated as final. Whether a block got respected or fought came down to how bruised Delwyn happened to feel that quarter, not to what the block actually said. I'd put that rule in from day one: every block gets one direct follow-up, on the record, before anyone accepts or fights it.
What I would leave alone: Corvidale's legal team also reviews the wording on the candidate consent form every quarter, standard language, no model behind it, nothing about how a score gets made. Delwyn never questions that review. It's routine, it's cheap, and getting it wrong costs almost nothing next to a scoring decision.
The lesson: a block that names a real, specific risk is telling you something true about the model, not being difficult. A block that never gets more specific than a feeling is legal doing what any team does under pressure, reaching for the safest-sounding no. They look identical from the outside. The only way to tell them apart is to ask, every single time, not just on the weeks you've got the energy for the argument.
Now here is the same thing as a story
Use this version when you've got room to let it land. A spreadsheet believes a percentage. A person believes a Tuesday.
Delwyn Bircher has spent four years building screening products at Corvidale, and she can read a flagged background report faster than most of the recruiters ScreenPulse was built for. Give her a report with six line items and she'll tell you which one actually matters before you finish your coffee.
For most of that time, whenever Callixtus blocked something, Delwyn had one habit. She asked him, directly, what rule or case the block was actually standing on. It worked. Twice that first year, the answer changed her mind completely, and both times the feature shipped better for it.
Then came Auto-Clear.
Corvidale had pitched Larkhaven Eldercare, a home care staffing agency that screens something like a hundred and fifty caregivers a week, on a version of ScreenPulse that could clear a clean report with nobody looking at it. Callixtus blocked it before it reached a single client, and this time his answer had a number in it: the EEOC's 2012 guidance on arrest and conviction records, and four quarters of Corvidale's own data behind it. Black applicants were showing up flagged on arrest alone, no conviction, at more than three times the rate of White applicants in the same zip codes.
Delwyn had heard Callixtus reach for "I want to be careful here" twice that same quarter, on features that turned out fine after one conversation. She read this one the same way. She pushed, her VP backed her, and a limited version of Auto-Clear went live for Larkhaven anyway, six weeks ahead of the redesign Callixtus had actually asked for.
It ran clean for six weeks. Then a state labor auditor pulled Larkhaven's hiring file for an unrelated reason, and noticed the same pattern Callixtus had already named: Black applicants cleared out at a lower rate, arrest-only, no conviction, than everyone else. Larkhaven's operations director called Corvidale directly, furious, and gave them ten days to explain it in writing or lose the contract.
The habit that had worked for a year broke on the same day the one block that mattered finally got tested for real.
Three people spent the better part of three weeks on the response: pulling every flagged report, rebuilding Auto-Clear around convictions only, writing the audit letter twice because the first draft undersold how serious it was. A hundred and twenty hours, and Larkhaven stayed, barely.
We didn't lose the client. We lost the version of Delwyn who asked the question before she was scared into it.
After that, Delwyn stopped asking. Any time Callixtus said no, she accepted it, full stop, and moved the feature off the roadmap without another word. It felt like the responsible thing. For a while, nobody noticed the difference, because nothing else got blocked.
Then, four months later, Callixtus blocked Verify Assist: a feature that reformats four separate verification documents, a state registry check, an elder-abuse registry check, an education check, a license check, into one clean paragraph. It doesn't score anything. It doesn't decide anything. It just saves a recruiter from reading four PDFs by hand. His reason, in the block memo: "I'm not comfortable with AI touching hiring records." Delwyn read it, nodded, and moved on.
Thirteen weeks went by. At Larkhaven alone, recruiters kept hand-compiling those four documents themselves, about twelve extra minutes a candidate, a hundred and fifty candidates a week. Nobody was tracking it as a cost. It just looked like the job.
Then a new PM joined Delwyn's team and sat in on a roadmap review. She pointed at Verify Assist, still parked in the blocked column, and asked the only real question in the room: "Did legal ever say why, on this one?"
Delwyn didn't have an answer. She had never asked.
Here's the replay. Same block, same memo. This time Delwyn goes back to Callixtus and asks him directly: what's the specific rule or case behind this. He tells her, honestly, that there isn't one. It's discomfort, the general kind, not the EEOC kind. So they build a lightweight version together, with a one-line disclaimer Callixtus writes himself, and it ships within three weeks. Larkhaven's recruiters get their twelve minutes back on every one of a hundred and fifty reports a week, starting the same month.
Same lawyer, same team, two blocks four months apart. One had a citation, and Delwyn should have trusted it the first time instead of needing an audit to believe it. The other had nothing, and she should have asked twice instead of needing a new hire to notice.
What I'd tell myself, back in the meeting where Auto-Clear's block first landed: the block that has a number in it and the block that doesn't sound exactly the same read out loud. You have to ask which one you're holding. I stopped asking right when it mattered most, and it cost thirteen weeks before anyone caught it.
PICK, and what fifteen minutes buys you
Not permission to fight every no, and not a reason to accept every one either. PICK only earns its place here if it turns a block into a question instead of a coin flip.
One path costs a conversation. The other costs weeks, no matter which direction the guess goes.
PPosition. Where the answer actually lands.
Accept a legal block the moment it names one real rule, case, or specific scenario, and build around it instead of fighting it. Push back when the objection stays a feeling, with nothing attached, even once you've asked directly what the risk is.
This isn't advice to distrust legal. Auto-Clear's block was right, and it stayed right no matter how tired Delwyn was of hearing "I want to be careful here."
State the position before any story, so it doesn't read as invented after the fact to fit what already went wrong.
IImpact. What's lost each way.
Accept every vague block without question, and you lose real, harmless value to nothing but discomfort. Verify Assist cost Larkhaven's recruiters about 390 hours over one quarter for a feature that never touched a single decision.
Override every specific block because it sounds like the usual caution, and you ship something that's actually breaking a real rule. Auto-Clear's limited release cost 120 hours of remediation and nearly the Larkhaven contract.
Naming both losses stops the answer from collapsing into "always defer" or "always fight," neither of which is a real decision.
CCost asymmetry. The heart of it.
Asking legal to name the specific rule, case, or scenario costs one direct conversation, about fifteen minutes, whether the answer turns out to matter or not. Guessing wrong costs real hours no matter which direction you guess. Comply blind with a vague block and the cost shows up as lost value nobody chose to give up. Override a specific block and the cost shows up as real exposure, an audit letter, a client threatening to leave. Start from the cheap move. Only accept or override once you've actually heard the answer.
KKill criteria. The one test.
Can legal name a specific rule, case, or concrete scenario, and does that answer survive you asking a second time. For Auto-Clear, yes: an EEOC guidance number and four quarters of Corvidale's own data behind it. For Verify Assist, no: "I'm not comfortable with this" was the whole answer, both times it got asked. Delwyn's team considered one shortcut instead of asking directly: checking whether a block came from a senior lawyer or a junior one, on the idea that seniority tracked seriousness. It got dropped, because Callixtus, the most senior lawyer at Corvidale, gave both blocks, and only one of them held up.
Four branches, one root question: did anyone actually ask, or did the deadline decide on its own.
Cost, by the numbers: guessing wrong, both directions
Guessed wrong by overridingGuessed wrong by complying
Asking Callixtus to name the specific rule, either time, would have cost about fifteen minutes. Both bars above are what guessing instead of asking actually cost, in two different directions.
The kill line, charted: ScreenPulse's arrest-only impact ratio, four quarters running
Below the 0.80 lineThe quarter the audit caught it
Corvidale tracked this ratio for four quarters before Auto-Clear ever shipped anywhere. It never once cleared 0.80. That's what "names a real, specific risk" actually looks like: not a single bad number, a pattern that holds up every time someone checks it.
The trade worth saying out loud: asking costs a short, visible pause, about fifteen minutes, right when a deadline makes any pause feel like the wrong move. That pause is worth paying every time, because the alternative, guessing which kind of no you're facing, only shows its real cost after the hours are already spent: a client nearly lost on one side, thirteen weeks of quiet waste on the other.
And if you want to be sure it really works, try it somewhere else
Same four letters, a claims adjuster's queue instead of a hiring pipeline, and the AI-specific risk moves from arrest records to a fraud score.
One feature genuinely needed the citation it got. The other needed someone to notice it never got one.
Windward Mutual uses ClaimGuard to score how likely a new insurance claim is to be fraudulent, so adjusters know which files need real scrutiny. Someone proposes Auto-Deny: skip adjuster review entirely and deny any claim ClaimGuard scores above a fraud-risk cutoff. Legal blocks it, and names the reason: the state's Unfair Claims Settlement Practices Act, which requires a documented, individual review before any denial, a real statute with real penalties attached. Position: accept it, and redesign so every denial, however high the score, gets a human sign-off with the score attached as one input, not the whole decision. Impact: skip that redesign, and Windward risks real regulatory penalties and bad-faith lawsuits, the same shape of risk Corvidale faced with arrest-only flags, a model quietly making a call the law says a person has to make. Cost asymmetry: building the sign-off step in from day one costs a few extra seconds per claim for the adjuster. Shipping Auto-Deny blind first and retrofitting the sign-off after a regulator notices costs a full compliance review and a real fine. Kill criteria: does legal name the actual statute, section number included? Here, yes, so the feature gets built, just with a person still holding the pen. Separately, someone proposes Claim Summarizer, condensing a claim's photos, repair estimate, and police report into one paragraph, no scoring, no decision. Legal blocks that one too, on "we're not ready for AI anywhere near claims," no statute, no case. Same test, same answer: push back, ask which specific rule this breaks, and when none arrives, ship the summarizer with a plain disclaimer instead of leaving it parked for a quarter.
Swap the trigger and it still runs.
Speed: an interviewer caps you at ninety seconds. Skip straight to the test: does legal name something specific, or not, before anything else gets said.
Cost: no time for even the fifteen-minute question before a decision is due. Fine, but say the test out loud and make whoever owns the block answer it, instead of letting the deadline decide by default.
The model got better, for real: say ClaimGuard's fraud score later gets independently audited and clears the four-fifths line with real margin. That's the moment a stricter feature like Auto-Deny earns another look, not before it.
Where people run it wrong.
They let a block that sounds serious stand unquestioned, because arguing with a lawyer feels riskier than losing the feature.
They treat "no citation yet" as "no citation ever," and never go back to check once real evidence would exist.
They accept or fight a block based on which lawyer sent it, not on what the block actually says.
How to use it live. If you're ever asked whether a legal block should stand, buy yourself a second with one plain question, said out loud: "did they name the actual rule, or are we just being careful?" That question is the whole method, asked instead of stated.
Three steps, and the whole method lives in whether step two ever actually gets asked.
Flashcards (tap any card to flip it)
1 · THE FRAMEWORK
What framework fits a question about when to accept a decision someone else made, and when to challenge it?
Tap to flip
ANSWER
PICK: state the real position, name what's lost on each side, find which mistake is cheap versus expensive, then give the one test that actually decides it.
2 · THE PEOPLE
Who is this answer about?
Tap to flip
ANSWER
Delwyn Bircher, who owns ScreenPulse, the background-check scoring model at Corvidale Screening, and Callixtus Dalziel, Corvidale's general counsel.
3 · THE POSITION
What's the real rule for accepting a legal block versus pushing back on one?
Tap to flip
ANSWER
Accept it the moment legal names one real rule, case, or specific scenario, and build around it. Push back when the objection stays a feeling, even after you ask directly what the risk is.
4 · THE TWO BLOCKS
What's the actual difference between Auto-Clear's block and Verify Assist's block?
Tap to flip
ANSWER
Auto-Clear's block named the EEOC's 2012 guidance on arrest and conviction records, backed by four quarters of Corvidale's own data. Verify Assist's block named nothing beyond "I'm not comfortable with this," even after being asked twice.
5 · THE REVERSAL
What old decision would Delwyn take back?
Tap to flip
ANSWER
Corvidale never had a standing rule that every legal block gets one direct follow-up, on the record, before it's accepted or fought. Whether a block held depended on how bruised Delwyn felt that quarter, not on what the block said.
6 · THE NUMBER
Fill in the blank: Auto-Clear's arrest-only flags gave an impact ratio around ___, under the ___ line regulators use. Verify Assist stayed blocked for ___ weeks, costing about ___ hours.
Tap to flip
ANSWER
0.77. 0.80. 13 weeks. 390 hours.
7 · THE KILL TEST
What's the one test for whether a legal block should actually stand?
Tap to flip
ANSWER
Can legal name a specific rule, case, or concrete scenario, and does that answer survive being asked a second time. A named answer is real. A vague one, even after asking twice, isn't.
8 · CROSS-PRODUCT TRANSFER
Section 4 answers this same question for a different product. Which one, and what plays the role of Auto-Clear's EEOC citation?
Tap to flip
ANSWER
Windward Mutual's ClaimGuard. The role goes to the state's Unfair Claims Settlement Practices Act, cited by name against the Auto-Deny feature, the same shape of specific, checkable citation as Auto-Clear's EEOC guidance.
Check yourself Score: 0 / 0
Short answer, name the rejected alternative
1. What old decision would Delwyn take back, and why did it make sense at the time she made it?
Show hint
Look at "the choice I would take back" in the Let's learn section.
Show answer
Model answer: Corvidale never required a written, specific reason attached to every legal block before it got accepted or fought. It felt fine when blocks were rare and Delwyn had the energy to argue each one out. It stopped being fine once a block could arrive on a day she was too bruised, or too busy, to ask the direct question.
Multiple choice
2. What actually explains why Verify Assist sat blocked for thirteen weeks?
A. ScreenPulse's model wasn't accurate enough yet.
B. Nobody had checked whether Callixtus's objection named a specific rule or risk.
C. Larkhaven's contract renewal was under review that quarter.
D. Verify Assist needed a security review first.
Show hint
Think about what was missing before the block was accepted, not what happened during the thirteen weeks.
Show answer
B. Nothing was wrong with the feature itself. The gap was upstream: nobody asked Callixtus to name the specific risk, so a feeling got treated the same as a citation.
True or false
3. True or false: because Auto-Clear's block turned out to be right, Delwyn should now accept every future block from Callixtus without asking for specifics.
True
False
Show hint
Ask what Verify Assist's block, from the same lawyer, four months later, actually had behind it.
Show answer
False. One correct block doesn't make the next one correct. Verify Assist, blocked by the same lawyer four months later, had nothing behind it at all. The test is what the block actually says, not who said it or what happened last time.
Fill in the blank
4. The audit found Black applicants flagged on arrest alone in ___ percent of reports, against ___ percent for White applicants, giving an impact ratio of about ___, under the ___ line regulators use to flag adverse impact.
Show hint
Look at the knowledge spark in Let's learn, and the kill-line chart in the framework recap.
Show answer
30 percent. 9 percent. 0.77. 0.80. That gap is what made Callixtus's Auto-Clear block a real, specific risk instead of a feeling.
Short answer, apply it yourself
5. Think of a decision at your own job, or one you've read about, where someone above you said no with no real reason given. What one question would have told you whether that no was worth respecting?
Show hint
Ask what specific, checkable thing would separate a real reason from a feeling.
Show answer
Model answer: A manager once blocked a change to a support script by saying it "felt risky." The one question that would have settled it: what specifically has gone wrong before, or could go wrong, if we ship this? A real past incident or a concrete failure mode is worth respecting. "It feels risky" with nothing behind it isn't.
Multiple choice
6. If Callixtus had given Verify Assist's block a real citation on the first try, what should Delwyn have done differently from what actually happened with Auto-Clear?
A. Nothing. She should have accepted it right away, the same as she eventually did with Auto-Clear once forced to.
B. Push back anyway, since Verify Assist doesn't make any decisions.
C. Escalate to a VP before deciding either way.
D. Ignore it, because Verify Assist is lower stakes than Auto-Clear.
Show hint
Ask whether the kill test cares how big the feature is, or only whether the reason is real.
Show answer
A. A named, checkable reason deserves acceptance regardless of how small the feature feels. Stakes change how much redesign work follows, not whether a real citation gets respected.
Before you close the answer
Why this works
Tests whether you'll actually challenge a no instead of rolling over or digging in on reflex, and whether you know that the challenge itself is cheap. Most candidates say either "I'd always trust legal" or "I'd push until I got my way." Neither survives one follow-up question.
Follow-up traps
"Isn't asking for a citation just going to slow everything down and annoy legal?" Response: it's one direct conversation, about fifteen minutes. That's the same question Delwyn should have asked every time, not a special favor she's requesting.
"What if the risk is real but genuinely new, with no case or rule written yet?" Response: then ask for the concrete scenario instead of a citation, a specific, named way it goes wrong. A well-argued scenario counts as real. A general feeling doesn't, no matter how senior the person holding it.
If pressed
The redesigned Auto-Clear doesn't just drop arrest-only flags. It re-checks its own flag rate by group every quarter, automatically, and raises an internal flag the moment the impact ratio dips under 0.85, five points above the actual 0.80 legal line, so Corvidale catches drift before it ever needs an audit to notice.
From U2xAI Academy
From answering questions to owning outcomes.
A live workshop where you ship a working AI agent, defend a launch decision, and walk away with a portfolio recruiters can't wave off, not just more questions to study.