ConceptAdvancedDesigning for Uncertainty & Trust / Designing for failure and graceful degradation / #9

Explain the concept of a blast radius for an AI feature and how design limits it.

FLIPS scope: trusting an agent everywhere, then trusting it only inside a slice you drew on purpose

Corebridge is an AI coding agent with access to a company's repos and, for small fixes, its production infrastructure directly. Bram Achterberg is a senior platform engineer who has used it daily for eight months. The concept underneath his story is blast radius: how far a single mistake can reach, not how likely the mistake is.

The direct answer
Blast radius is how much of your system a single wrong action can touch, not how often it happens. Limit it by giving every agent task its own narrow, short-lived credential scoped to exactly the service it's working on, so a wrong diagnosis can only break the one thing it was actually looking at, never something three services away.
Do this, in order
  1. Issue a fresh, narrow credential per task, not one standing broad credential.Why: a shared credential means every mistake inherits the reach of the widest thing it was ever allowed to touch.
  2. Expire that credential fast, in minutes, not for the life of the deployment.Why: a credential that outlives the task keeps a closed incident's blast radius open.
  3. Make the boundary a hard wall, not a suggestion the agent can reason around.Why: an agent convinced its own logic justifies reaching further will reach further, unless it physically can't.
  4. Log exactly what each credential touched, service by service.Why: without this, you find out your blast radius was too big from the outage, not from a dashboard.
  5. Re-check total scope on a schedule, not just at launch.Why: access grows in small, reasonable steps that nobody re-adds up until something breaks.
  6. Leave low-stakes, single-file dev-branch tasks with today's broader access.Why: this fix is about production and shared infrastructure, not about every single thing the agent touches.

How to answer this, stage by stage

Nobody is grading whether you can define blast radius in one sentence. They're grading whether you can point at the exact decision that made one bigger than it needed to be.

Stage 1
Define it in one plain sentence, then scope it
Say it like this
"Blast radius is how far a mistake can spread, not how likely the mistake is. I'll ground it in Corebridge, a coding agent with production access, and one engineer named Bram."
Why this works
Answers the definition part of the question immediately, before the story does any more work.
Stage 2
Say your structure out loud
Say it like this
"I'll use FLIPS. Find the person, locate the habit, identify the flip, pinpoint the old decision, show the replay."
Why this works
Shows you have a repeatable way to reason about a concept, not just a definition memorized from a blog post.
Stage 3
Name the habit that quietly let scope grow
Say it like this
"Corebridge started on one small, low-traffic service. Every time its access grew, it seemed small enough on its own that nobody re-checked the total."
Why this works
Locates the exact habit, not re-questioning cumulative scope, that let the blast radius grow unnoticed.
Stage 4
Give the one decision that limits it
Say it like this
"Give every agent task its own narrow, short-lived credential scoped to one service, expiring in minutes, and make that boundary a hard wall the agent can't reason its way past."
Why this works
This is the direct answer, said as a concrete engineering decision instead of a definition.
Stage 5
Name the trade-off out loud
Say it like this
"Provisioning a fresh scoped credential per task adds a few seconds of setup and a credential-broker service to build. That's a small, worthwhile tax against never again losing three services to one misdiagnosis."
Why this works
Shows the fix isn't free, and that you'd pay the cost anyway.
Stage 6
Close on the one line
Say it like this
"Blast radius design doesn't try to stop the agent from ever being wrong. It tries to make sure being wrong only ever costs you the size of the room the agent was actually standing in."
Why this works
Restates the direct answer in one breath, and separates the concept from "make the model more accurate."

Let's learn

Here is what happens when a tool works fine for months, gets a little more trusted every one of those months, and then, for one Tuesday morning, does not.

Before Corebridge, engineers on Bram's team fixed small production issues by hand: check the alert, open a narrow terminal session scoped to exactly the one service in question, make the fix, close the session. Slow, maybe twenty minutes end to end, but nobody's fix ever reached past the service they opened.

Hand sketched icon list titled The five letters. Five rows with icons: F find the person Bram a senior engineer, L locate the habit checking each grant, I identify the flip scope grows unchecked, P pinpoint the old decision one shared key, S show the replay the wall holds this time.
The whole method, in five rows. The third one is the hard one, and the one this whole answer turns on.

Now Corebridge reads an alert, diagnoses the likely cause, and can run the fix itself, no terminal session, no waiting for a human, often in under a minute.

Number of services Corebridge could write to, month over month
15 7 0 Month 1, 1 service Month 8, 14 services
No single month looks alarming next to the one before it. The whole climb only looks reckless from month eight looking back.

Here's the turn: the extra speed was never the problem. The problem is that Corebridge's access had quietly grown from one low-traffic service to fourteen, and its blast radius, how far a single wrong call could reach, grew right along with it, unnoticed, because each individual grant looked small and reasonable on its own.

At its worst, an agent gets one diagnosis wrong on a Tuesday morning and the damage lands not on the service it was actually looking at, but on two completely unrelated ones sharing the same database credential.

Hand sketched two-panel comparison titled Small move, big snap. Left panel, a blue gauge icon labeled Before, caption scope widens a bit each month. Right panel, a red box icon labeled The snap, caption one credential no limit at all.
Eight months of small, reasonable widenings. One shared credential that never had an edge.
The decision I would take back The team gave Corebridge one shared production database credential with broad write access across services, since provisioning a separate scoped credential for every small fix felt like unneeded process back when the agent only touched one low-traffic service. It stopped making sense the day that same credential let a migration reach two services that had nothing to do with the actual alert.

What I would leave alone: low-stakes fixes on an isolated dev branch don't need this treatment. A mistake there can't reach production at all, so a narrow, short-lived credential buys nothing.

The lesson: a blast radius isn't something you notice growing. It's something you only measure honestly after it's already gone off.

Now here is the same thing as a story

The short version above is what you'd say defending this redesign to Corebridge's platform council. Read this one for the actual Tuesday.

Bram Achterberg has spent seven years catching race conditions before they ever reach code review, the kind of engineer other people's PRs get routed to when something feels subtly wrong. Corebridge, when it launched, only ever touched a single low-traffic internal reporting service, and Bram reviewed every one of its pull requests in full, out of habit as much as caution.

Knowledge spark: what is a blast radius, technically? In infrastructure terms, blast radius means the set of systems a single failure, action, or bad credential can actually reach. A feature can have a low error rate and still have a huge blast radius, and a feature that's wrong more often but boxed into one small system is often the safer of the two, since being wrong there simply costs less.

Over eight months, as Corebridge proved reliable on small fixes, its access grew: a second service, then write access to shared configuration, then permission to run database migrations directly against production. Each grant, on its own, looked like a small, sensible convenience. Nobody ever sat down and added the whole thing up.

Hand sketched two-panel metaphor scene titled Switch, not dial. Left, a blue gauge icon labeled Assumed, caption a dial, scope tunable anytime. Right, a red box icon labeled Actual, caption a switch, all access or none.
The team assumed Corebridge's reach could be turned down gradually if needed. It was never actually built with a dial at all.

On a Tuesday morning, an alert fired: query latency climbing on the internal reporting service, the same small one Corebridge started on. It read the logs, decided the cause was a stale index, and ran a migration to rebuild it.

Hand sketched flow diagram titled The morning the index dropped. Five boxes: Alert fires, Agent reads the logs, Agent misreads the cause highlighted, Runs a migration, Shared index gone.
The third box is the actual mistake. Everything after it was just the credential doing exactly what it was allowed to do.
The agent's diagnosis was wrong. Its credential made sure the cost of being wrong wasn't small.

The index it rebuilt wasn't only used by the reporting service. It was shared by two other, unrelated checkout-adjacent services that had been quietly pointed at the same database years earlier. Rebuilding it locked the table for forty minutes. Checkout went down along with the reporting dashboard nobody was even looking at that morning.

Hand sketched timeline titled How Corebridge's reach grew, quietly. Five milestones: Corebridge launches one small service, Access grows nobody re-checks it, The incident 40 minutes 3 services down highlighted, Task credentials ship scoped per request, Replay contained to 1 service.
Eight months of quiet growth, forty minutes of damage, and a redesign that fits on one credential.

With the redesign, Corebridge now requests a fresh credential for every task, scoped to exactly the service the alert named, expiring in ten minutes, with no path to touch anything outside that boundary even if its own reasoning insists a fix elsewhere would help. Run the same Tuesday forward: the agent still misdiagnoses the cause, still tries to rebuild the index, and the credential simply can't reach the two other services. The reporting dashboard hiccups. Checkout never notices.

Hand sketched labeled parts diagram titled What a bounded task credential contains. A document icon at the center labeled Task Credential, with four callouts around it: one service only, expires in 10 minutes, read or write not both, every action logged.
None of these four existed on the old shared credential. All four came out of one dropped index.

The old design asked the team to trust that scope, once granted, stayed reasonable forever. The new one never lets scope outlive the task that needed it.

I approved each access grant because each one, alone, looked like an obviously safe convenience. It took one shared index to see that eight small yeses had quietly built one very large blast radius nobody had actually signed off on.

The five steps, if you want to remember it

F
Find the person. Whose morning is this?
Bram Achterberg, a senior platform engineer who used to review every one of Corebridge's actions in full.
Grounds an abstract infrastructure concept in one specific person's actual Tuesday.
L
Locate the habit. What did the team stop doing?
Re-adding up Corebridge's total access every time a new grant was approved, since each single grant looked small enough on its own.
Names the exact thing that let scope creep in without anyone deciding it on purpose.
I
Identify the flip. A scope flip.
Trusting the agent broadly across everything it had ever been granted, versus trusting it only inside a slice narrow enough to reason about, flipped the moment one wrong diagnosis reached three services instead of one.
This is the hardest step and the concept itself: blast radius is exactly the size of that slice.
P
Pinpoint the old decision.
One shared production credential with broad write access, reasonable when Corebridge only touched one low-traffic service, never revisited as that access grew.
Finds the specific, reasonable-at-the-time choice that quietly stopped being safe.
S
Show the replay.
With a task-scoped, ten-minute credential, the same wrong diagnosis stays contained to the one service it was actually looking at.
Ends on something countable: zero customer-facing downtime instead of forty minutes across three services.

The recap, one line per letter: find the person is Bram and his habit of reviewing everything, locate the habit is re-adding up total access, identify the flip is scope trusted broadly versus scope trusted in a narrow slice, pinpoint the old decision is one shared credential nobody revisited, and show the replay is the same mistake contained to one service instead of three.

And if you want to be sure it really works, try it somewhere elseA different flip family, a pharmacy order-entry assistant instead of a coding agent. The blast radius here is measured in prescriptions, not services.

PharmaLoop is an AI assistant that helps pharmacists process refill requests and flag drug interactions. Petros Amundsen is a pharmacist who uses it during every shift. This story runs on a different family, the delegation flip, not scope: as PharmaLoop proved reliable on routine refills, pharmacists began letting it auto-approve more categories of request without a second look, handing off judgment calls that used to always get a human's eyes first.

The old decision behind it: PharmaLoop's rollout let any refill request the model scored above a fixed confidence number auto-approve, across every drug category, on the theory that a single confidence threshold was simpler to reason about than category-specific rules. The risk that decision created: a request for an interaction override, approving a drug combination the system would normally flag, scored above the threshold on a rare, unusual case, and auto-approved with no pharmacist glance at all, since the interface never distinguished a routine refill's blast radius from a life-threatening interaction's.

Hand sketched quadrant titled Which pharmacy agent tasks need a hard boundary. Axes: how routine rare to routine, damage if wrong small to large. Refill reminder and label reprint sit routine and low damage. Dosage flag sits in the middle. Interaction override sits rare and high damage.
Only the top-left corner, rare and high-damage, ever needs a hard human boundary. Everywhere else, the confidence threshold is fine as it is.
Interaction-override requests requiring a pharmacist's manual sign-off, by category, after the redesign
100% 50 0 Refill, 3% Dosage flag, 40% Override, 100%
The redesign didn't lower the model's confidence anywhere. It just refused to let confidence alone decide the one category where being wrong costs the most.

Swap the trigger and it still runs.
Speed: an interviewer caps you at sixty seconds. Say "scope every agent credential to one task, expire it fast, and make the boundary a hard wall," and stop.
Cost: there's no time to rebuild the credential system this quarter. Say so honestly, and start by scoping down whichever service shares infrastructure with the most other services first.
The model gets better, for real: if Corebridge's diagnoses genuinely get more accurate, that's still not a reason to widen the credential back out, a rarer mistake inside a wide blast radius still costs the same when it happens.

Where people run it wrong.
They measure how often the agent is wrong and stop there, without ever asking how far a wrong action could actually reach.
They grant access in small increments and never re-add the total, so the blast radius grows one reasonable-looking step at a time.
They assume a boundary the agent could reason its way around counts as a real limit, when only a boundary it physically can't cross actually does.

How to use it live. When someone asks you to explain blast radius, don't reach for percentages. Ask: if this feature is wrong right now, what is the largest thing nearby it could still touch? Design to shrink that answer, not the odds of being wrong in the first place.

Flashcards (tap any card to flip it)

1 · THE FLIP FAMILY
What flip family is this?
Tap to flip
ANSWER
Scope: trusting an agent across everything it's ever been granted, then trusting it only inside a slice narrow enough to hold in your head.
2 · THE PERSON
Who is this answer about?
Tap to flip
ANSWER
Bram Achterberg, a seven-year senior platform engineer who used to review every one of Corebridge's actions in full.
3 · THE HABIT
What did the team stop doing because it worked?
Tap to flip
ANSWER
Re-adding up Corebridge's total access every time a new grant looked small and safe on its own.
4 · THE FLIP, IN THIS STORY
What's the two-setting switch here?
Tap to flip
ANSWER
Trusting the agent's whole granted footprint versus trusting it only inside one task-scoped slice. It flipped the day a wrong diagnosis reached three services instead of one.
5 · THE OLD DECISION
What decision would you take back?
Tap to flip
ANSWER
Granting one shared production credential with broad write access, reasonable when Corebridge only touched one low-traffic service, never revisited as access grew.
6 · THE NUMBER
Fill in the blank: by the month of the incident, Corebridge's credential could write to ___ production services.
Tap to flip
ANSWER
14 services, up from 1 in its first month, with no single month's growth ever looking alarming on its own.
7 · THE REPLAY
Same misdiagnosis, redesigned credentials. What changes?
Tap to flip
ANSWER
The agent still misreads the cause and still tries the fix, but the task-scoped credential can't reach the other two services, so checkout never notices.
8 · CROSS PRODUCT TRANSFER
Section 4 answers this again for a different product, with a different flip family. Which product, and which family?
Tap to flip
ANSWER
PharmaLoop, a pharmacy order-entry assistant, and the delegation flip: pharmacists let a single confidence threshold auto-approve every category, including rare, high-damage interaction overrides.

Check yourself Score: 0 / 0

Multiple choice
1. Which of these best defines blast radius, as this answer uses the term?
  • A. The percentage of the time a feature produces a wrong answer.
  • B. How much of the system a single mistake or action can actually reach.
  • C. How many users a feature has at peak load.
  • D. How long it takes a model to generate a response.
Show hint
Look at the direct answer and the knowledge spark.
Show answer
B. Blast radius is about reach, not frequency. A rare mistake with a huge reach is often more dangerous than a common one boxed into a small system.
True or false
2. True or false: the redesign in this answer made Corebridge's diagnosis more accurate.
  • True
  • False
Show hint
Look at "show the replay."
Show answer
False. The agent still misdiagnosed the cause in the replay. The redesign only limited how far that same wrong action could reach.
Fill in the blank
3. Fill in the blank: Corebridge's write access grew from 1 service in month one to ___ services by the month of the incident.
Show hint
Look at the line chart in Section 1.
Show answer
14 services. No single month's growth looked alarming, which is exactly why nobody caught it building.
Short answer, why no middle setting
4. Why couldn't the team have just "trusted the agent a little more carefully" instead of scoping credentials per task?
Show hint
Look at the switch-not-dial diagram.
Show answer
Model answer: A shared credential is all-or-nothing. There's no halfway "trust it a bit less" setting on a database credential, either it can reach a service or it can't.
Short answer, apply it yourself
5. Think of an app or tool with more access to your data or accounts than it strictly needs for what you use it for. What's the largest thing nearby it could still touch if it made a mistake?
Show hint
Ask what a single wrong permission, not a wrong answer, could actually reach.
Show answer
Model answer: Most people can name at least one app with broader access than its actual job needs, exactly the kind of unscoped credential this answer designs against.
Short answer, where it wouldn't matter
6. Name a place in Corebridge's workflow where this same credential-scoping redesign genuinely isn't needed.
Show hint
Look at "what I would leave alone."
Show answer
Model answer: A fix on an isolated dev branch. A mistake there can't reach production at all, so a narrow, short-lived credential doesn't buy anything extra.
Before you close the answer
Why this works
Tests whether you separate "how often is it wrong" from "how far does wrong travel," and whether you can point at the specific access decision that let a small mistake reach three services instead of one.
Follow-up traps
"Isn't a ten-minute credential just security theater if the task itself takes longer?" Response: no, the expiry re-issues automatically mid-task, it's there to stop a credential from outliving a closed incident, not to interrupt an open one.

"Won't scoping every credential per task slow the agent down noticeably?" Response: provisioning adds seconds, not minutes, and it's a fixed cost that doesn't scale with how many services the agent touches, unlike the blast radius it replaces.
If pressed
Corebridge's credential broker also records which specific alert or ticket justified each task-scoped credential, so a later audit can tell whether an agent's access ever exceeded what its own stated reasoning actually needed.
From U2xAI Academy

From answering questions to owning outcomes.

A live workshop where you ship a working AI agent, defend a launch decision, and walk away with a portfolio recruiters can't wave off, not just more questions to study.

  • A live AI agent you actually shipped
  • A launch decision you can defend under pressure
  • An interview-ready portfolio, not more flashcards
Know more