ConceptIntermediateDesigning for Uncertainty & Trust / UX for uncertainty and confidence display / #10

Describe the tradeoff between showing sources and cluttering the interface.

PICK a shrugged-off footnote and a missing one do not cost the same

Dunmore Falls' building department runs ZoneCite, a chat tool on its permit page that answers zoning questions and cites the specific code section behind each answer. Renata Sowinski leads permitting technology for the department.

The direct answer
Default to a one-line, collapsed source strip on every answer, not a wall of footnotes and not nothing at all. Show the plain answer plus a single tappable citation, and only auto-expand the full source when the stakes are genuinely high, like whether a permit is required at all. A resident who never taps the citation loses nothing. A resident who needed it and couldn't find it loses a finished deck.
Pick it in this order
  1. Show a one-line, tappable source strip on every answer, by default.Why: traceability shouldn't depend on the user knowing to ask for it.
  2. Auto-expand the full citation on high-stakes questions, like whether a permit is required.Why: this is the exact question where a resident acting on a wrong or incomplete answer costs the most.
  3. Let any answer expand to its full source on a single tap, cheaply, on demand.Why: the reader who wants to check should never have to leave the screen to do it.
  4. Never drop the citation to nothing, even on routine-sounding questions.Why: "routine" is a guess about the question, not a guarantee about the answer.
  5. Track how often people actually expand a source, every month.Why: that ratio tells you whether the current balance is cluttered or under-sourced, instead of guessing.

How to answer this, stage by stage

The interviewer isn't asking you to pick a side and defend it forever. They're asking whether you can name which kind of wrong actually hurts someone.

Stage 1
Scope it to one real screen
Say it like this
"I'll answer this for ZoneCite, a chat tool on Dunmore Falls' permit page that cites zoning code sections, built by Renata Sowinski's team."
Why this works
Keeps "sources versus clutter" from turning into an abstract design principle with nothing real behind it.
Stage 2
Say your structure out loud
Say it like this
"I'll use PICK. Position, my pick before any reasoning. Impact, who feels each kind of error. Cost asymmetry, which one actually costs more. Kill criteria, what would change my mind."
Why this works
Shows the interviewer you can commit to a side instead of listing pros and cons forever.
Stage 3
State the position, before any reasoning
Say it like this
"A collapsed, one-line source strip on every answer, expanding automatically only on high-stakes questions. Not a wall of citations, not nothing."
Why this works
This is the direct answer. A tradeoff question is testing whether you'll actually commit to one.
Stage 4
Name who feels each kind of error
Say it like this
"A resident who never taps a citation on a routine question loses a few seconds of curiosity, nothing more. A resident who needed the citation and couldn't get to it loses a permit, a fine, or a deck that has to come back down."
Why this works
Puts both sides of the tradeoff in real, human units instead of an abstract "clutter versus trust" debate.
Stage 5
Name the asymmetry, and prove it with the near miss
Say it like this
"When ZoneCite dropped citations from routine-sounding answers to clean up the screen, a homeowner got a clear answer that skipped one overlay-district exception. He built a deck. The city later required it torn back to code."
Why this works
Turns "sources add clutter" into a specific, checkable cost on the other side of the tradeoff.
Stage 6
Give the kill criteria
Say it like this
"If expand-for-source requests on a given question type start climbing, that question type moves into the auto-expand tier. If nobody's tapping a citation for months, it can safely collapse further."
Why this works
Shows the pick isn't fixed forever, it moves based on real evidence, not a guess made once at launch.
Stage 7
Close on the one line
Say it like this
"A citation nobody reads costs a shrug. A citation nobody could find costs a torn-down deck. Default to showing it, quietly, and only get loud when the stakes actually justify the noise."
Why this works
Restates the position in one breath, ready for a live follow-up.

The chat box in the corner of the permit page

The chat box sits at the bottom right of the city's permit page, small, easy to miss, and busier than anyone on staff expected. Before ZoneCite, residents called or waited in line to ask "do I need a permit for this," and staff answered from memory or looked the code up by hand, about 8 minutes a question, across roughly 60 questions a day.

Hand sketched metaphor scene titled What clutter and clarity actually look like. Left, a green document icon labeled receipt, caption clean quick to scan. Right, an amber document icon labeled legal brief, caption dense fully sourced.
Most answers should feel like the receipt. A few genuinely need to feel like the brief.

ZoneCite's first version answered instantly, but under every response it printed the full statute text and every cross-reference, treating every question, "what are your office hours" included, like a legal filing. Average time to read a full answer stretched to 14 minutes, longer than the old phone call.

Residents who abandoned a permit question before getting a usable answer, by screen version
40% 20 0 34% Dense footnotes 6% Collapsed strip
A wall of footnotes cost the city a third of its questions before anyone even got an answer.

Here's the turn: the fix for clutter isn't removing the source. It's changing how loud it is. Dunmore Falls' second attempt swung the other way, stripping citations entirely from any question that sounded routine, and that swing is what actually let a wrong answer through.

Hand sketched comparison titled The asymmetry drawn. Left, a green document icon labeled ignored citation, caption cheap a shrug. Right, a red scale icon labeled wrong code cited, caption permit revoked later.
One of these costs a shrug. The other costs a torn-down deck. They are not the same kind of wrong.

At its worst, an under-sourced answer doesn't just annoy someone later. It lets a resident act, in good faith, on a clean-looking answer that quietly left out the one detail that mattered, with no citation anywhere to have caught it.

The decision I would take back When ZoneCite's second version dropped citations from "routine-sounding" questions to clean up the screen, the team decided that questions without obvious legal weight didn't need a source. That made sense for the vast majority of questions, which really were routine. It stopped making sense the one time a question only sounded routine.

What I would leave alone: a question like "what are your office hours" or "where do I submit a paper form" genuinely doesn't need a zoning citation. Nothing about those answers depends on a code section, and adding one there would be clutter with no offsetting benefit.

The lesson: clutter and missing sources aren't opposite ends of one dial you can just split the difference on. They're two different failures, and the fix for one is not automatically safe for the other.

Now here is the same thing as a story

The short version above is what you'd say defending this design to the city council. Read this one for how the actual near miss unfolded.

Renata had spent four years modernizing Dunmore Falls' permit office before ZoneCite, replacing paper logs with a searchable system nobody else in the building had bothered to build. She knew the zoning code well enough to catch a wrong answer by ear.

ZoneCite's first months were good. Residents got instant answers, staff got fewer repetitive calls, and everyone assumed the dense footnotes underneath, while a little much, were at least thorough. Nobody complained about missing information. They complained about reading time.

Knowledge spark: what's an "overlay district" in zoning? It's an extra layer of rules laid on top of a city's regular zoning map, covering things like flood zones, historic areas, or land near a wetland. Two houses on the same street, both zoned "residential," can have completely different permit rules if only one of them sits inside an overlay district.

So the team simplified. Any question ZoneCite classified as routine, a wide majority of them, got a clean answer with no citation block at all, on the theory that citations were for complicated cases, not easy ones. Nobody decided this was risky. It looked like a reasonable cleanup at the time.

Hand sketched decision tree titled When to show a source inline. Root, AI cites a code section. Three branches: high stakes decision leads to show full citation, routine question leads to small reference link, user asks why leads to expand full source.
The middle branch is where the near miss lived: a question that looked routine but sat inside an overlay district.

A homeowner asked whether he needed a permit to build a small backyard deck. ZoneCite classified the question as routine, since decks under a certain size usually don't need one, and answered cleanly: no permit required. It didn't mention that his specific lot sat inside a floodplain overlay district, where the same deck did need one.

The answer wasn't wrong about decks in general. It was wrong about this deck, on this lot, and nothing on the screen gave him a way to check.

He built the deck over a weekend. The overlay-district requirement surfaced three months later during an unrelated inspection next door, and the city required the deck brought up to code, at his own cost, well after it was finished.

Permit code violations later traced to a ZoneCite answer, by month, across the redesign
10 5 0 citations dropped Month 1 Month 4 Month 6 9 1
Violations climbed for two months after citations disappeared from routine answers, then dropped once the collapsed strip put a source back on every screen.

Dunmore Falls didn't go back to the wall of footnotes. They built the collapsed source strip instead: one tappable line under every answer, expanding automatically on any question touching permit requirements at all, routine-sounding or not.

Hand sketched labeled parts diagram titled What's inside a well-placed source strip. A document icon at the center labeled Answer Card, with four callouts: code section, plain summary, view full text, confidence hue.
Four small facts, collapsed by default, expanded on a single tap. Neither a wall nor a blank.

PICK, said out loud before the reasonsNot a debate about clutter in general. PICK is what tells you exactly where the line sits.

P
Position. The pick, before any reasoning.
A collapsed, one-line source strip on every answer, auto-expanding only on high-stakes permit questions.
Commits to a side instead of listing tradeoffs forever.
I
Impact. Who feels each kind of error.
A resident skimming past a citation loses a few seconds. A resident who needed it and couldn't reach it loses a permit or a finished project.
Puts both errors in human terms, not an abstract "clutter versus trust" tradeoff.
C
Cost asymmetry. Which one actually costs more.
A shrugged-off citation is cheap and visible. A missing one, on the one question that wasn't actually routine, is hidden and expensive.
The hardest step, and the one the whole pick turns on.
K
Kill criteria. What would change the pick.
A rising expand-for-source rate on a question type moves it into the auto-expand tier; a flat rate lets it stay collapsed.
Keeps the pick answerable to real evidence instead of fixed forever at launch.
Hand sketched icon list titled Signs the interface has gone too far either way. Two items: a box icon labeled a wall of footnotes nobody reads, a question mark box icon labeled zero way to trace a claim back.
Either failure is a real failure. Neither one is the safe default.

The recap, one line per letter: position is the collapsed strip that expands on stakes, impact is naming both the bored skimmer and the burned homeowner, cost asymmetry is why a missing citation costs more than an ignored one, and kill criteria is letting real expand rates move a question type between tiers.

Hand sketched timeline titled How ZoneCite's citation design evolved. Four milestones: dense footnotes ship month 1, complaints arrive month 2, source strip collapses month 3 highlighted, adoption recovers month 5.
Two overcorrections and a fix, five months apart, before the screen finally found the actual line.

And if you want to be sure it really works, try it somewhere elseSame four letters, a public library's reference desk instead of a permit office. A different impact breaks the second story.

The Dunmore Falls public library runs AskStax, an AI reference tool that answers patron research questions and cites the encyclopedia entries, databases, or archived articles behind each answer. Halvard Bruun leads reference services there. Mapped onto PICK: position is the same collapsed source strip, expanding automatically whenever a patron's question sounds like it's for a paper or a citation, not a quick personal curiosity; impact is different from Dunmore Falls' permit case, since the person hurt by a missing source here isn't risking a fine, they're a student who can't cite an unsourced claim in their own bibliography and has to redo the research from scratch.

The cost asymmetry still holds, just in a different currency. A patron skimming a quick fact loses nothing by not tapping a citation. A student building a paper on an AskStax answer with no traceable source loses the whole citation, and sometimes the credibility of the paper itself if a professor asks where the fact came from. The kill criteria are the same shape too: if "where's this from" follow-up questions rise for a topic area, that topic's answers move to auto-expanded sourcing.

Hand sketched labeled parts diagram titled What's inside a well-placed source strip, reused here for AskStax. Center document icon labeled Answer Card, with code section, plain summary, view full text, and confidence hue around it.
Swap "code section" for "database entry," and the same four-part card does the same job.

Swap the trigger and it still runs.
Speed: an interviewer caps you at sixty seconds. Say "a one-line source strip by default, full citation auto-expanded on high stakes," and stop.
Cost: there's no time this sprint to build tiered auto-expansion logic. Say so honestly, and ship the flat one-line strip on everything first, since even a always-visible-but-collapsed citation beats either extreme.
The model gets better, for real: if ZoneCite's classification of "routine" gets more accurate over time, that's still not a reason to remove the citation entirely from any tier. It's a reason to trust the collapsed default more, not to go back to hiding sources altogether.

Where people run it wrong.
They treat "add sources" and "reduce clutter" as opposite ends of the same dial, instead of two separate failures with two separate fixes.
They classify a question as low-stakes based on how it sounds, not on what's actually true about the specific case.
They ship a fix for one side of the tradeoff and declare the problem solved, without watching whether the other side quietly got worse.

How to use it live. When someone hands you a "sources versus clutter" question, ask back: for this exact answer, is the source's whole job to be skimmed past, or to be found when someone really needs it? Design the loudness of the citation around that answer, not around a general rule for the whole screen.

Flashcards (tap any card to flip it)

1 · THE FRAMEWORK
What framework fits an "A or B" tradeoff question like this one?
Tap to flip
ANSWER
PICK: position, impact, cost asymmetry, kill criteria. It forces a real commitment, then finds which error kind actually costs more.
2 · THE PERSON
Who is this answer about?
Tap to flip
ANSWER
Renata Sowinski, permitting technology lead at Dunmore Falls' building department, who modernized the permit office before ZoneCite existed.
3 · THE POSITION
What's the actual pick this answer commits to?
Tap to flip
ANSWER
A collapsed, one-line source strip on every answer by default, auto-expanding only when the question genuinely touches high stakes.
4 · THE ASYMMETRY
Which costs more: a citation nobody reads, or a citation that isn't there?
Tap to flip
ANSWER
The missing one. An ignored citation costs a shrug. A missing one, on the one question that only sounded routine, cost a resident a torn-down deck.
5 · THE OLD DECISION
What decision would you take back?
Tap to flip
ANSWER
Dropping citations entirely from any question ZoneCite classified as "routine-sounding," reasonable for the majority of cases, wrong for the one that wasn't.
6 · THE NUMBER
Fill in the blank: with the dense-footnote screen, ___ percent of residents abandoned their question before getting a usable answer.
Tap to flip
ANSWER
34 percent, versus 6 percent once the collapsed source strip shipped.
7 · THE KILL CRITERIA
What would move a question type from collapsed to auto-expanded sourcing?
Tap to flip
ANSWER
A rising rate of people tapping to expand the source on that question type, a real signal instead of a one-time guess at launch.
8 · CROSS PRODUCT TRANSFER
Section 4 answers this same question again for a different product. Which product, and how does the impact differ there?
Tap to flip
ANSWER
The public library's AskStax reference tool. There, the person hurt by a missing source isn't risking a fine, they're a student who can't cite an unsourced claim and has to redo the research.

Check yourself Score: 0 / 0

Short answer, apply it yourself
1. Think of a tool you use that cites sources. Are those citations collapsed by default, or do they clutter the screen? Which failure would you rather have?
Show hint
Ask which kind of wrong would actually hurt you, not just annoy you.
Show answer
Model answer: Most people say clutter is annoying but a missing source is the one that actually costs them something later.
Multiple choice
2. Why does this answer treat "ignored citation" and "missing citation" as two separate failures instead of two ends of one dial?
  • A. Because citations are expensive to build either way.
  • B. Because the fix for clutter, hiding sources, is exactly what creates the risk of a missing source when it mattered.
  • C. Because residents prefer more text on screen, not less.
  • D. Because zoning law requires two separate citation formats.
Show hint
Look at "here's the turn."
Show answer
B. Overcorrecting for clutter by removing sources is what actually let the wrong-deck incident happen.
True or false
3. True or false: the final design shows the full statute text under every single answer, regardless of the question.
  • True
  • False
Show hint
Look at the priority list and "what I would leave alone."
Show answer
False. Most answers get a one-line collapsed strip; only high-stakes questions auto-expand to the full citation.
Fill in the blank
4. Fill in the blank: violations traced to a ZoneCite answer peaked at ___ per month, in the month right after citations were dropped from routine questions.
Show hint
Look at the line chart.
Show answer
9 per month. Up from a steady 2 a month before citations were dropped, and back down to 1 after the collapsed strip fix shipped.
Short answer, where it wouldn't matter
5. Name a kind of question on ZoneCite where a citation genuinely isn't needed at all.
Show hint
Look at "what I would leave alone."
Show answer
Model answer: Something like office hours or where to submit a paper form. Nothing about that answer depends on a code section.
Short answer, name the kill criteria
6. What real, measurable signal would tell you a question type needs to move from collapsed to auto-expanded sourcing?
Show hint
Look at the K step.
Show answer
Model answer: A rising rate of people tapping to expand the source on that specific question type, tracked over real weeks, not guessed at launch.
Before you close the answer
Why this works
Tests whether you can commit to one concrete design instead of listing both sides forever, and whether you actually understand that decluttering and dropping traceability are two different design mistakes with two different fixes.
Follow-up traps
"Isn't classifying questions as high-stakes or routine just guessing again?" Response: yes, at first, which is exactly why the kill criteria track real expand-rate behavior afterward and correct the classification instead of trusting the first guess forever.

"Won't residents just ignore the collapsed source strip the same way they ignored the footnotes?" Response: a collapsed one-line strip costs almost nothing to skim past, unlike a wall of statute text; the two aren't the same weight of clutter.
If pressed
The rebuilt ZoneCite also logs which specific overlay-district exceptions get missed most often in routine-classified answers, so the classification itself improves over time instead of relying on the same fixed rule that let the deck case through.
From U2xAI Academy

From answering questions to owning outcomes.

A live workshop where you ship a working AI agent, defend a launch decision, and walk away with a portfolio recruiters can't wave off, not just more questions to study.

  • A live AI agent you actually shipped
  • A launch decision you can defend under pressure
  • An interview-ready portfolio, not more flashcards
Know more