Designing for Uncertainty & Trust
Designing for failure and graceful degradation Interview Questions
22 questions. All 22 carry a written answer.
- #1What should happen in the UI when the model returns nothing usable?CaseFoundational
- #2Design the fallback experience for an AI feature when the provider is down.CaseIntermediate
- #3Explain the difference between failing loudly and failing silently, and which you prefer.ConceptIntermediate
- #4How do you design a feature that degrades to a non-AI version rather than breaking?CaseAdvanced
- #5Describe three failure modes to design for before launch.ConceptIntermediate
- #6What error message would you write for a model timeout, and what would you avoid saying?Artifact critiqueIntermediate
- #7How should the product behave when the model produces output that fails a safety filter?CaseAdvanced
- #8Design the recovery path for a user whose agent took a wrong action.CaseAdvanced
- #9Explain the concept of a blast radius for an AI feature and how design limits it.ConceptAdvanced
- #10What is the right undo experience for AI-generated changes?CaseIntermediate
- #11Critique an error state that says something went wrong, please try again.Artifact critiqueFoundational
- #12How do you design for the case where the model is confidently wrong?CaseAdvanced
- #13Describe the escalation path from AI to human and its design requirements.CaseIntermediate
- #14What should a rate-limited user see, and how do you avoid making it feel punitive?CaseIntermediate
- #15Explain how to design a kill switch that product can operate without an engineer.ConceptAdvanced
- #16How do you preserve user work when an AI operation fails midway?CaseAdvanced
- #17Design the experience for a partial result rather than a failure.CaseAdvanced
- #18What does graceful degradation look like for a multi-step agent?ConceptAdvanced
- #19How would you handle a failure that only affects a subset of languages or regions?CaseAdvanced
- #20Describe the difference between a retry that helps and a retry that just costs money.ConceptIntermediate
- #21What failure telemetry does design need in order to improve the experience?ConceptIntermediate
- #22Walk me through the failure states you would design for a feature I name.InterviewAdvanced