AI UX Design and Trust
UX for AI Uncertainty and Confidence Interview Questions
How to show users that the AI might be wrong without making the product annoying: confidence display, encouraging verification, and what changes when the model is unsure. Relevant to AI PMs and product designers.
- 22 questions with model answers
- 1 foundational · 8 intermediate · 13 advanced
Foundational UX for AI Uncertainty and Confidence Questions
Intermediate UX for AI Uncertainty and Confidence Questions
- When should you show a confidence score to a user, and when should you hide it?Concept
- Describe three ways to communicate uncertainty without displaying a number.Concept
- What is the risk of showing a percentage confidence that users cannot interpret?Concept
- Critique a design that presents an AI answer with the same authority as a database lookup.Artifact critique
- Describe the tradeoff between showing sources and cluttering the interface.Concept
- How should the interface change when the model's confidence is very low?Case
- Design the empty state for an AI feature that cannot answer.Case
- What is the accessibility consideration for confidence indicators?Concept
Advanced UX for AI Uncertainty and Confidence Questions
- Design the UI for a feature that is 70 percent confident in its answer.Case
- Explain how hedging language in generated text affects user trust.Concept
- How would you design an interface that encourages verification without being annoying?Case
- How do you display uncertainty in a data extraction feature with 20 extracted fields?Case
- Explain when a binary confident-or-not display beats a graded one.Concept
- What is the design response to a model that is well-calibrated versus poorly calibrated?Concept
- How do you show uncertainty in a voice interface with no screen?Case
- Explain the risk of uncertainty displays that users learn to ignore.Concept
- What research would you run to test whether your uncertainty display works?Case
- Describe how uncertainty display differs for expert versus novice users.Concept
- How would you handle uncertainty in an agent that has already acted?Case
- Design a confidence display for a medical information feature.Case
- Show me how you would redesign a confident-sounding AI answer to be honest instead.Interview