Eval-Driven Specification
Writing a PRD for an AI feature Interview Questions
26 questions. All 26 carry a written answer.
- #1What sections does an AI PRD need that a standard PRD does not?ConceptFoundational
- #2Write the problem statement section for an AI meeting-summary feature.Artifact critiqueIntermediate
- #3How do you specify expected behaviour when the output is generated text?ConceptIntermediate
- #4Describe how to document the failure modes section of an AI PRD.Artifact critiqueIntermediate
- #5What belongs in the scope section about what the model will explicitly not do?ConceptIntermediate
- #6How do you specify the data dependencies of a feature in a PRD?ConceptIntermediate
- #7Write the quality bar section for a customer-facing classification feature.Artifact critiqueAdvanced
- #8Should the PRD name a specific model? Argue both sides.InterviewAdvanced
- #9How do you document cost assumptions inside a PRD?CalculationIntermediate
- #10Describe the latency requirements section and how you would derive its numbers.ConceptIntermediate
- #11What does the PRD say about what happens when the model is unavailable?ConceptIntermediate
- #12How do you specify the human-in-the-loop checkpoints in a PRD?ConceptIntermediate
- #13Write the user-facing error handling requirements for an AI feature.Artifact critiqueIntermediate
- #14Describe how the PRD should handle the eval spec: inline, linked or separate?ConceptIntermediate
- #15How do you write requirements that survive a model version change?ConceptAdvanced
- #16Critique this requirement: the assistant should give helpful and accurate responses.Artifact critiqueFoundational
- #17What does the PRD need to say about logging and observability?ConceptIntermediate
- #18How do you document the guardrails and content policy for a generative feature?ConceptAdvanced
- #19Write the rollout and kill-switch section of an AI PRD.Artifact critiqueAdvanced
- #20What assumptions should be listed explicitly, and why does that matter more for AI?ConceptIntermediate
- #21How do you keep an AI PRD from becoming a technical design doc?ConceptIntermediate
- #22Describe how you would version a PRD as model behaviour changes underneath it.ConceptAdvanced
- #23What does the success criteria section look like when the metric is subjective quality?ConceptAdvanced
- #24How would you write a PRD for an agent that takes actions on a user's behalf?CaseAdvanced
- #25Give me the outline of an AI PRD from memory and justify each section.InterviewIntermediate
- #26Which section of an AI PRD is most often missing, and what damage does that cause?InterviewAdvanced