Eval-Driven Specification

Writing a PRD for an AI feature Interview Questions

26 questions. All 26 carry a written answer.

  1. #1What sections does an AI PRD need that a standard PRD does not?ConceptFoundational
  2. #2Write the problem statement section for an AI meeting-summary feature.Artifact critiqueIntermediate
  3. #3How do you specify expected behaviour when the output is generated text?ConceptIntermediate
  4. #4Describe how to document the failure modes section of an AI PRD.Artifact critiqueIntermediate
  5. #5What belongs in the scope section about what the model will explicitly not do?ConceptIntermediate
  6. #6How do you specify the data dependencies of a feature in a PRD?ConceptIntermediate
  7. #7Write the quality bar section for a customer-facing classification feature.Artifact critiqueAdvanced
  8. #8Should the PRD name a specific model? Argue both sides.InterviewAdvanced
  9. #9How do you document cost assumptions inside a PRD?CalculationIntermediate
  10. #10Describe the latency requirements section and how you would derive its numbers.ConceptIntermediate
  11. #11What does the PRD say about what happens when the model is unavailable?ConceptIntermediate
  12. #12How do you specify the human-in-the-loop checkpoints in a PRD?ConceptIntermediate
  13. #13Write the user-facing error handling requirements for an AI feature.Artifact critiqueIntermediate
  14. #14Describe how the PRD should handle the eval spec: inline, linked or separate?ConceptIntermediate
  15. #15How do you write requirements that survive a model version change?ConceptAdvanced
  16. #16Critique this requirement: the assistant should give helpful and accurate responses.Artifact critiqueFoundational
  17. #17What does the PRD need to say about logging and observability?ConceptIntermediate
  18. #18How do you document the guardrails and content policy for a generative feature?ConceptAdvanced
  19. #19Write the rollout and kill-switch section of an AI PRD.Artifact critiqueAdvanced
  20. #20What assumptions should be listed explicitly, and why does that matter more for AI?ConceptIntermediate
  21. #21How do you keep an AI PRD from becoming a technical design doc?ConceptIntermediate
  22. #22Describe how you would version a PRD as model behaviour changes underneath it.ConceptAdvanced
  23. #23What does the success criteria section look like when the metric is subjective quality?ConceptAdvanced
  24. #24How would you write a PRD for an agent that takes actions on a user's behalf?CaseAdvanced
  25. #25Give me the outline of an AI PRD from memory and justify each section.InterviewIntermediate
  26. #26Which section of an AI PRD is most often missing, and what damage does that cause?InterviewAdvanced