Model Fluency & the AI PM Role

The AI literacy baseline every PM needs Interview Questions

21 questions. All 21 carry a written answer.

  1. #1Explain what a token is and why a PM should care about it.ConceptFoundational
  2. #2Describe the difference between a context window and a model's memory.ConceptFoundational
  3. #3What is the practical difference between prompting, RAG and fine-tuning for a product decision?ConceptFoundational
  4. #4Explain hallucination in one paragraph a sales team could repeat accurately.InterviewFoundational
  5. #5What does temperature control and when would you lower it in a product?ConceptFoundational
  6. #6Describe what an embedding is and one product feature it makes possible.ConceptFoundational
  7. #7Explain the difference between latency and throughput and which one your users feel.ConceptFoundational
  8. #8What is a system prompt and why is it a product asset rather than a code detail?ConceptIntermediate
  9. #9Explain what function calling lets a model do that plain text generation does not.ConceptIntermediate
  10. #10What does it mean for a model to be multimodal and what product surfaces does that unlock?ConceptFoundational
  11. #11Describe what an eval is and how it differs from a unit test.ConceptIntermediate
  12. #12Explain the tradeoff between a larger model and a smaller one in plain product terms.ConceptFoundational
  13. #13What is quantization and why might it show up in a cost conversation?ConceptIntermediate
  14. #14Explain why the same prompt can cost different amounts on different days.ConceptIntermediate
  15. #15What is prompt caching and what product decision does it enable?ConceptIntermediate
  16. #16Describe what a reasoning model does differently and when the extra cost is worth it.ConceptIntermediate
  17. #17Explain the difference between training data and retrieval data to a compliance officer.InterviewIntermediate
  18. #18What does model deprecation mean for a shipped product and what should you have in place before it happens?CaseIntermediate
  19. #19Explain what an agent is in a way that distinguishes it from a chatbot with tools.ConceptIntermediate
  20. #20A PM says the model needs more training on our data. Diagnose what they probably actually need.CaseIntermediate
  21. #21I will name five technical terms. Explain each to me as if I were your CEO.InterviewFoundational