Model Fluency & the AI PM Role
The AI literacy baseline every PM needs Interview Questions
21 questions. All 21 carry a written answer.
- #1Explain what a token is and why a PM should care about it.ConceptFoundational
- #2Describe the difference between a context window and a model's memory.ConceptFoundational
- #3What is the practical difference between prompting, RAG and fine-tuning for a product decision?ConceptFoundational
- #4Explain hallucination in one paragraph a sales team could repeat accurately.InterviewFoundational
- #5What does temperature control and when would you lower it in a product?ConceptFoundational
- #6Describe what an embedding is and one product feature it makes possible.ConceptFoundational
- #7Explain the difference between latency and throughput and which one your users feel.ConceptFoundational
- #8What is a system prompt and why is it a product asset rather than a code detail?ConceptIntermediate
- #9Explain what function calling lets a model do that plain text generation does not.ConceptIntermediate
- #10What does it mean for a model to be multimodal and what product surfaces does that unlock?ConceptFoundational
- #11Describe what an eval is and how it differs from a unit test.ConceptIntermediate
- #12Explain the tradeoff between a larger model and a smaller one in plain product terms.ConceptFoundational
- #13What is quantization and why might it show up in a cost conversation?ConceptIntermediate
- #14Explain why the same prompt can cost different amounts on different days.ConceptIntermediate
- #15What is prompt caching and what product decision does it enable?ConceptIntermediate
- #16Describe what a reasoning model does differently and when the extra cost is worth it.ConceptIntermediate
- #17Explain the difference between training data and retrieval data to a compliance officer.InterviewIntermediate
- #18What does model deprecation mean for a shipped product and what should you have in place before it happens?CaseIntermediate
- #19Explain what an agent is in a way that distinguishes it from a chatbot with tools.ConceptIntermediate
- #20A PM says the model needs more training on our data. Diagnose what they probably actually need.CaseIntermediate
- #21I will name five technical terms. Explain each to me as if I were your CEO.InterviewFoundational