← Blog
Core AI Competence22 min read

When Not to Use AI: The Judgment Call That Wins Interviews

Interviewers increasingly probe for the opposite skill: knowing when a simple script or a human beats an AI model. A real decision framework, an AI fit scorecard built into this guide, and 10 real scenarios.

After a candidate has spent an entire interview describing how they use AI for everything, a sharper interviewer will sometimes ask a very different question: tell me about a task where you deliberately chose not to use AI, and why. This question catches more candidates off guard than almost any other in this series, because most preparation for AI enabled roles focuses entirely on demonstrating AI usage, never on demonstrating restraint.

This is a real, specific gap, and closing it is one of the fastest ways to stand out. Knowing when a fixed, deterministic script beats a flexible AI model, and when a human judgment call beats both, is not a lesser skill than knowing how to use AI well. It is the same skill, applied with real judgment rather than reflexive enthusiasm.

This guide gives you a real decision framework, a usable scorecard, and ten concrete scenarios so you can answer this question with specifics rather than a vague sense that "it depends."

By the end of this guide, you will understand the real difference between a deterministic script and an AI model, and the specific signals that tell you which one a given task actually needs.

You will have a real, five question AI fit scorecard, built directly into this guide, that you can apply to any task in under two minutes. And you will have a sayable answer, with a real example, ready for the moment an interviewer asks you about a time you chose not to use AI.

Why "when not to" has become its own interview question

Early AI adoption in most companies followed a predictable pattern: enthusiasm first, judgment later. Teams applied AI models to tasks that a much simpler, cheaper, and more reliable deterministic script would have handled better, because the AI approach felt more modern, not because it was actually the better tool. A meaningful share of these early efforts were quietly rolled back once the cost, the inconsistency, or the unnecessary complexity became clear.

Employers who lived through that cycle now specifically screen for the judgment that would have prevented it. A candidate who reaches for AI on every task, including ones a fixed rule already handles perfectly, is not actually demonstrating skill, they are demonstrating a lack of the exact judgment this guide is about. The candidates who stand out are the ones who can articulate, specifically, why a task does or does not need a probabilistic, flexible tool rather than a deterministic, exact one.

This matters especially in procurement and finance adjacent roles, where a meaningful share of real work, three way matching a purchase order against an invoice and a receipt, applying a fixed approval threshold, calculating a tax amount, is exact, rule based, and does not benefit from AI's flexibility at all. Using AI on these tasks does not just waste resources, it introduces a small but real risk of inconsistency into a process that specifically needs to be perfectly consistent.

There is also a cost dimension that matters at scale, separate from the reliability argument. A deterministic script, once written, runs at essentially no marginal cost per transaction. An AI model call, even a cheap one, has a real cost that adds up across thousands or millions of transactions. Applying AI to a task a five line script already solves perfectly is not just a reliability mistake, it is a real, ongoing, unnecessary expense, and a candidate who can make this argument in cost terms, not just correctness terms, speaks the language a budget owner actually cares about.

Deterministic versus AI: a deterministic script gives the same output for the same input every time, an AI model is flexible but not guaranteed identical every time.
A fixed script always gives the same answer for the same input. An AI model is flexible, not guaranteed identical.

The real distinction: deterministic versus probabilistic

A deterministic system, a fixed script or rule, produces exactly the same output for exactly the same input, every single time, with no variation. If a purchase order total does not match an invoice total, a deterministic three way match script flags it, every time, without exception, because the rule is exact and does not require judgment.

An AI model is probabilistic. It produces a highly likely, well reasoned answer, but not a guaranteed identical one every time, and it is built specifically to handle situations a fixed rule cannot, ambiguous vendor names, unstructured contract language, a judgment call between two plausible categories. This is not a weakness of AI, it is the entire reason it exists: fixed rules cannot handle genuine ambiguity, and AI models can.

The practical conclusion follows directly: a task with a fixed, exact rule and no real ambiguity is a deterministic task, and a script handles it better, cheaper, and more reliably than an AI model ever will. A task involving genuine ambiguity, unstructured input, or a judgment call is where AI earns its place. Using AI on the first kind of task is not more advanced, it is simply the wrong tool.

Decision tree: is the rule fixed and exact, yes use a simple script, no does it need judgment on messy input, yes use AI, no use a human.
Fixed and exact, use a script. Genuinely ambiguous, use AI. Too consequential for either alone, involve a human.

Four signals that AI is the wrong tool for a task

Beyond the deterministic versus probabilistic distinction, four specific signals reliably indicate AI is not the right choice, regardless of how capable the model is.

The answer must be exactly the same every time. Tax calculations, fixed approval thresholds, and exact numerical rules need deterministic precision, not a highly likely correct answer.

A mistake could cause real harm. High stakes decisions, ones with legal, financial, or safety consequences, generally need a human in the loop regardless of how good the underlying model is, because the cost of the rare wrong answer outweighs the convenience of automation.

A simple rule already solves it completely. If a five line script already handles a task perfectly, replacing it with an AI model adds cost, latency, and a new source of inconsistency for no real benefit.

Regulation or policy requires a fixed, auditable process. Some processes are required, by law or internal policy, to follow an exact, documented, repeatable procedure, which is fundamentally a deterministic requirement that a probabilistic tool cannot satisfy on its own.

Four signals AI is the wrong tool: the answer must be exactly the same every time, a mistake could cause real harm, a simple rule already solves it, regulation requires a fixed process.
Any one of these is a strong reason to reach for something other than AI.

The AI fit scorecard

This is the real framework promised for this guide. Score any task against these five questions.

QuestionLow AI fitHigh AI fit
How ambiguous is the input?Clean, structured, consistent formatMessy, unstructured, varies case to case
What does a mistake cost?High, legal or financial consequencesLow, easily caught and corrected
How much volume?Low volume, a script is easy to maintain by handHigh volume, manual review does not scale
Does it need exact repeatability?Yes, must be identical every timeNo, a well reasoned answer is enough
Are the rules already clear?Yes, a simple rule already covers itNo, judgment is genuinely required
Real example: three way match of purchase order, invoice, and receipt is exact and repeatable, a script handles it well, reading a messy scanned contract needs AI.
Three way matching is exact and repeatable. Reading a messy scanned contract genuinely needs judgment.

A worked example: applying the scorecard to a real decision

A procurement team is deciding how to handle two related tasks: matching purchase orders against invoices and receipts, and reviewing scanned vendor contracts for unusual clauses.

Three way matching, scored: input is clean and structured, three numbers being compared. A mismatch is low cost, it gets flagged and reviewed, not silently acted on. Volume is high, thousands of invoices a month. It needs exact repeatability, the same mismatch should always be caught. The rule is already completely clear: do the three numbers match within a defined tolerance. This scores low on AI fit across nearly every question, and a deterministic script is the correct choice.

Scanned contract review, scored: input is messy, scanned PDFs with inconsistent formatting and varied legal language. A missed clause could carry real cost. Volume is moderate. Exact repeatability is less critical than actually finding the relevant clause. And no simple rule can reliably read varied legal prose. This scores high on AI fit, and an AI tool, with human review before anything gets acted on, is the correct choice.

The team ended up building a fixed script for three way matching, the way it always should have been done, and used an AI tool specifically for the contract review task, where its flexibility actually earned its cost. Using AI for both, or a script for both, would have been the wrong call on at least one of the two.

Keep reading

You have read the free preview

The rest of this guide, including the worked example, the career action plan, and the interview ready summary, is for subscribers. Any paid plan unlocks every post like this one, and Foundation adds the full course catalogue.

Practice these interview questions

This is one of the highest-signal question types in a modern interview, because almost every candidate can talk about when to use AI, and far fewer can talk convincingly about when not to. Work through your own honest answer first, using a real example if you have one, then compare against the sample.

Why they're asking: They want a real, specific instance with a clear reason, not a hypothetical, since the reason is what actually shows judgment.

Hit these points:

  • Use a specific example: a decision with informal, undocumented history that shaped the real call
  • Say why: the AI tool had no access to that context and would have had to guess
  • Say what you did use AI for: organizing the factual, on-record information
  • Make clear the judgment call itself stayed entirely yours

Sample answer:

  • The situation: "I was asked to help decide whether to renew a specific vendor relationship that had a complicated, informal history, a past dispute that never made it into any written record but that everyone on the team factored into their thinking."
  • The reason: "I didn't ask an AI tool to weigh in on the recommendation itself, since it had no access to that context and would have had to guess."
  • What AI did do: "I used it to organize the factual, on-record information, but the actual judgment call stayed entirely mine."

Remember it as: Undocumented context, undelegated decision.

9 of 12 answers are locked. Any paid plan unlocks every question like these, and Foundation adds the full course catalogue.