CalculationAdvancedAI Opportunity & Model Strategy / Evaluating AI vendors as a buyer / #8

How do you compare vendors whose pricing models are structurally different?

BOUND the day the finance lead asked what nine cents and forty six cents actually meant

ToolCrate is a marketplace where neighbors rent tools like drills and generators to each other. Tomasz Bellweather is the product manager deciding between two AI vendors for rental damage disputes. Odalys Fenwick handles those disputes by hand today. Wynn Castellano runs finance and asked to see the vendor comparison before it went to budget.

The direct answer
Convert every vendor's price sheet to the same unit, cost per rental transaction, using your own real volume, not a demo customer's. At ToolCrate's numbers, Scuffguard runs about nine cents per rental and Ledgerlens runs about forty six cents, a five times gap a side by side price list would never show. Then name the one usage swing, here it's the confirmed claim rate, that could flip which vendor is actually cheaper.
Do this, in order
  1. Convert both vendors' prices to the same unit before comparing anything.Why: a per-photo fee and a per-claim fee aren't comparable until they're both cost per rental.
  2. Use your own real volume, not the vendor's reference customer.Why: their sample customer's flagged-to-claim ratio isn't yours, and the gap changes the whole answer.
  3. Check the converted number against something known, like your own commission per rental.Why: a cost that's absurdly high or low against a known figure means an assumption is wrong.
  4. Name the single usage swing that would flip which vendor is cheaper.Why: today's cheaper vendor can become the pricier one the moment your claim rate moves.
  5. Re-run the comparison whenever that swing factor actually moves.Why: a price comparison is a snapshot of this month's volume, not a permanent ranking.

How to answer this, stage by stage

Nobody is scoring whether you can read a price sheet. They're scoring whether you can convert two different price sheets into one number you can actually compare.

Stage 1
Scope it to the two vendors on the table
Say it like this
"I'll answer this for ToolCrate, comparing Scuffguard's per-photo pricing against Ledgerlens's flat-plus-per-claim pricing, on ToolCrate's own volume."
Why this works
Keeps the question from turning into a generic pricing-strategy essay.
Stage 2
Say your structure out loud
Say it like this
"I'll use BOUND. Break down the cost equation, own my numbers, use a range, nail a sanity check, and say which assumption swings it most."
Why this works
This is an estimation question, not a story question, and saying so upfront is part of the answer.
Stage 3
Break down the equation
Say it like this
"Monthly cost equals any flat fee, plus the per-unit price times how many of that unit we actually generate, converted to cost per rental."
Why this works
States the arithmetic before touching a single number from either vendor's sheet.
Stage 4
Own the numbers out loud
Say it like this
"We run forty thousand rentals a month. About twenty six hundred get flagged for photo review, and nine hundred of those become confirmed claims."
Why this works
Names exactly where every number in the comparison comes from, not just the vendors' own claims.
Stage 5
Nail the sanity check and the swing
Say it like this
"Both costs land under eight percent of our average commission per rental, so neither is absurd. But if confirmed claims rise by four hundred a month, Ledgerlens jumps by seventy two hundred dollars. Scuffguard barely moves."
Why this works
Shows the comparison survives a smell test, and names the one number that could flip it.
Stage 6
Close on the one line
Say it like this
"Convert both to cost per rental on our own volume, not their sample customer's. Right now that's nine cents versus forty six cents, and I'd watch the claim rate, not the price sheet, going forward."
Why this works
Restates the direct answer in one breath, ready for a live follow-up.

Let's learn

For three years, Odalys Fenwick was the only person at ToolCrate who could tell real damage from bad lighting in a photo. She compared before-and-after pictures of rented tools by hand, about twenty five minutes per flagged case, and closed roughly nine hundred confirmed damage claims a month across the whole marketplace.

Hand sketched flow diagram titled Resolving a damage dispute, before AI. Five boxes in sequence: Renter flags damage, Compare photos by hand, Call both parties, Decide who pays highlighted, Close the case.
This is the job either vendor is meant to speed up. Neither one changes what actually gets decided.

Two vendors pitched AI photo review to replace the manual comparison. Scuffguard charges thirty five cents for every photo its model analyzes. Ledgerlens charges a flat twenty four hundred dollars a month, plus eighteen dollars for every claim it confirms as valid.

The real question was never which price sheet looked smaller. It was which vendor actually costs less once you run ToolCrate's own numbers through it.
Monthly cost, built up from ToolCrate's own volume
20,000 10,000 0 3,640 Scuffguard 18,600 Ledgerlens photo review fee per claim fee flat monthly fee
Scuffguard costs about nine cents per rental. Ledgerlens costs about forty six cents. Neither price sheet says either of those numbers.

At its worst, comparing sticker prices instead of converted costs means picking the pricier vendor while believing you picked the cheaper one. Building this comparison honestly costs about a day of Tomasz's time. Skipping it risks locking in a vendor that costs five times more than the alternative, every month, for as long as the contract runs.

The choice I would take back ToolCrate's original vendor comparisons just laid two price sheets side by side and read off the smaller number. That was fine back when every vendor ToolCrate considered priced the same way, a flat monthly fee. It stopped working the moment two vendors showed up with structurally different pricing and nobody converted either one to a shared unit first.

What I would leave alone: when two vendors price the exact same way, say both charge a flat monthly fee for the same feature set, reading the smaller number really is the whole comparison. The conversion step only matters once the pricing shapes actually differ.

The lesson: a cheap-looking price and a cheap price are not the same thing. The only way to tell them apart is to run your own volume through both equations before you sign anything.

Now here is the same thing as a story

The short version above is what you'd say defending this pick to ToolCrate's budget review. Read this one for how the comparison actually got built.

Tomasz Bellweather had run four vendor searches before this one, and every previous comparison had been easy: line up the flat monthly fees, pick the lower number, move on. He expected this one to go the same way.

Hand sketched comparison titled Two vendors, two pricing shapes. Left, a blue gauge icon labeled Scuffguard, caption priced per photo reviewed. Right, an orange scale icon labeled Ledgerlens, caption flat fee plus per resolved claim.
Two shapes, not two numbers. That's what made the old habit stop working here.

Scuffguard's quote read thirty five cents per photo. Ledgerlens's quote read twenty four hundred dollars a month plus eighteen dollars per resolved claim. Read as sticker prices, Scuffguard looked obviously cheaper, and Tomasz nearly wrote it into the recommendation memo that way.

Knowledge spark: why don't per-unit AI vendor prices compare directly? Two AI vendors can price the same feature completely differently: one per action the model takes, one per outcome it confirms. A model that reviews every photo costs you for its own uncertainty. A model that only bills on a confirmed claim costs you for its own confidence. Neither number means anything until you multiply it by how often each of those things actually happens to you.

Wynn Castellano, ToolCrate's finance lead, pulled the comparison sheet ahead of the budget meeting and asked one question: "What does nine cents even mean here, and where did that number come from?" Tomasz realized he'd never actually run ToolCrate's own volume through either vendor's formula.

Hand sketched labeled parts diagram titled What ToolCrate's own volume actually is. A box icon at center labeled Monthly Rentals, with four callouts: 40,000 rentals, 2,600 flagged, 900 confirmed claims, 4 photos per case.
Neither vendor's quote mentions a single one of these four numbers. They're the whole comparison.

Tomasz had considered simply asking each vendor for "an average customer's monthly bill" instead of building the comparison himself. He dropped that idea. A vendor's reference customer has its own flagged-to-claim ratio, not ToolCrate's, and their quoted average would quietly reflect someone else's marketplace, not this one.

Neither vendor's price sheet was dishonest. Neither one was written for ToolCrate's actual mix of flagged reviews and confirmed claims either.

He ran the real numbers: forty thousand rentals a month, twenty six hundred flagged for review at four photos each, nine hundred confirmed claims. Scuffguard's cost came out to three thousand six hundred forty dollars a month, all from photo fees. Ledgerlens's cost came out to eighteen thousand six hundred dollars, the flat fee plus nine hundred claims at eighteen dollars each.

Hand sketched decision tree titled Which vendor costs less this month. Root, compare vendor cost on ToolCrate's own volume. Three branches: review rate stays low leads to Scuffguard cheaper, claim rate climbs leads to Ledgerlens cheaper, volume swings either way leads to re-run the numbers.
The answer isn't fixed. It depends on which of ToolCrate's own numbers moves next.

The gap held against a sanity check too: ToolCrate earns about six dollars twenty cents in commission per rental. Scuffguard's cost is about one and a half percent of that. Ledgerlens's is about seven and a half percent, higher, but not an absurd number for a fraud and dispute tool to cost.

BOUND, the estimate that shows its own arithmeticNot a gut call on which price sheet looks friendlier. BOUND is what makes a pricing comparison checkable instead of just confident.

B
Break it down. State the equation first.
Monthly cost equals any flat fee, plus the per-unit price, times ToolCrate's own real volume of that unit.
An estimate with no stated equation is a guess wearing a spreadsheet.
O
Own the numbers. State every assumption.
Forty thousand rentals a month, twenty six hundred flagged reviews at four photos each, nine hundred confirmed claims.
This is the hardest step: naming exactly where each number came from, not just stating a total.
Hand sketched quadrant titled Vendor cost, mapped against volume risk, axes Review volume sensitivity and Claim volume sensitivity. Scuffguard sits high on review sensitivity, low on claim sensitivity. Ledgerlens sits low on review sensitivity, high on claim sensitivity. A hybrid vendor sits in the middle.
Each vendor's real risk is which of ToolCrate's own numbers it's most exposed to.
U
Use a range, not false precision.
The confirmed-claim rate has moved between thirty and forty percent of flagged reviews over the past year, not a fixed number.
A single confident number here claims more certainty than ToolCrate's own history actually supports.
N
Nail the sanity check.
Both costs land under eight percent of ToolCrate's average commission per rental, plausible for a dispute tool, not an absurd number either way.
Comparing the estimate to something known catches a number that's quietly nonsense.
D
Direction. What swings it most.
A rise in confirmed claims moves Ledgerlens's cost by thousands of dollars. Scuffguard barely notices the same change.
Naming the single lever that actually moves the estimate is what a good estimator does and a bad one skips.

The recap, one line per letter: break it down is stating cost as a flat fee plus a per-unit price times real volume, own the numbers is naming ToolCrate's actual rental, review, and claim counts, use a range is admitting the claim rate moves month to month, nail the sanity check is comparing both costs to commission per rental, and direction is naming the claim rate as the lever that actually decides the winner.

And if you want to be sure it really works, try it somewhere elseSame five letters, a fishing cooperative instead of a tool rental marketplace. A different old decision breaks the second estimate.

Herringcove Fishing Cooperative runs dockside cameras that estimate catch weight from photos instead of a hand-tally at the scale. Halden Voss, who runs cooperative operations, was comparing TallyNet, priced per image processed, against Wharfmetric, priced per ton processed plus a flat fee that rises with how many docks run the cameras. Mapped onto BOUND: break it down is cost equals TallyNet's per-image rate times images captured, versus Wharfmetric's flat dock fee plus its per-ton rate times tons weighed. Own the numbers is assuming five docks, about eleven thousand images a month across all of them, and about four hundred tons of catch weighed monthly. Use a range is admitting the tons-per-dock figure varies by season, not a fixed number year round. Nail the sanity check is comparing either cost against the cooperative's own per-ton dock fee revenue, to see if either estimate is plausible. Direction is naming the number of docks running cameras at all as the single biggest swing, since Wharfmetric's flat fee scales with dock count and TallyNet's does not.

Hand sketched metaphor scene titled Comparing prices with no common unit. Left, a blue scale icon labeled Per photo, caption counts every look taken. Right, an orange gauge icon labeled Per outcome, caption counts what got resolved.
Herringcove faced the same two shapes ToolCrate did, just wearing different names.

The old decision here isn't a side-by-side sticker comparison, it's a different reversal: Wharfmetric's dock-tiered flat fee pushed Herringcove to run cameras at only two of its five docks, to keep the flat fee down, which meant the other three docks kept using hand tallies with no photo record at all. That made sense as a way to control cost early. It stopped making sense once those three unmonitored docks became the ones with the least reliable catch data in the whole cooperative.

What would change ToolCrate's vendor pick most
0 Claims rise by 400/month $7,200 Review rate doubles $3,640 Photos per case, 4 to 6 $1,820 Flat fee cut 20% $480
The biggest bar isn't either vendor's price. It's how often a real claim gets confirmed, which is exactly the number neither price sheet shows.

Swap the trigger and it still runs.
Speed: an interviewer caps you at sixty seconds. Say "convert both to cost per unit of your own real volume, then name the swing factor," and stop.
Cost: there's no time to gather a full year of volume data before the decision is due. Say so honestly, and use the best three months you have, flagged as a range, rather than presenting a guess as a fixed number.
The model gets better, for real: if Scuffguard's model gets sharper and flags fewer photos for review, that's still worth re-running the comparison for, since a lower review rate lowers Scuffguard's own cost without changing Ledgerlens's at all.

Where people run it wrong.
They compare sticker prices instead of converting both to the same unit first.
They borrow a vendor's reference-customer numbers instead of running their own real volume through the equation.
They never name which single usage number would flip the comparison, so the pick never gets re-checked as volume changes.

How to use it live. The moment someone hands you two vendors with different pricing shapes, ask: what's the one unit both of these can be converted into, using our own numbers, not theirs? Let that answer decide, not whichever price sheet reads smaller.

Flashcards (tap any card to flip it)

1 · THE FRAMEWORK
What framework fits a calculation question like comparing structurally different vendor pricing?
Tap to flip
ANSWER
BOUND: break it down, own the numbers, use a range, nail the sanity check, direction. FLIPS doesn't fit a pure estimation question.
2 · THE PERSON
Who is this answer about?
Tap to flip
ANSWER
Tomasz Bellweather, product manager at ToolCrate, comparing two AI vendors' structurally different pricing.
3 · THE EQUATION
What's the cost equation, stated in the B step?
Tap to flip
ANSWER
Monthly cost equals any flat fee, plus the per-unit price, times your own real volume of that unit, converted to cost per rental.
4 · THE SHARP QUESTION
What question did the finance lead ask that reframed the whole comparison?
Tap to flip
ANSWER
"What does nine cents even mean here, and where did that number come from?" Nobody had run ToolCrate's own volume through either formula yet.
5 · THE OLD DECISION
What decision would you take back?
Tap to flip
ANSWER
Comparing vendor price sheets side by side without converting either to a shared unit, a habit that worked when every vendor priced the same way.
6 · THE NUMBER
Fill in the blank: at ToolCrate's real volume, Scuffguard costs about ___ dollars a month and Ledgerlens costs about 18,600.
Tap to flip
ANSWER
3,640 dollars, all from per-photo review fees on 2,600 flagged cases at four photos each.
7 · THE REPLAY
Same two vendors, but confirmed claims rise by 400 a month. What changes?
Tap to flip
ANSWER
Ledgerlens's cost jumps by about 7,200 dollars a month. Scuffguard's cost barely moves, since it's priced on reviews, not confirmed claims.
8 · CROSS PRODUCT TRANSFER
Section 4 answers this same question again for a different cooperative. Which one, and what's different about its old decision?
Tap to flip
ANSWER
Herringcove Fishing Cooperative, comparing TallyNet and Wharfmetric. Its reversal is a dock-tiered flat fee that made it ration camera coverage to two of five docks.

Check yourself Score: 0 / 0

True or false
1. True or false: Scuffguard is always the cheaper vendor for ToolCrate, no matter how its volume changes.
  • True
  • False
Show hint
Look at the D step and the sensitivity chart.
Show answer
False. If the confirmed-claim rate keeps climbing, Ledgerlens's cost rises fast while Scuffguard's barely changes, and if the review rate climbs instead, the reverse happens.
Fill in the blank
2. Fill in the blank: converted to cost per rental, Scuffguard runs about nine cents, and Ledgerlens runs about ___ cents.
Show hint
Divide Ledgerlens's total monthly cost by 40,000 rentals.
Show answer
46 cents. 18,600 dollars divided by 40,000 rentals, about five times Scuffguard's per-rental cost.
Multiple choice
3. Why did comparing the two vendors' sticker prices directly fail?
  • A. One of the vendors' prices was a typo.
  • B. The two prices were structured around different units, so they weren't comparable until converted.
  • C. ToolCrate's finance system couldn't read decimals.
  • D. Vendors aren't allowed to publish real prices.
Show hint
Look at the knowledge spark and the B step.
Show answer
B. A per-photo price and a per-claim-plus-flat price only become comparable once both are converted to the same unit.
Short answer, where it wouldn't matter
4. Name a situation where comparing two vendors' sticker prices directly would actually be fine.
Show hint
Look at "what I would leave alone."
Show answer
Model answer: When both vendors price the exact same way, for example both charging a flat monthly fee for the same feature set.
Short answer, apply it yourself
5. Think of two tools or services you've compared that were priced differently, like per-seat versus per-use. What single number would you need to convert them fairly?
Show hint
Ask what unit both tools ultimately get used for, and how much of that unit you actually generate.
Show answer
Model answer: Usually it's your own real usage volume of whatever unit both prices are secretly measuring, not either vendor's list price.
Short answer, the number question
6. If ToolCrate's confirmed-claim rate had been half of what it is now, would Scuffguard still be the cheaper vendor? Why or why not?
Show hint
Notice that Scuffguard's cost depends on flagged reviews, not confirmed claims.
Show answer
Model answer: Yes, and by an even wider margin, since Ledgerlens's per-claim cost would drop but its flat fee wouldn't, while Scuffguard's cost wouldn't change at all.
Before you close the answer
Why this works
Tests whether you can convert two differently shaped prices into one honest comparison using your own numbers, and whether you can name what would flip the answer instead of treating it as fixed.
Follow-up traps
"Couldn't you just ask each vendor to quote you in the same unit?" Response: you can ask, but the vendor doesn't know your own flagged-to-claim ratio as well as you do, so their converted number would still be a guess about your business, not a fact about it.

"Isn't Ledgerlens just a worse deal, period?" Response: not necessarily. If ToolCrate's claim-confirmation rate ever drops sharply, say after a fraud crackdown, Ledgerlens's cost drops with it while Scuffguard's stays exactly the same.
If pressed
The real hidden cost driver for either vendor isn't the price sheet at all, it's how twitchy each vendor's own model is about flagging a photo pair for review in the first place, so ToolCrate now tracks each vendor's monthly review-trigger rate as its own metric, separate from the invoice.
From U2xAI Academy

From answering questions to owning outcomes.

A live workshop where you ship a working AI agent, defend a launch decision, and walk away with a portfolio recruiters can't wave off, not just more questions to study.

  • A live AI agent you actually shipped
  • A launch decision you can defend under pressure
  • An interview-ready portfolio, not more flashcards
Know more