What is the honest way to describe your AI feature's limitations in marketing copy?

Pebblewise is Applewood Learning's AI tutoring app for kids, math and writing both. Magnus Jankowiak, who runs growth, tested a new headline: "One AI tutor. Every subject, automatically personalized." Florabel Eskander, Pebblewise's product manager, owns what the tutoring engine actually does on each side of that claim. Kazimiera Nowosielski is the parent who found out, four days before her son's scholarship deadline, that the two sides weren't the same.

How to answer this, stage by stage

Nobody is grading whether you think marketing copy in general is too aggressive. They're grading whether you can turn "be honest about limitations" into an actual sentence you'd ship.

Let's learn

Pebblewise lives on a tablet at the Nowosielski family's kitchen table, the one with a hairline crack across the corner where Tibor's little sister dropped it back in March. Two things happen on that tablet most weeks: times tables before dinner, and whatever essay is due that Friday.

Five things on the page. Four of them say what the app does. None of them says where a parent still needs to check.

Pebblewise is an app that watches a kid work through math problems and writing drafts, and hands back help on both, right there on the screen. Applewood Learning checked how well it actually does that, on both sides, and the two answers are not close.

On 500 real math problems, checked against a certified answer key, Pebblewise caught the mistake and explained the right method correctly 486 times. That's 97 percent, and it's the number the whole company points to when anyone asks whether the tutoring really works.

Writing is a different animal. Applewood pays a contracted literacy teacher, Zelig Kirchner, to hand-mark a sample every quarter. Her last batch was 40 real drafts from working students. She found an average of six real problems in each one: a thesis that never quite lands, a middle paragraph that wanders off, a claim with nothing backing it up. Pebblewise's own feedback caught an average of two of those six. In 14 of the 40 essays, on drafts Zelig had marked as needing real work, Pebblewise opened with something like "Great structure, nice work."

Two of these five sit on solid ground. Two of them are the model's best guess, dressed up exactly the same way as the other three.

Here's the turn. Missing four problems out of six isn't, on its own, the thing that hurt anyone. Magnus's headline is. "Every subject, automatically personalized" told every parent that writing worked the same way math did. So nobody went looking for a gap the copy never admitted was there.

At its worst, this is Kazimiera Nowosielski two days before her son Tibor's scholarship deadline, reading a note from his actual teacher that flatly contradicts what Pebblewise told them a week earlier: "in great shape, just polish the ending." They had budgeted two hours for a polish. They had four days left, and a middle section that needed to be rebuilt.

The lesson: "automatically personalized" is not one claim. It's two, wearing the same three words. If a model does two genuinely different jobs, the copy has to say so twice, not once, or somebody finds out the hard way, at exactly the moment it matters most.

Now here is the same thing as a story

Stage six above compresses this into four sentences. Here's the six months underneath, the part a stand-up answer skips.

Florabel Eskander has spent three years owning what Pebblewise's tutoring engine actually does, not what it's supposed to do. She can tell you, without opening a dashboard, which grade levels struggle with fractions and which ones struggle with topic sentences, because she reads the model's own accuracy numbers most mornings before her coffee's gone cold.

Six months ago, Magnus Jankowiak, who runs growth, tested a new headline on the landing page: "One AI tutor. Every subject, automatically personalized, so your child gets exactly the help they need, the moment they need it." Signups jumped. Trial-to-paid conversion went from 2.6 percent to 3.5 percent inside three weeks, the best number the page had ever posted. The line went everywhere: the hero, the app store screenshots, the welcome email. Nobody thought twice, because nothing in the numbers said to.

Four of these five months looked completely fine, if the only thing you were watching was the average.

For three months, that looked exactly right. Math-heavy families reviewed the app well and stayed. Writing-heavy families seemed fine too, at least in the one number Florabel was watching then, a single blended churn rate for the whole app.

Parents who leaned on the writing feature did what new users always do at first: they read Pebblewise's notes on their kid's draft, then read the draft themselves, just to check. After a few weeks of the notes sounding right, most stopped reading the draft first. By month three, most weren't reading it at all. The headline had told them they didn't need to.

In month four, on an ordinary Thursday, Lennox Quirke, three weeks into the support job, forwarded Florabel a batch of five cancellation notes. He didn't flag it as urgent. He just wrote, "these all say almost the same thing, is that normal?" Four of the five used some version of the same sentence: the app said it was basically done.

Florabel pulled the churn number apart by feature that afternoon, not by the whole app. Math-heavy families were churning at 3 percent, flat, same as month one. Writing-heavy families had climbed from 4 percent in month one to 9 percent in month four, quietly, underneath a blended average that had barely moved.

Neither person here did anything wrong. Only one of them could see the whole page before it went out.

One of the five notes was from Kazimiera Nowosielski. Her son Tibor, eleven, had a scholarship application essay due that Friday. Pebblewise's feedback on his draft, five days earlier, opened with "In great shape, just polish the ending." His actual teacher read the same draft two days later and said the middle section didn't support his thesis at all. Kazimiera had budgeted two hours for a polish. She had four days left, and a real rewrite in front of her.

Florabel ran the writing audit that weekend, the one Zelig Kirchner runs every quarter. Forty real drafts, hand-marked, an average of six genuine problems per essay. Pebblewise's feedback caught two of those six, on average, and in fourteen of the forty cases opened with encouragement despite the real problems sitting right there in the draft.

The decision Florabel would take back sits six months earlier, in a fifteen-minute meeting about the new headline. Magnus showed the conversion lift. Someone asked if "automatically personalized" was accurate for writing too. Florabel said the writing model was "directionally fine" and the meeting moved on. Nobody asked directionally fine by what measure, because nobody had run the audit yet, so there was no number to ask about.

So here's the replay. Same six months, honest copy from month one: "Math: instant and adaptive. Writing: a fast first pass, reviewed by you or a teacher before it's final." Landing conversion settles at 3.1 percent instead of 3.5, a real but small cost. Writing-heavy churn never climbs past 4 percent, because parents like Kazimiera are already reading Tibor's draft themselves, the way the copy told them to. His scholarship essay gets a real teacher's read nine days before the deadline instead of two.

One design tells a parent nothing, so their trust has nowhere to break cleanly. The other tells them exactly where it can, so it never does, quietly, at the worst possible moment.

What I'd tell myself, back in that fifteen-minute meeting: "directionally fine" isn't an answer, it's a guess wearing a confident voice. If I didn't have the number, I should have said so, out loud, instead of letting the meeting move on.

What GUARD actually catches in one headline

This was never really about whether Applewood lied. GUARD is for naming who carries the real risk when one word covers two very different truths, and turning that into a rewrite you'd actually ship.

Four of these five steps happened exactly as the copy was written to make them happen. The missing one, a plain warning, was never built.

Four lines. None of them apologizes for what Pebblewise can't do yet. They just say it.

And if you want to be sure it really works, try it somewhere else

Same five letters, a home-appliance diagnosis app instead of a tutoring one, and this time the unscoped word is "any."

Wrenchly, built by Farnsworth Diagnostics, reads a photo of an appliance's error code and a few follow-up questions, then tells a homeowner what's actually broken before a technician shows up. Gunnar Hakonsson owns Wrenchly's diagnosis model the way Florabel owns Pebblewise's tutoring engine.

Same three branches Applewood faced, a different appliance. The honest branch is the only one that survives a customer's own off-brand dryer.

Guglielmo Grimaldi, who runs growth at Farnsworth, tested a new app store line: "Wrenchly diagnoses any appliance, instantly, no technician needed." Downloads jumped. What the line left out: Wrenchly reads digital error codes from six major brands correctly about 94 percent of the time. On older analog dials and off-brand units with no digital code at all, its guess rate drops to around 40 percent, barely better than naming the most common cause.

Same rank, mapped onto Wrenchly: name the real split in the app store copy itself, not a support article. "Reads digital error codes from major brands instantly. For older or off-brand appliances, Wrenchly gives its best guess, confirm with a technician before buying a part." Track refund requests split by appliance age, the same way Florabel split churn by subject, since a blended refund rate would hide an old-dryer cohort quietly asking for its money back.

Swap the trigger and it still runs.
Speed: an interviewer caps you at ninety seconds. Skip straight to it: name the real scope in the headline, not the footnote. A blanket claim isn't free, it just charges you later, in churn.
Cost: no budget to rebuild the whole copy deck this quarter. Start with the two lines a parent, or a homeowner, actually reads before buying: the headline and the first screenshot. Scope those two first.
The model got better, for real: say Pebblewise's writing feedback jumps to catching five of six problems next quarter. That's a reason to widen the claim on purpose, with a new audit backing it up, not a reason it should have been claimed six months early.

Where people run it wrong.
They treat this as a moral question, honest versus dishonest marketing, instead of a scoping question about where the model is actually strong.
They fix the copy once, after a complaint, instead of tracking the split number that would have shown the gap widening months earlier.
They let growth alone decide what the copy claims, when the actual claim is a product judgment about what the model can back up.

How to use it live. Before answering, ask yourself out loud: "does this word mean the same thing in every case it's applied to?" Say the answer for the specific case in the question, and the honest scope almost always falls straight out of it.

Flashcards (tap any card to flip it)

Check yourself Score: 0 / 0