Cindy Zhu.
Free guides
Power-user Claude

Run your own Claude model head-to-head test

Hey, it's Cindy 🌱 This is the two-minute test I run from my phone to settle it myself, no benchmark screenshots required. You run the exact same prompt on two models.
btw the waitlist for AI System Club is now open! If you're keen on using AI to automate your content, video editing, job search, business or build AI agents, feel free to sign up (only if you want to hehe). Ps. the waitlist gets first dibs:)
the setup

What this does

This turns Claude into its own judge. Instead of trusting a stranger's benchmark, you give two different Claude models the identical task, then a third chat scores them side by side so you can see which model actually wins for the kind of work you do.

🎯 What it is A controlled A/B test where the only variable is the model.
🧪 When to use it Any time a new model launches, or when you are deciding whether it is worth paying for the smarter (pricier) model for a specific job.
⚠️ Heads-up: it is a taste test, not a lab benchmark. Great for your real use cases, not a substitute for formal evals.

pick your two

The current Claude lineup (so you pick the right two)

As of July 2026, here is the real lineup straight from Anthropic's model docs. Pick one "smart" model and one "fast" model to compare.

  • 🧠 Claude Opus 4.8 is the top everyday model for complex work, priced at $5 in / $25 out per million tokens.
  • ⚡ Claude Sonnet 5 is the best balance of speed and intelligence, $3 in / $15 out (intro pricing $2 / $10 through 31 Aug 2026).
  • 🪶 Claude Haiku 4.5 is the fastest and cheapest, $1 in / $5 out.
  • 🚀 Claude Fable 5 is Anthropic's most capable released model for long-running agents, $10 in / $50 out.
  • 📖 Source: Anthropic models overview and pricing.
A good default matchup is Opus 4.8 (smart) vs Sonnet 5 (fast). If you want the absolute ceiling, put Fable 5 on the smart side.

step one

Step 1: open two chats, one per model

Open the Claude app (or claude.ai), start a new chat, and use the model picker to select your smart model. Start a second new chat and pick your fast model. Keep them separate so nothing bleeds between them. On mobile the model picker sits at the top of the chat, and you can switch models per chat.


step two

Step 2: run the exact same prompt in both

Use ONE real task you actually care about, not a toy. Paste the identical prompt into both chats. Same words, same context, same attachments. If you change even one line, the test is contaminated.

🎯 the identical task
Rewrite this into a high-converting landing page hero section for [what you sell], for [who it's for]. Give me a headline, a one-line subhead, and one CTA button label. Keep it specific and benefit-led, no fluff, no em dashes.

Swap the landing page for whatever your real work is: a tricky client email, a bit of code, a caption, a cold DM, a SQL query. The point is to test the model on YOUR job, not a generic demo.


step three

Step 3: make Claude grade both outputs

This is the part people skip. Open a third chat, paste both answers in, and let Claude judge them against your actual goal.

⚖️ the grader
Here are two outputs for the same task from two different models. My goal is [what a great result looks like: converts cold traffic / sounds like me / passes to a junior dev with no edits]. Grade each one out of 10 on that goal, tell me exactly where each one wins and loses, and pick the one you'd actually ship. Be blunt, don't flatter either.

Because both outputs came from the same task, the grading is apples to apples. You will often find the "worse" model wins on your specific job, which is the whole point.


the fun one

Step 4: the visual version (the lava lamp test)

For a fast, fun gut-check, ask each model to build the same little thing and just eyeball which looks better.

🌋 the lava lamp test
Build a single-file HTML page with a realistic animated lava lamp: blobs that slowly rise, merge, split, and sink with soft physics and a warm glow. No libraries, just HTML, CSS and JS. Make it look genuinely believable.

Run it in both models, open both previews, and compare the physics. Animation and UI quality is one of the fastest ways to feel the gap between a smart model and a fast one.


The honest catch: the smart model costs more usage

This is the real trade-off the reel flags. The most capable models cost more per token (Opus 4.8 is $5/$25 vs Sonnet 5 at $3/$15, and Fable 5 is $10/$50), and on the Max plan there is even a separate weekly usage cap for Sonnet vs an all-models cap, because heavier models burn through your allowance faster.

  • 💸 Source: Anthropic pricing and what the Max plan includes.
  • 🧠 The rule of thumb: save the smart model for the hard, high-stakes builds. Let the fast model handle your daily reps so you do not blow through your usage on low-stakes work.

go further

3 bonus prompts to run next

1 · the consistency check
Consistency check: Run my task 3 times on the same model. Show me all 3 outputs and tell me how much they vary. I want to know if this model is reliable for me or a coin flip.
2 · cost vs quality
Cost vs quality verdict: Here are outputs from Opus 4.8 and Sonnet 5 for the same task. The smart one costs more usage. Tell me honestly, is the quality jump worth the extra cost for THIS kind of task, or is the cheaper model good enough?
3 · build your rubric
Build my test rubric: I keep testing new models on my work. Write me a reusable scoring rubric for [my main use case] with 5 criteria and a 0-10 scale, so every future model gets judged the exact same way.

the craft

How to get the most out of it

  • 🌱 If you're newer: just do Step 1 to 3 once with a real task. Seeing two models disagree on your own work teaches you more than any comparison video.
  • 🚀 If you're a power user: save your grading prompt and rubric inside a Claude Project so every new model launch is a two-minute re-test, not a rebuild. Keep a little running note of which model wins which job.

skip it when

When not to bother

  • 🧭 For quick, low-stakes tasks (a rephrase, a quick summary) the fast model is almost always fine, no test needed.
  • ⏱️ Model quality shifts between releases, so re-run the test when a genuinely new model drops, not every week.
the waitlist is now open

AI System Club is launching soon

Build AI systems with me through recorded lessons you can follow at your own pace. Join the waitlist for first access and the founding price.

btw this list gets first dibs
the moment doors open :)