Episode 20 · 2026-11-13

What Did That AI Task Cost?

Nobody hands us an itemized receipt for AI, so most of us reach for the smartest model and guess what it cost.

Robert Alvarez, PhD, a data scientist at Everpure who once taught Sam statistics, on why most of us can't say what an AI task costs, and why the answer starts with our own benchmark, not the smartest model.

Host Sam Rogers · guest Robert Alvarez, PhD, the enterprise data scientist · 29 min

A choice this episode can help with

Which AI tasks deserve the most expensive model, and which are we overpaying for?

The short answer: Most of us can't say what an AI task costs. Start with our own benchmark, pick the cheapest model that passes, and mark any cost the provider didn't report as unknown.

Run it on your own work: The Receipt Ledger, one page, any model.

Watch it below, or read the conversation.

Jump to a moment
  1. 2:20 Every enterprise needs its own benchmark
  2. 8:35 Nobody hands us an itemized receipt
  3. 11:32 The subtraction: what no longer makes sense
  4. 13:58 Intern, generalist, senior developer: matching model to task
  5. 22:54 Keep only provider-reported costs: unknown is honest
  6. 25:56 The Receipt Ledger takeaway

The signals

The subtractions

About this episode

Robert Alvarez, PhD is a data scientist who has worked on AI from storage, from education and at NASA's Frontier Development Lab, and is now at Everpure. Five years ago he taught Sam data analytics and statistics; his courses now reach close to ten thousand students a year.

The cold open is Robert's warning: "You now pay per token. And that's when you're gonna realize how much AI you're really using."

When answers come back wrong, Robert listed the knobs: the retrieval pipeline, chunking, the embedding model, the prompt, or a slightly more intelligent model. He described GEPA, from academic research: a prompt mutated "like a farmer would mutate seeds," with a smarter model reflecting on each round. His closing advice: for a task we run over and over, optimize the prompt until the model is a specialist, and a cheaper model will probably do.

On agents, Robert describes the finished result rather than a step-by-step plan, with Opus as the orchestrator and Sonnet or Haiku subagents, "like you would in an organization." His small team runs a Kanban board where humans write every card and a person steps in whenever an agent finishes or gets stuck, with permissions outside the agent.

One thing to do this week: pick one AI task our team runs every week. Can we say what it costs, and whether a cheaper model would do? Then take our three biggest AI bills through The Receipt Ledger and label every cost counted, billed, estimated or unknown.

Links from the episode:

Want to bring your own signal and subtraction? Find yours.

Transcript

Read the conversation

0:00

Robert Alvarez, PhD: there will come a day. when prices are gonna increase and AI is gonna get more expensive, or you no longer pay for a monthly fee. You now pay per token. And that's when you're gonna realize how much AI you're really using.

0:23

Sam Rogers: Welcome to Signals and Subtractions. I'm your host, Sam Rogers. Every week, everyone here brings two things one signal worth watching, one subtraction worth making, and that's the whole show. What to watch, what to drop. This week, what does any given AI task actually cost? Most of us can't say and reach for the smartest model by default. Because nobody hands us an itemized receipt. Maybe that's okay for. Personal AI subscriptions, but what about when it's the API? Or in enterprise use cases when we're paying per token?

1:01

Sam Rogers: joining me today is Dr. Robert Alvarez. He's a data scientist who's worked on AI from a storage perspective, from an education perspective, and at NASA's Frontier Development Lab. These days he's working at Everpure, but I'm ever grateful for what he was doing five years ago when he taught me quite a lot about data analytics and visualization and probability and statistics and Tableau and the works. Robert, thank you so much for being here.

Read the full transcript

Put it to work

Pick one AI task your team runs every week. Can you say what it costs, and whether a cheaper model would do?

The newsletter

Read the newsletterBy the Pound

One signal, one subtraction, one analogy, in five minutes. It draws on this episode but stands on its own. Every issue.

Keep the next choice in view

One signal, one subtraction and one analogy every Sunday. Five minutes, no video required.