Independent buyer side advisory · Anthropic onlyNew York · London
Token Optimization

The optimization backlog worth funding first.

Every Claude bill hides a dozen possible optimizations. Only a few are worth doing now. This is how to rank the backlog by dollars freed against effort, and fund the work that pays for itself fastest.

Buyer side analysis · 8 min read
34%
Average reduction in Claude spend
$40M+
Anthropic commitments advised
100%
Anthropic focus, no other vendor

When a team finally decides to bring its Claude spend under control, the first instinct is to fix everything at once. That is the wrong move. Optimization work competes with every other engineering priority, and the way to win that competition is not to present a long list of possible savings but a short list ranked by what each one frees against what it costs to do. The optimizations are not equal. Some return large savings for a day of work. Others return a little for weeks of effort. A backlog that is funded sensibly does the first kind before the second, banks the savings early, and uses the proof to justify the rest. Here is how to build that backlog and which items usually belong at the top.

Rank by dollars freed against effort

The only ranking that matters is annual dollars freed divided by engineering effort to capture them. Every candidate optimization gets two estimates: how much it takes off the yearly bill, and how much build time it needs. Sort by the ratio and you have your backlog. This sounds obvious, yet most teams skip it and work on whatever is most interesting or most recently complained about. The ranking forces the conversation finance wants, which is payback period, and it almost always reveals that two or three items account for the majority of the achievable saving. Fund those first, prove the model, and the rest of the list becomes far easier to resource.

The items that usually top the list

Across most enterprise Claude deployments, the same handful of optimizations sit at the top of the ranking because they free large dollars for modest effort.

  • Model routing. Moving work off Opus onto Sonnet or Haiku where quality holds is the single largest lever, typically cutting aggregate spend 40 to 70 percent. The effort is mostly classification and routing logic, not new infrastructure, so the payback is fast.
  • Batch migration. Moving asynchronous workloads to the batch path takes roughly half off their rate. For genuinely async work the engineering is a submission and retrieval flow, modest against the saving.
  • Prompt caching. Caching large stable context, long system prompts, reference documents, returns up to 90 percent off the repeated portion. On high volume workloads with shared context this pays back almost immediately.
  • Output length control. Output tokens cost several times more than input, so trimming verbose responses with clear instructions and limits frees disproportionate dollars for a prompt change rather than a build.

These four are at the top of most backlogs because they share a profile: large recurring saving, low to moderate build effort, no loss of quality when done with care. They are also the optimizations that compound, since routing, caching, and batch stack on the same workload.

The items that usually wait

Lower on the list sit the optimizations that return less or cost more to capture. Deep prompt compression that risks quality, bespoke per workload tuning, speculative techniques that need careful validation, and infrastructure rewrites all tend to have worse ratios. They are not wrong to do eventually, but funding them before the high ratio items is how optimization programs lose credibility, because they consume effort without showing the early savings that justify continued investment.

Fund in waves, prove as you go

The right way to fund the backlog is in waves rather than as one large project. The first wave takes the top two or three items, the ones with the best ratios, and ships them quickly. The savings show up on the next invoice, which funds and justifies the second wave. This staged approach beats a single big bet for two reasons. It de risks the work, because each wave is small and provable. And it builds the evidence base that finance and the vendor both respond to, since a documented, measured reduction in spend is exactly what strengthens the next commitment negotiation. Optimization done before you sign means a smaller commit, less exposure to unused commitment, and more room to move the rate.

Estimating the two numbers

The ranking depends on two estimates per item, and both can be made well enough without a research project. For dollars freed, look at the share of spend the workload represents and the realistic reduction the optimization delivers on it. Moving a workload that is ninety percent on Opus down to Sonnet where quality holds frees a large, calculable amount. Caching a stable context that prefixes every call in a high volume workload frees up to ninety percent of that repeated portion. These are arithmetic, not guesswork, once you know the workload's spend. For effort, the honest unit is engineering weeks to ship and validate, including the testing that proves quality held. The two estimates do not need to be precise to three decimals, they need to be good enough to sort the list, and a rough ratio is enough to tell the day of work that frees six figures from the month of work that frees a little.

Validate quality, not just savings

Every item on the backlog carries a quality risk that has to be checked, because a saving that degrades the output is not a saving, it is a hidden cost. Routing a workload to a cheaper model is only a win if the cheaper model handles it well, which means testing on real cases before the change is permanent. Trimming output length is only a win if the shorter response still does the job. Caching is the safest of the levers because it does not change the output at all, which is part of why it ranks so well. The discipline is to pair every funded optimization with a quality check, so the dollars freed are real and defensible rather than a number that quietly costs you in rework or user trust later.

Keep the backlog alive

A backlog funded once and forgotten goes stale, because the spend keeps moving. New workloads ship, adoption grows, and the mix shifts, so an item that ranked low last quarter can rise as the workload behind it scales. The practice that works is to revisit the ranking on a regular cycle, refresh the dollars freed estimates against current spend, and re sort. This keeps the team working on the highest payback item at any given time rather than on a list that reflects last year's bill. It also means the optimization program becomes a standing capability rather than a one time cleanup, which is what continuous control of a growing AI bill actually requires.

Tie the backlog to the contract

The last step is to connect the backlog to the commercial picture. The savings from the top items lower your baseline spend, and that lower baseline is the number you should carry into a commitment negotiation, not the unoptimized one. A team that optimizes first and commits second pays for less and exposes itself to less. This is why we treat the optimization backlog and the contract as one piece of work rather than two. The engineering frees the dollars, and the negotiation locks in a deal sized to the optimized reality.

Where this fits

The backlog is the practical front end of a full optimization program. For the detail behind each lever, read the pillar guide, the token optimization playbook, and get a quote so we can audit your spend, rank your backlog by payback, and fund the work that pays for itself first.

Want this backlog built and priced for you?

Get a quote and we will audit your Claude spend, rank the optimizations by payback, and tell you what to fund first.

Get a Quote
Get started
Tell us what you are negotiating.

The Counteroffer

Weekly intelligence on Anthropic pricing moves and the buyer side counters that work.

Get a Quote · Book a Strategy Call · The Counteroffer · New York · London Not affiliated with Anthropic PBC. Independent buyer side advisory only.