Independent buyer side advisory · Anthropic onlyNew York · London
Home · Blog · Token Optimization
Token Optimization

How Verbose Responses Inflate Your Anthropic Bill

Buyer side analysis · About 9 minutes · The Counteroffer desk

Here is a fact that quietly governs your Anthropic bill: output tokens cost several times more than input tokens. Every word Claude writes back is priced at a premium over every word you send in. Most teams know this in the abstract and ignore it in practice, which means they pay the premium thousands of times a day for output they never needed. Verbose responses are not a quality problem. They are a cost problem, and on a high volume application they are one of the largest and most invisible line items you carry. This is the buyer side view of how verbosity inflates your bill and how to cut it without losing anything that matters.

We negotiate Claude contracts for enterprise buyers and optimize the token spend underneath them. Output verbosity is one of the first things we look at, because it is common, it is large, and it is almost always fixable with changes that improve the product rather than degrade it. A shorter, sharper answer is usually a better answer as well as a cheaper one.

Why output is the expensive half

Claude pricing meters input and output separately, and output carries a materially higher rate per token. The reason is structural to how the model generates text, and it is not something a buyer can negotiate away at the token level. What you can change is how many output tokens your application produces. Because the output rate is the high one, a reduction in output volume drops straight to the part of your bill that costs the most per unit. Cutting a thousand output tokens saves more than cutting a thousand input tokens, every time.

This inverts the instinct many teams have, which is to obsess over the size of their prompts. Input matters, and we treat it, but the prompt is the cheap half. The response is the expensive half, and the response is the half that grows uncontrolled when nobody is watching, because verbosity feels like helpfulness and helpfulness feels free. It is not free. It is the premium rate, paid on every interaction.

Input is the cheap half of the bill. Output is the expensive half. Verbosity spends your money on the expensive half by default.

Where verbosity hides

Verbose output accumulates in predictable places. The most common is the unrequested preamble and postamble, where the model restates the question, explains what it is about to do, and then summarizes what it just did. None of that is the answer, and all of it is billed at the output rate. Another is over explanation, where a one line answer arrives wrapped in three paragraphs of justification the user did not ask for. A third is format bloat, where responses come back in elaborate structures when a plain value would do.

The most expensive case is structured output that carries more than the consumer needs. An application that asks Claude for a classification and receives a classification plus a paragraph of reasoning plus a confidence narrative is paying output rate for two pieces of text it discards. Multiply that across millions of calls and the discarded verbosity becomes one of your larger costs, paid entirely for content that never reaches a user or a downstream system.

The levers that cut output

Cutting output is mostly a matter of asking for less and constraining what you get. The simplest lever is an explicit instruction to be concise, to answer directly, and to omit preamble and restatement. Models follow these instructions well, and the savings begin immediately. The next lever is setting a maximum output length appropriate to the task, so a response cannot run away even when the instruction is ignored. A cap is a hard ceiling on the expensive half of every call.

For programmatic use, the strongest lever is demanding structured output that contains only what the consumer uses. If your code needs a category, ask for the category and nothing else. If it needs three fields, define exactly those three fields. Tight output schemas eliminate the discarded verbosity that pure prose invites, and they make the response cheaper and easier to parse at the same time. The cost win and the engineering win point the same direction.

The verbosity checklist

  • Instruct for concision. Tell the model to answer directly and skip preamble, restatement, and summary.
  • Cap the length. Set a maximum output appropriate to the task so no single call runs away.
  • Constrain the format. For programmatic use, define a tight output schema that carries only what the consumer needs.
  • Match the model. Do not pay Opus output rates for work a lighter model handles, where the rate per output token is lower.
  • Measure output ratios. Track output tokens per call and watch for the calls where the expensive half is largest.

Model choice multiplies the effect

Verbosity and model selection compound. Output tokens cost the most on the most capable model, so verbose responses on Opus are the most expensive text your application can produce. Routing work to the right model in the Claude family, reserving Opus for the tasks that genuinely need it and sending the rest to Sonnet or Haiku, lowers the output rate on the bulk of your calls. Combine right sized models with disciplined output length and you attack the bill from both directions at once: fewer expensive tokens, at a lower rate.

This is why we treat verbosity as part of a wider optimization rather than a standalone fix. Model routing across Opus, Sonnet, and Haiku typically cuts aggregate spend 40 to 70 percent versus running everything on Opus. Prompt caching returns up to 90 percent on stable input. Batch runs asynchronous jobs at 50 percent. Output discipline sits alongside these and reinforces them, because every one of them is cheaper still when the responses are tight.

Free download

The Token Optimization Field Guide

Verbosity is one lever in a complete playbook. Our field guide covers output discipline, model routing, caching, and batch, with the buyer side numbers that show what each one returns.

Get the Token Optimization Field Guide

Concision usually improves the product

The objection we hear is that cutting output will hurt quality, that users want thorough answers and trimming them will feel curt. In practice the opposite is usually true. Most users want the answer, not the journey to it. A response that opens with the conclusion and stops when the work is done reads as more competent, not less, and it arrives faster because there are fewer tokens to generate. The verbosity you are paying for is frequently the verbosity your users are skimming past to find the part that matters.

There are genuine cases where length is the value, a detailed explanation, a thorough document, a careful analysis, and those should stay long. The point is not to make everything terse. It is to stop paying output rate for length nobody asked for and nobody reads. Match the length to the need, and the cases that deserve depth keep it while the cases that were merely padded get cheaper.

A worked example of the cost

Consider a classification feature that runs at high volume, sending each item to Claude and receiving back a category. Built carelessly, the response comes back as a paragraph: it restates the item, explains the reasoning, names the category, and offers a confidence note. The code that consumes the response parses out the single category and discards the rest. Every one of those discarded words was generated at the output rate, the expensive half of the bill, and the feature pays for them on every call, millions of times over.

Now constrain the same feature to return only the category, as a single value in a tight schema. The output per call collapses to a fraction of what it was, and because output is the premium half, the saving on that feature is large and immediate. Nothing of value is lost, because nothing of value was being used. The reasoning paragraph was never read by anything. This is the typical shape of a verbosity problem: not a dramatic mistake, just a default that quietly bills premium rate for content that goes straight to the discard pile.

Scale that pattern across an estate of features and the aggregate is one of the larger savings available, often without touching model choice, caching, or batch at all. Verbosity is the lever that costs the least to pull, because tightening output is usually a small change to a prompt or a schema, and it returns on every single call from then on.

How to find your verbosity

You cannot fix what you cannot see, so the first step is to measure output tokens per call, broken down by feature, and rank the features by how much output they generate relative to the value they return. The features at the top of that ranking, high output volume serving a thin slice of actually used content, are where the verbosity money sits. A feature that returns a paragraph when its consumer needs a word is visible the moment you look at the ratio, and it is almost always cheaper to fix than to keep paying for.

Then sample the actual responses. Read what the model is sending back and ask, line by line, whether each part reaches a user or a downstream system or whether it is generated and discarded. The preamble, the restatement, the confidence narrative, the closing summary, all of it is suspect until proven useful. What survives that scrutiny is the response you actually need, and the gap between that and what you are currently generating is the verbosity you are paying for.

Find it before you negotiate

Verbosity also matters at the contract table, because the size of your commitment should be based on efficient consumption, not bloated consumption. If you forecast your Claude commitment from a baseline full of unnecessary output, you commit to volume you have not yet engineered away, and unused commitment on Anthropic generally does not roll over. Trim the output first, measure the real consumption, and commit to that. A buyer who optimizes verbosity before negotiating walks in with a smaller, cleaner number and more leverage to hold the rate.

Your Anthropic number is negotiable.

Get a quote for a bounded engagement. Fixed fee or gainshare, no risk to you.

Get a Quote

The Counteroffer

Weekly intelligence on Anthropic pricing moves and the buyer side counters that work.

Get a Quote · Book a Strategy Call · The Counteroffer · Blog · New York · London Not affiliated with Anthropic PBC. Independent buyer side advisory only.