Hacker News

NikZaal
Claude Code regularly sends each background agent’s transcript to its model gist.github.com

AlexErrant2 hours ago

While we're modding Claude Code, Anthropic includes your email in the system prompt and Opus _constantly_ includes it in request headers.

https://www.reddit.com/r/ClaudeCode/comments/1xhqvzn/opus_55...

You can remove it with a simple plugin https://github.com/AlexErrant/claude-code-no-email/blob/main...

justech41 minutes ago

Not to defend Claude here but the only instances this happened was when

1. It was said to be required (e.g. Searching through SEC)

2. Politeness policy (Wikimedia's bot policy and Crossref's "polite pool" ask automated clients for contact details)

So I think it wasn't because of malicious reasons as far as I can tell.

I did instruct Claude to never do it again except for the politeness policy. I'm assuming WikiMedia requested this so that they have someone to contact in case a bot overloads their servers

AlexErrant17 minutes ago

Are you telling me with a straight face that the stochastic parrot has only ever sent emails in request headers to ONLY the SEC and Wikipedia and no other sites???

Come on.

I caught it sending my email to two non-Wikipedia/SEC sites (which I won't specify because they're work related.) I only found out because I held a "retro" with the agent, then found the other session after grepping my logs.

kardos18 minutes ago

Instructions are not guardrails. Best case, that just makes it less likely to do it

[deleted]9 minutes agocollapsed

franticgecko32 hours ago

Claude Code burning a large amount of tokens for no good reason is a headline we've seen more than a few times now.

Time to start questioning the motivations of model providers shipping their own harnesses.

bronlund2 hours ago

It's not really a secret, the answer is profit. And in the part of the world where this provider is from, greed is reckoned as a good thing.

weird-eye-issuean hour ago

I disagree because with their subscriptions and people using Opus I doubt the majority of users are hitting their limits often so this would just burn compute on their end

bronlundan hour ago

They need to prove there is a demand in order to attract more funding. Funding they are completely depended on.

queenkjuulan hour ago

Enterprises pay API rates though and they account for the vast majority of revenue

weird-eye-issue37 minutes ago

The vast majority of revenue from Claude Code or from their integrating the API in their own apps?

sshine5 minutes ago

API vs. Subscriptions

I don’t know if there’s any openly available statistics on how API costs divide between Claude Code, Claude SDK, raw API, and via OpenRouter.

akstan hour ago

It leads to the same thing (but probably better spells it out), but the answer is entry barriers to competition which in the long run translates into less competition in the long run and greater profitability

pants2an hour ago

Really? Because you'd think for profit they would want to minimize token burn and therefore get away with lower limits on their plans

bronlundan hour ago

This is not about the bottom line, it is about proving to the marked that there is a demand - in order to attract more funding.

adwnan hour ago

That only applies to subscriptions. Enterprise customers pay API rates and therefore per-token. Being wasteful would directly increase Anthropic's profit, assuming they're not selling them at a loss.

HeavenFox3 hours ago

If they are literally sending the entire transcript and asking for a summary, wouldn't almost all of the tokens be cache hit, and therefore fairly cheap?

minraws3 hours ago

I don't want to sound rude but even at cache hit you are burning almost input * 0.10 * context amount of tokens multiple times.

If it happens 10 times you have already accepted the same cost as the entire session fresh prefill.

People on HN are either too rich or wayyy too rich

odo124216 minutes ago

But you also burn the exact same number of tokens (actually more) every time the model makes a tool call. It's an agent, it makes a lot of tool calls.

RockRobotRock2 hours ago

Who pays for their own tokens at full price?

cheesefacean hour ago

All Claude Enterprise customers.

serf2 hours ago

given that the subsidized plans from all companies are getting worse by the hour it's probably a smart thing to consider, at least.

simianwords3 hours ago

Isn’t it 0.2?

minraws3 hours ago

It's 0.1 I think brain fart I typed the rest correctly though after 10 summaries you still burn the same amount of tokens

simoncionan hour ago

A cheap operation adds up to a large cost if it's done enough times. TFA even talks about caching.

Do you disagree with the numbers and conclusion in the -pretty obviously bot-generated- Fine Article?

buzer3 hours ago

Didn't they change the cache TTL to 5 minutes earlier this year? So depending on exact timing it could potentially be invalidated between the updates.

skeledrew2 hours ago

If you're using the API, I think. It's an hour when using Claude Code.

maxbond2 hours ago

It's an hour. It'll tell you the expiry time on the status line now but that information is also available in /usage.

buzer2 hours ago

https://github.com/anthropics/claude-code/issues/46829

Looks like what I remembered was a bug.

dietr1ch3 hours ago

Unless they prepend something like, "summarise this, "

NewsaHackO3 hours ago

But they definitely wouldn’t do that.

gym3 hours ago

I was surprised the usage issue wasn't mentioned here before this based on my searching on hn.algolia.

I'm on pro. Two days ago, 100% 5 hour was using 25% of my weekly. Today, 100% 5 hour is like 13% so something was fixed.

throwup2382 hours ago

This is (still) happening to three of my four 20x Max accounts and by all accounts it seems they’re getting short changed on total weekly quota.

They’ve got that IPO coming up so they’re turning up the fraud in preparation.

James872115 minutes ago

How do you use up all the tokens on four 20x Max accounts. That's really impressive.

mirsadm36 minutes ago

That assumes they know what is going behind the scenes. The whole company is vibe coded at this point.

bombcar3 hours ago

They very aggressively compact when the cache is about to expire, which saves a ton of tokens, the equivalent of doing a handoff at 25% or less.

adastra223 hours ago

I assume that is only if compact is turned on? I never use compaction.

SyneRyder3 hours ago

They enabled it for everyone in a recent Claude Code update, but you can turn it off (I did).

I am definitely getting frustrated with a lot of the changes they keep making in Claude Code. It's one thing to find settings have changed during your next interactive session, it's another when it changes how overnight unattended sessions behave. I really should be spending more time building my own harness again.

Matticus_Rex2 hours ago

Check your idleCompaction line in /config to make sure it's off -- several times they've toggled new features on by default for me. This one isn't in the VS Code extension so I don't know if it shipped default-on.

OsrsNeedsf2P3 hours ago

This is an A/B test

grim_io3 hours ago

More likely it depends on the overall load of the infrastructure.

dozerly2 hours ago

This is the harness’s job. Incentives are not aligned for inference providers to own the harnesses.

jakozaur3 hours ago

I tested it, and it looks real but more nuanced. It is just for subagents; workflows do not seem affected. I guess many new users prefer workflows (ultracode), so the impact is less than the report suggested.

Moreover it is mostly cached reads, so subagents with short context cost little, while long-context ones cost much more.

In my Claude Code sessions, it looks more like ~8% at most.

lemming3 hours ago

I mean… 8% still seems pretty indefensible, especially if you can’t turn it off. That’s a big chunk of usage.

chii3 hours ago

any % is indefensible, because this should be user toggled. It's an unnecessary money burner.

[deleted]2 hours agocollapsed

_boffin_2 hours ago

Just looked and we're burning around ~3%, but that's across everything / everyone.

creamyhorror3 hours ago

Background agents only have 5 minutes' cache TTL, but I'm guessing this doesn't help extend it (not that it would be too useful anyway, especially considering the extra burn).

Also, the claim "15-20% of your tokens" seems unclear; of all tokens, or of tokens spent on background agents? Poorly edited AI writing strikes again!

messh3 hours ago

Bloat. I like Pi much better with it's minimalism

fractorial3 hours ago

As someone who rolled and daily drives a harness leaner than Pi, there’s still a use case for both.

Similarly to “one language is best,” saying “one harness is best” is shortsighted in the best possible case.

That being said, Claude Code is bloatware.

Zizizizzan hour ago

Can pi be used with Claude on an enterprise sub?

fredoliveira14 minutes ago

Doesn't an enterprise account already use API rates? If that's the case, there's no difference. You'll end up paying less because Pi will typically use less tokens for the same texture of requests.

xyzsparetimexyz33 minutes ago

Claude code has to be the worst harness I've ever used. Has anyone figured out how to rip the subscription auth/verification out so that it can be used within Pi yet?

ab_wahab012 hours ago

Does this happen in the VS Code extension? or only in the terminal?

nikolay2 hours ago

Opus 5.5 burns tokens like there's no tomorrow! Meanwhile, GPT 6.1 Sol on Extra High feels unlimited! Opus (on Max 20x) munches my weekly quota in a day, or two at best. Meanwhile, working with Codex and reviewing with a $50/mo Muse Code Wonder Full seems like it can go own forever (on the same codebase, the same skills, etc.) I am highly disappointed by the overly glorified Opus and Claude Code in general - there's no commit in which Codex or Muse Code or GitHub Pilot don't find critical flaws! I have long sessions of Claude Code having over 100 review cycles of Codex and still not addressing all the valid issues that Codex finds in Claude Code's work! Claude Code keeps injecting British English into prose and identifiers with nothing being able to stop it! Of course, there are almost never resets for Claude Code either - they would rather me focus on Codex being my primary and Claude Code being the reviewer (it works much better than in reverse). Anyway, enver trust a single model! Always review with another frontier one!

deadnomorean hour ago

100 review cycles sounds like a lot of arbitrary churn, I can get most models to review and endlessly find things to “improve”

thunfischtoastan hour ago

If you tell a model to find flaws, it will find flaws. What qualifies as critical to you?

xyzsparetimexyz38 minutes ago

What on earth are you working on that you're burning this many tokens? i can survive the regular 1x pro subscription just by using Opus on low and not medium/high

apt-apt-apt-apt3 hours ago

At least they seem to have fixed their free-revenue feature-bug, where they randomly invalidate your cache (~$8 a pop (turn))

lifeisloving3 hours ago

This is by design, its the same reason inference providers on Openrouter will advertise super cheap pricing but cache TTLs of 2 min/ 70% hit rate.

Cache rules everything around me.

adamsmark2 hours ago

Hey, letting you know I'm stealing your quote about CREAM. It'so absurd.

Implicatedan hour ago

About 6 months ago I embarked upon building a little mac native app to monitor all my claude code sessions and alert me/surface sessions that were going to go stale so I could go ping them if I wanted to keep things cached. I named it CREAM.

That eventually grew into what is now my 'software factory' and I've realized, eventually, it's still C.R.E.A.M. (I named it flower) but it's _context_ rules everything around me.

leroman2 hours ago

At the base there is a conflict of interests- what we pay for

poisonborzan hour ago

Claude lovers tend to be either early adopters not well informed/lazy to experiment ("why, it's still the best, right?"), or millionaires or devs with unlimited budgets, who often ask on HN "why would you use anything else than Opus on xhigh".

I was handed 150$/mo budget and no subs, and while it was frustrating at first, with better tooling, context management and especially OAI models it's a breeze now and not even using 70% mostly while achieving a lot in a small team.

Having limited resources teaches you a lot.

[deleted]40 minutes agocollapsed

mirmor23an hour ago

> I was handed 150$/mo budget and no subs, and while it was frustrating at first, with better tooling, context management and especially OAI models it's a breeze now and not even using 70% mostly while achieving a lot in a small team.

It's great that the project/team you were in had skills/cycles to do it.

In many cases this is pure yak shaving so to speak. Consider an embedded project where there are tons of tedious things to be tied together; Also, the project velocity is more important than saving another 1k per year. The decision not to switch is the smart choice in many cases.

handfuloflightan hour ago

> A limited budget teaches you a lot.

Absolutely.

quantbuilder3 hours ago

i think its not the status line at the bottom of the terminal, but actually the few words summary claude generates for each background agents in the agents panel. so if we mostly run one plain session we wont pay for this? i do run claude code with disableAgentView on in my settings. does anyone know if that helps to stop the summary calls or just hides the panel?

z3ratul163071an hour ago

those i guess are all cache hits.

emsignan hour ago

This is fraud. Unknowing to its customers a company is running a daemon that wastes a commodity it sells to said customer.

tluyben2an hour ago

I now run Jev in front of claude code and the results so far have been very good. It picks Haiku far far more often than I would think to use it and it works very well.

esperentan hour ago

Why do you think it's making the right choice when it's not the choice you would have made?

tluyben2an hour ago

Because the result is the same. We did split test and when something is wrong we retry with fable or opus to see what it would do. But I did say seem; I am not a researcher, just someone running a business and it seems faster, cheaper and with the same outcomes so far. Subscriptions last much longer now for no visible degradation yet.

rurban2 hours ago

That's why people are using pi, not Claude. What a waste of money

nullbio2 hours ago

Not good. Please fix.

rsalus3 hours ago

does this happen for Claude Desktop too?

simianwords3 hours ago

Isn’t this prompt cached? Then it’s not that big of a deal

raverbashingan hour ago

Another reason why CoPilot seems more "honest" than CC

moezdan hour ago

It's how they finally become profitable: You burn through your token quotas so you have to buy them per request now. Oh, and also Enterprise seats are selling like bubble gum.

It's the same addiction script again and again.

appsbymo26 minutes ago

[flagged]

NikZaalop4 hours ago

Claude Code's (CC) status summaries used 16.4% of our token spend in a week! We have investigated a source of overhead in CC: it's an agent_summary query that calls your current session/subagent model approximately every 30 seconds for a few words in CC’s status line.

Our DRIM system flagged the anomaly in CC's OTEL traces. Grouping requests by query_source showed that over one measured week agent_summary accounted for: 16.4% of total estimated spend (versus 15.7% for the main conversation), and 19.7% of all API requests with approximately 9,000 input tokens per output token.

Most requests reuse the prompt cache, but repeatedly reading a large cached transcript still has a cost. Longer contexts and more concurrent agents increase the overhead.

We couldn’t find a supported setting that disables only these summaries while preserving background agents and forks. Disabling those capabilities also stops the summaries, but changes the workflow we want to keep.

Our workaround is a small Bun preload that intercepts the summary timer without modifying the CC binary. It identifies the timer callback by source-text anchors and leaves other timers alone.

In controlled tests on Linux (from ver 2.1.257 to 2.1.312), the same workload produced five summary calls without the hook and zero with suppression enabled. On our current production setup, agent_summary calls remained at zero with the hook enabled. Background agents and forks continued running. The only visible change was that their generated status summaries stopped updating.

The workaround depends on implementation details. An update can break the callback matching and silently restore the requests. macOS and Windows are untested. If someone could help us with testing there, it would be much appreciated.

If you want to try it - the script, full technical explanation, test results, and installation instructions are on GitHub: https://gist.github.com/flamerix-ai/c3905705cc4205e5de3011fa...

lostsock2 hours ago

[flagged]

vinaygundeti182 hours ago

[flagged]

mokto42 minutes ago

[dead]

edwinarbus3 hours ago

I work on Claude Code. You've got the basic mechanism right, but to be super clear, this only applies to background agents that are actively working. They get a summary call about every 30 seconds, and idle background agents don't. These summaries are used for both you and Claude Code to track what each background agent is working on, without reading transcripts.

Your 16.4% sounds like it was for a team running mostly background agents, and doesn't seem like a typical session. (Feel free to send me the session ID at [email protected] and we can dig further.)

Last week, across Claude Code users who send us telemetry, agent_summary was about 2% of cost at API list prices and just under 4% of requests. In the terminal, where nearly all of these calls happen, it was about 6% of cost.

That said, we agree that's a lot for a status line. We just rolled out a fix for the most expensive case, summaries that miss the prompt cache (2.1.311+), and right now we're working on a much cheaper mode that sends short notes to a smaller model instead of the full transcript.

jawran hour ago

Sorry to side swipe this, but it's related to token usage :peek:

Are you aware of any updates on the SDK using more session usage vs claude code (https://github.com/anthropics/claude-code/issues/97074)?

rptxan hour ago

That helps put the 16 percent in context. I think it would be better to add a real setting to turn agent summaries off... in the current binary, both the sdk option and the env var can only switch them on

esikichan hour ago

You're telling us there are frequent scheduled summary calls to agents that burns tokens like this is common knowledge. Is it? And is this documented somewhere?

simoncionan hour ago

Perhaps this is terminology confusion, but the official docs explicitly state that status lines "[Run] locally and [do] not consume API tokens." [0] _If_ that documentation is talking about the same thing that TFA is talking about, then I'd say that this is very much not common knowledge.

I also wonder if the fix that they "just rolled out" is actually activating the 'short' mode that TFA mentions...

[0] <https://code.claude.com/docs/en/statusline#how-status-lines-...>

xyzsparetimexyz35 minutes ago

Status lines should either be optional or the tokens used for them is free. Anything else is insane.

digitaltrees3 hours ago

It’s almost like they are trying to go public. Burn those tokens.

helsinki3 hours ago

I’m sure they release a decision model that alleviates this problem in due time.

hypfer2 hours ago

With the ever-increasing amount of paper cuts one gets from using their products, I wonder how long this will really go on?

After all, for most of the work people seem to be doing daily, Claude kinda isn't.. necessary? In fact, for a lot of tasks, not using it leads to better results in my experience.

There are things that only it can reasonably accomplish, but if every interaction with it hurts you in various ways (like this one), then, eventually, I do not see that working out for them anymore.

But perhaps this is just a way to push the numbers a bit further up for the IPO? That would make a lot of sense to me.

jitl2 hours ago

i use opus 5.5 to delegate to sol and luna via codex-thread-bridge (https://github.com/saidelike/codex-thread-bridge). these days i’m experimenting with opus using luna as “hands” and it’s largely resolved the tokens per output issue with my Anthropic subscription.

¯\_(ツ)_/¯ it’s not efficient but yeah it’s the best

hn-front (c) 2024 voximity
source