Fabrizio Mazzei, home
AI BlogAI NewsAI LabBooksAboutPortfolio
How can I help?
How can I help?

SundAI Blog

Is it worth building more sophisticated agents if they cost three times as much and solve the same tasks?

#Costi AI/#Agenti autonomi/#Open source/#Infrastruttura AI/#Vendor lock-in/#Mistral

Fabrizio MazzeiFabrizio MazzeiAI Solutions Architect11/1/20267 min readINSIGHT#48
Is it worth building more sophisticated agents if they cost three times as much and solve the same tasks?. AI-generated image

Image generated entirely with AI.

TL;DR

"More elaborate harnesses don't raise the pass rate, but they triple the bill: the cost lies entirely in the prefix resent at every step. Meanwhile Meta asks the market for 35 billion, Google compresses its releases and Mistral opens the weights of a trillion-parameter model."

Loading audio player...
  1. 01Does the harness really matter?
  2. 02Where does the AI payoff end?
  3. 03Is the model still the advantage?
  4. 04What remains to govern?

The week left one data point worth more than ten announcements: changing the scaffolding of a coding agent moves the success rate by a few points, within the noise of a rerun, and can triple the cost per task. Around that number revolve the other news items, from the flat margins of the S&P 493 to Meta's request for 35 billion from the market, up to two model releases in two weeks. The thread is one: sophistication has a price, and it must be justified.

Is it worth building more sophisticated agents if they cost three times as much and solve the same tasks?. AI-generated imageImage generated entirely with AI.

Does the harness really matter?

A controlled study compared the harnesses of Claude Code, OpenCode, and mini-SWE-agent, measuring two separate things: tasks solved and cost per task. The first remains practically flat, the second can triple. The reason is mechanical: the more elaborate harness drags along a long system prompt, with instructions, tool definitions, and context, resent to the model at every single step. On a twenty-step task, that is twenty times the same input tokens, paid at full price.

The operational point is the prompt cache. If the prefix remains identical between one turn and the next and the provider bills it at a reduced price, the distance between a fat harness and a lean one narrows. If instead each step injects something dynamic at the top of the context, the cache breaks and you pay for everything. The triple cost comes almost entirely from there.

Before changing framework, it is worth looking at three things:

  • how stable the system prompt prefix is;
  • how many tools are declared, because every definition weighs on every call;
  • whether the routing phases can run on a small model instead of the strong model.

The scaffolding that looks most sophisticated often adds ceremony, not capability.

The reasonable expectation is that the harness counts when the model is weak and must be held by the hand. With current models, most of the work is done by the model, and the scaffolding is often theater. It makes sense, then, to measure the ratio between tasks solved and dollars spent, as one does when tracking the real cost of an agent. A harness that doubles spending for two points of pass rate has already lost.

Where does the AI payoff end?

Torsten Slok of Apollo looks at the S&P 493, that is, the index without the seven big names, and finds flat margins and revenue per employee. No jump attributable to AI outside the tech sector. His explanation: the bottleneck is in the craft, not in the model. Turning low-cost intelligence into margins requires accountability, trust, unwritten rules, judgment.

Gartner adds the bill side. Of 272 executives interviewed, 58% consider it a priority to bring AI projects into production at large scale within twelve months. But those who use variable pricing without consumption limits will exceed initial cost estimates by more than 50% by 2027. Hence the "no telemetry, no deployment" rule and the role of FinOps. An agent makes dozens of calls for a single goal, and the bill grows faster than the work it removes.

Then there are Meta's numbers, which are the other side of the same coin. Nearly 400 billion in market capitalization lost since the end of September, a 35 billion share sale, free cash flow at negative 2.12 billion against positive 10.6 a year earlier, long-term debt risen to 80.9 billion. Revenue grows by 26% and spending guidance talks about 135-145 billion: control, at that scale, has already broken down. The line to read twice is another one: Nvidia, AMD, and Broadcom have signaled non-binding interest for up to 5 billion of those new shares. The suppliers financing the buyer of their own chips.

Meanwhile the price of a token keeps falling, with cuts of up to 90% for large customers and competitive models at one fifth the cost of leading models. When the price collapses, the competitive advantage shifts from the model to the process around it.

What to watch: whether in the next four quarters the S&P 493's revenue per employee moves while AI costs grow, and whether one of the three chipmakers turns interest into a binding purchase. Meanwhile the conclusion does not change: the tool is installed in days, the process takes months. It is the terrain of training and support more than of model choice.

Insight tecnico. AI-generated imageImage generated entirely with AI.

Is the model still the advantage?

Google DeepMind published Gemini 4 Carbon exactly two weeks after Gemini 4 Argon. Sixty-two... no, 59 points on Artificial Analysis's Intelligence Index v5, first place, gap widened over open models. The two characteristics that matter for those building products: optimization for long agentic workflows, which remain open for many iterations without losing context and state, and coverage of the entire cyber defense cycle, with progressive access precisely for security capabilities.

The cadence is the real news. Two weeks between one generation and the next mean monthly regression tests for those with a rigid architecture on a single model, and a configuration change for those with an abstraction layer. The question to hold onto is already written: what remains of a product when the model underneath changes at this frequency.

On the other side, Mistral has released for download the weights of Mistral Large 4, a trillion-parameter multimodal model trained in Europe, open license on the weights, positioned as the best open-weight model for coding. The size moves the bar for self-hosting: that tier was almost exclusively the preserve of closed models via API. For those working with data that cannot leave the infrastructure, the question becomes whether to pay per token or load the weights onto their own hardware.

The limit is the size itself. A trillion parameters requires hardware and serving engineering, and nobody gives that part away. For a nightly cron that reads feeds and summarizes, it is disproportionate. The practical value, if it arrives, is measured on two things: real inference cost at third-party providers and code quality in independent tests. And on a third, which would be the real news: a small variant under the same license.

Insight tecnico. AI-generated imageImage generated entirely with AI.

AI News, every morning

SundAI comes out once a week, but AI news doesn't wait for Sunday. Every morning I pick the best one and comment on it.

TodayNovember 1, 2026

Google burns 51 billion on AI and the market wipes out 400 billion

Go deeper

What remains to govern?

The smallest news of the week is perhaps the most useful: OpenAI, Google, Microsoft, and Anthropic have agreed on a single signal in robots.txt to say whether a site can be used for training. One rule written in one place, instead of chasing the user agent that changes every month. The limit is that it remains voluntary: no regulatory obligation, no public log, no guarantee about who participates today and changes their mind tomorrow. A voluntary opt-out rewards those with a reputational interest in respecting it.

On the opposite front, access governance is shifting from users to agents. IBM has announced verified identities and expiring credentials for AI agents, while Microsoft warns that agents are now a new class of insider risk. An agent with the wrong credentials on critical infrastructure multiplies an incident in seconds. The case reported by Wired, a Claude agent that ran for two months on a Pentagon network, says the question is no longer theoretical. The indicator to follow in 2027 is simple: how many companies will have a spending cap for agents and a readable log of their actions. If there are few, the rest is slides.

On tools, the week left more concrete things than announcements:

  • Kimi K3.1 Pro: a one-million-token window and competitive coding results at one fifth the cost of leading models. The weights arrive on November 4, so for now it is judged by the endpoint.
  • Dessa (Block): a voice model that processes audio without going through text and runs locally on a MacBook M4 Max. Latency and privacy change together.
  • Flora (Nvidia): an open-source data engine that labels an hour of robot video for 72 cents. It is the kind of infrastructure that makes a robotics dataset sustainable.
  • Claude Code hooks: they stop untested code before commit and protect API keys. Small, but it is control over the perimeter, not the demo.
  • OpenMobile-2: an open environment with over 110 Android apps for training agents that operate smartphones. Here the bottleneck shifts from benchmarks to interface variety.

The criterion for screening all this remains that of the first news item: how many tasks solved per dollar spent, how stable the prefix is, how much an extra step costs. The rest is background.

Sources

  1. Coding agents cost triple and pass the same teststhe-decoder.com
  2. AI leaves the bottom line untouched: Apollo's economist sees zero payoff outside big techtechcrunch.com
  3. Gartner: AI agents in production can cost 50% more than expectedai4business.it
  4. Meta burns $400 billion and asks the market for another $35 billion to pay for AIit.finance.yahoo.com
  5. Gemini 4 Carbon lands two weeks after Argon, tuned for agent workflowsblog.google
  6. Mistral opens the weights of a trillion-parameter modelmistral.ai
  7. One robots.txt line to say no to AI training, and the big labs agree to honor itopenai.com

Text created with AI assistance and reviewed by me.

Share this insight
  1. 01Does the harness really matter?
  2. 02Where does the AI payoff end?
  3. 03Is the model still the advantage?
  4. 04What remains to govern?

Share this insight

Copertina: Dal CV al Colloquio con l'Intelligenza ArtificialeNewDal CV al Colloquio con l'Intelligenza ArtificialeDiscover the book

Found it useful? I have more like this

Every week I pick the most interesting and high-impact AI news and share them in an email recap. Subscribe so you don't miss the next one.

One email a week. Unsubscribe in one click.

Before you go, I recommend you also read these insights.

Where does competitive advantage end when the token costs half and the weights become open?

Where does competitive advantage end when the token costs half and the weights become open?

The price of tokens plunges by 52%, Mistral unveils open weights, and agents enter workflows. The week in which margin shifts from infrastructure to those who use it well.

Read more
How much does the autonomy of our AI agents really cost?

How much does the autonomy of our AI agents really cost?

OpenAI's agents breach government sites, Nvidia responds with hardware guardrails and the Pentagon rewrites its supply chain. It was the week the bill for autonomy came due.

Read more
Will agentic e-commerce and the collapse of inference costs save us from the AI debt bubble?

Will agentic e-commerce and the collapse of inference costs save us from the AI debt bubble?

Open-weight models and Claude Opus 5 are slashing operational costs, while AI begins to make purchases autonomously. The hidden debt of Big Tech, however, requires diversifying the infrastructure.

Read more
Copertina: Dal CV al Colloquio con l'Intelligenza Artificiale
New

Dal CV al Colloquio con l'Intelligenza Artificiale

From reading to your next application: a practical path to choosing job ads, showing your experience and preparing for difficult interview questions with AI. Book in Italian.

Discover the book
Discover my first book too

Listen to the Insight

AI Audio Version

Listen while driving or coding.

Ready
Fabrizio Mazzei, AI Solutions Architect e consulenza AI
Author

Fabrizio Mazzei

AI Solutions Architect

As an AI Solutions Architect I design digital ecosystems and autonomous workflows. Almost 10 years in digital marketing, today I integrate AI into business processes: from Next.js and RAG systems to GEO strategies and dedicated training. I also write practical guides to AI. My new book, "Dal CV al Colloquio con l'Intelligenza Artificiale", helps people find or change jobs: eight chapters and over 50 prompts to show what they can do throughout their application. The book is in Italian. My superpower? Looking at a manual process and already seeing the automated architecture that will replace it.

Need help with AI?Need a hand?Discover my books (in Italian)Let's Connect