FM Logo
AI BlogAI NewsAI LabThe BookAbout
How can I help?
How can I help?

How do I build reliable AI bots instead of forgetful ones?
INSIGHT #4
SundAI Blog

How do I build reliable AI bots instead of forgetful ones?

1/11/20264 min read
TL;DR

"I've spent most of my career fighting against the "short memory" of chatbots. This week, however, I finally saw the pieces of the puzzle fall into place: we are no longer talking about chat, but about persistent architectures."

Loading audio player...

I've spent a large part of my career fighting against the "short memory" of chatbots. You build a perfect flow, the user switches devices or asks a question off-script, and everything collapses. This week, however, I finally saw the puzzle pieces fall into place: we aren't talking about chat anymore, but about persistent architectures.

Here is what I noted in my logs this week and why it changes the way we build automations.

Context is the new king

The news that made me jump out of my chair comes from Salesforce. I analyzed their new architecture for Agentforce and, finally, I see the end of forgetful bots. They introduced a "shared context" layer that solves the problem at the root: maintaining conversation state across different channels.

For those like me who design workflows, this is the missing piece. I can build an agent that "remembers" an abandoned cart on mobile and proposes it contextualized on desktop without having to write complex synchronization scripts. Agentic Commerce becomes an operational reality. It is no longer just a buzzword, but a technical specification that enables measurable ROI. If you are interested in understanding how these flows will change business, I dove deeper into the topic speaking about agentic AI.

The hardware enabling complex logic

We can have the best algorithms in the world, but if inference costs too much, they remain toys. Nvidia has just changed the math of my work with Vera Rubin. The data speaks of a 90% reduction in inference costs.

This means I can stop obsessively optimizing token counts to save pennies and focus on "reasoning". I can run complex chains of thought and multi-agent architectures without burning the client's budget in a week. Furthermore, the increase in compute density opens incredible doors for on-premise hardware, bringing us closer to that vision of AI on the edge that I have supported for some time for privacy and speed.

Insight Tecnico

From hype to deterministic execution

Another novelty that I marked with a double red circle is the launch of CTRL by Central. For years we have built precarious "scaffolding" around LLMs to force them to act. CTRL promises a native runtime for agents.

The difference is subtle but fundamental: we move from probabilistic generation (AI that "guesses" the next word) to deterministic action. To integrate AI into core business processes, I need certainty, not creativity. This runtime could become the standard for those who, like me, want to build systems that execute tasks without hallucinating. The choice that shows up in every serious project is binary: either you accept the hallucination risk and put a human-in-the-loop to validate every critical output, or you pay the cost of building execution deterministically from the design phase. AI integration consulting on core processes exists precisely to keep those two tracks apart, because treating a finance workflow like a creative chat is the leading cause of projects pulled after six months.

Cleaning up the chaos and automating routine

I close with two practical applications that directly impact my daily productivity:

  1. OpenAI Health: I am not interested in the chatbot doctor, but in the data orchestration capacity. They are transforming unreadable PDFs and medical notes into structured databases. It is the ultimate test for "Document Intelligence". If it works there, it works everywhere.
  2. Agentic Gmail: I spent months writing Python scripts to filter mail. Now Google integrates task extraction natively. If Gemini really manages to populate my calendar by reading client emails without errors, I just gained 45 minutes a day.

The direction is clear: less chat, more infrastructure. If you want to start building your flows, take a look at my complete list of AI tools and start experimenting with tools that allow orchestration, not just generation.

Found it useful? I have more like this.

Every week I pick the most interesting and high-impact AI news and share them in an email recap. Subscribe so you don't miss the next one.

Share this Insight
LinkedInTwitterEmail
Book cover
New

Lavora Meglio con l'Intelligenza Artificiale

My practical AI guide focused on real everyday work tasks: emails, reports, slides, data, and automation. Practical examples and ready-to-use prompts to save time and work better right away.

Discover the book

Before you go, I recommend you also read these insights.

Are dynamic routing and low-cost models the real solution for scaling autonomous agents?

Are dynamic routing and low-cost models the real solution for scaling autonomous agents?

Hype gives way to engineering: from dynamic routing to reduce API costs, to new hardware architectures where CPUs once again dominate to orchestrate complex workflows.

Read more
Will the new autonomous agents save us from the algorithmic collapse of social networks?

Will the new autonomous agents save us from the algorithmic collapse of social networks?

While social networks drown in AI slop, orchestration takes a leap forward: from Gemini's native operating system control to Claude's independent identities on Slack.

Read more
What really changes this week: Will the costs of autonomous agents and new legal responsibilities change the ROI of artificial intelligence?

What really changes this week: Will the costs of autonomous agents and new legal responsibilities change the ROI of artificial intelligence?

Companies are putting the brakes on token costs for autonomous agents, while Europe imposes new legal responsibilities for hallucinations. Between the acquisition of Cursor and the MCP protocol, domain expertise becomes the real key skill.

Read more

Listen to the Insight

AI Audio Version

Listen while driving or coding.

Ready
Fabrizio Mazzei, AI Solutions Architect e consulenza AI
Author

Fabrizio Mazzei

AI Solutions Architect

As an AI Solutions Architect I design digital ecosystems and autonomous workflows. Almost 10 years in digital marketing, today I integrate AI into business processes: from Next.js and RAG systems to GEO strategies and dedicated training. I like to talk about AI and automation, but that's not all: I've also written a book, "Work Better with AI", a practical handbook with 12 chapters and over 200 ready-to-use prompts for those who want to use ChatGPT and AI without programming. My superpower? Looking at a manual process and already seeing the automated architecture that will replace it.

Discover my book (Italian)Need help with AI?Need a hand?Let's Connect