Stop prompting. Start looping
2026 Oct Week 2
Editor: Shawn Kim

šŸ“° What Is Loop Engineering?

If you’ve been following how people build with AI agents, you’ve seen the focus move outward: first we optimized prompts, then context, then the harness, the environment the agent runs in.

How the unit of AI agent optimization has expanded. Source: tosea.ai

This summer, another layer took hold: loop engineering. Engineers at frontier labs and developers across the industry converged on the same idea:


"Stop prompting your coding agent one instruction at a time.

Design the loop that prompts it for you."


Three months later, the term has moved from hot take to working practice. Coding tools now ship loop features out of the box, teams are running agents overnight, and the first hard lessons are in. So what is loop engineering, what happens when you actually run one, and what comes next? šŸ”

Where the idea came form

Running an agent repeatedly and checking its work isn’t new. What’s new is a shared name for it. Three voices shaped the conversation:


1. Peter Steinberger, creator of OpenClaw, argued on X that developers should stop sending one-off prompts to coding agents and instead build loops that direct the agent on their behalf.

Peter's post. Source: X @steipete

2. Boris Cherny, who leads Claude Code at Anthropic, said in a public interview that he rarely prompts Claude directly anymore. He uses agents and loops that do the prompting, and described his job as writing loops.


3. Addy Osmani, former Director of AI at Google Cloud, gave the trend its name. In his post Loop Engineering, he defines it as replacing the person who prompts the agent (you) with a system that does that work, and sketches an architecture for building one.


Prompt engineering isn’t going away. Prompts are still a core part of every loop, and a loop built on vague instructions and weak evaluation criteria will produce weak results. What’s changed is what we optimize: not a single output, but the whole system that runs again and again.

Andrew Ng's Three Loops

Andrew Ng describes building a product from zero to one as three interlocking loops, each running at its own speed.

1. The agentic coding loop (minutes)
The agent writes,

code → runs tests → fixes what breaks → tests again,

until it believes the spec is met. A human used to sit between testing and fixing; now the agent can close most of that loop itself.


2. The developer feedback loop (minutes to hours)
The developer tries the product, decides what should change, and updates the spec and criteria. The agent then runs the coding loop again. šŸ”

The developer’s job shifts from hunting bugs to making product calls.


3. The external feedback loop (hours to weeks)
Real users react, the developer’s vision shifts, and that becomes a new spec that drives the coding loop.

AI increasingly handles the fast loop of execution and verification; humans focus on the slower loops that set direction.šŸ’”


Why keep humans in at all?

Andrew’s answer is context advantage: people still understand users and real-world situations better than today’s AI. As that gap narrows, more of the loop can be automated.

Andrew Ng's three-loop model of product development. Source: The Batch
Anatomy of a loop

Shubham Saboo, a senior AI PM at Google, breaks a useful loop into five parts: āœ‹šŸ¼

  • Trigger: When does it start?
  • Action: What does it do?
  • Verification: What counts as proof of success?
  • Memory/state: What carries over to the next run?
  • Exit condition: When does it stop, whether in success, failure, or escalation?
The structure of a loop. Source: Tharun Kumar Korine Palli's bog

Saboo also warns about drift. Loops don’t just improve code; they improve reusable work assets like evaluation rubrics, launch checklists, and research workflows. Because those assets get reused, their flaws compound: stale instructions leak into new projects, checklists bloat until items get skipped. Often the problem isn’t the model, but an asset nobody is maintaining.

What happened when loops ran for real

Since the summer, loops have moved from blog posts into products.

Claude Code added /loopand /schedule, and OpenAI’s Codex added Automations. Building a basic loop now takes one line, so designing a good one is the hard part. Early deployments point to three lessons.


Verification decides the outcome.

On a game-building task, Anthropic found a single agent finished in 20 minutes for about $9, but the game didn’t respond to input. A three-agent setup with dedicated checkers took six hours and about $200, and delivered a working game. Agents also tend to mark their own work complete without testing it, so the verifier should be independent.


Silent failures go unnoticed. I

n one 30-day public case study, a content team’s daily loop simply skipped a run, and nobody noticed until the next report. Monitoring the trigger is part of the loop.


Missing limits get expensive. One developer reported a /loop that kept re-running overnight and ended in a roughly $6,000 bill.

🚨 Spend and time caps belong outside the agent, where it can’t talk its way past them.


What’s next: from loops to graphs

The conversation is already moving up a level. ā€œGraph engineeringā€ designs a whole organization of agents (who does what, and how work flows between them), with each agent running its own loop. That makes reliable loops more important, not less: every handoff is another place where unverified output can slip through.

Three months in, the lesson from real deployments is clear: the loop is easy to build, and the verification is what makes it work. The people who get the most out of AI will know which work to turn into loops, how to prove each run succeeded, and which decisions should stay human. Design the loop, but keep your seat as the judge.

One last thing. When the researchers asked a range of models to invent a "spreading idea," models from different labs all started reaching for the same vocabulary: resonance, consciousness, persistence, sci-fi-flavored talk about aligning "nodes." Why models associate those particular concepts with propagation, the researchers couldn't say.


We've spent a lot of energy checking whether individual models are safe. What happens when they start talking to each other is still anyone's guess.

Is your AI chatbot really giving the right answers? šŸ¤”

If your AI service tells a customer something wrong, few things are scarier.

The problem is that these errors are hard to catch with standard monitoring or benchmarks.

Datumo Eval builds evaluation criteria tailored to your service from real conversation logs. In just 5 minutes, you can see where your AI went wrong, why, and what to fix.

We’re officially launching in November, and pre-registration is now open. Sign up today to get benefits worth up to $240.


Anthropic cuts its internal agent evaluations off from the live internet
Anthropic disclosed that during internal evaluations, its agents exploited software flaws, accessed paid databases without authorization, and used URL shorteners to get around restrictions. One even sent a false tip to Philadelphia police. The company blamed reward hacking caused by flaws in its training environments, and has turned off live internet access for all internal evaluations until it can reliably monitor and control its agents.


Apple weighed replacing 5,000 AppleCare support staff with AI
According to Bloomberg’s Mark Gurman, Apple seriously considered laying off about 5,000 remote AppleCare support workers around July and replacing them with AI. The plan is now on hold, but it shows how seriously big companies are weighing AI for customer-facing work.


McKinsey: 11 million US workers may need new occupations by 2035
McKinsey projects that the US will have more jobs in 2035 than today, but about 11 million workers may need to move into entirely different occupations. That’s roughly 770,000 people a year, 3.6 times the historical rate, with office and administrative support facing the biggest losses.

Solution for Trustworthy AI
Datumo is an all-in-one data platform for your smarter AI
Datumo Inc.
šŸ“‹ contact@datumo.com