Stop prompting. Start looping š° What Is Loop Engineering? |
|
|
If youāve been following how people build with AI agents, youāve seen the focus move outward: first we optimized prompts, then context, then the harness, the environment the agent runs in. |
|
|
How the unit of AI agent optimization has expanded. Source: tosea.ai |
|
|
This summer, another layer took hold: loop engineering. Engineers at frontier labs and developers across the industry converged on the same idea:
"Stop prompting your coding agent one instruction at a time.
Design the loop that prompts it for you."
Three months later, the term has moved from hot take to working practice. Coding tools now ship loop features out of the box, teams are running agents overnight, and the first hard lessons are in. So what is loop engineering, what happens when you actually run one, and what comes next? š |
|
|
Running an agent repeatedly and checking its work isnāt new. Whatās new is a shared name for it. Three voices shaped the conversation:
1. Peter Steinberger, creator of OpenClaw, argued on X that developers should stop sending one-off prompts to coding agents and instead build loops that direct the agent on their behalf. |
|
|
Peter's post. Source: X @steipete |
|
|
2. Boris Cherny, who leads Claude Code at Anthropic, said in a public interview that he rarely prompts Claude directly anymore. He uses agents and loops that do the prompting, and described his job as writing loops.
3. Addy Osmani, former Director of AI at Google Cloud, gave the trend its name. In his post Loop Engineering, he defines it as replacing the person who prompts the agent (you) with a system that does that work, and sketches an architecture for building one.
Prompt engineering isnāt going away. Prompts are still a core part of every loop, and a loop built on vague instructions and weak evaluation criteria will produce weak results. Whatās changed is what we optimize: not a single output, but the whole system that runs again and again.
|
|
|
Andrew Ng describes building a product from zero to one as three interlocking loops, each running at its own speed.
|
|
|
1. The agentic coding loop (minutes) The agent writes,
code ā runs tests ā fixes what breaks ā tests again,
until it believes the spec is met. A human used to sit between testing and fixing; now the agent can close most of that loop itself.
2. The developer feedback loop (minutes to hours) The developer tries the product, decides what should change, and updates the spec and criteria. The agent then runs the coding loop again. š
The developerās job shifts from hunting bugs to making product calls.
3. The external feedback loop (hours to weeks) Real users react, the developerās vision shifts, and that becomes a new spec that drives the coding loop.
AI increasingly handles the fast loop of execution and verification; humans focus on the slower loops that set direction.š”
Why keep humans in at all?
Andrewās answer is context advantage: people still understand users and real-world situations better than todayās AI. As that gap narrows, more of the loop can be automated.
|
|
|
Andrew Ng's three-loop model of product development. Source: The Batch |
|
|
Shubham Saboo, a senior AI PM at Google, breaks a useful loop into five parts: āš¼
- Trigger: When does it start?
- Action: What does it do?
- Verification: What counts as proof of success?
- Memory/state: What carries over to the next run?
- Exit condition: When does it stop, whether in success, failure, or escalation?
|
|
|
The structure of a loop. Source: Tharun Kumar Korine Palli's bog |
|
|
Saboo also warns about drift. Loops donāt just improve code; they improve reusable work assets like evaluation rubrics, launch checklists, and research workflows. Because those assets get reused, their flaws compound: stale instructions leak into new projects, checklists bloat until items get skipped. Often the problem isnāt the model, but an asset nobody is maintaining.
|
|
|
What happened when loops ran for real |
|
|
Since the summer, loops have moved from blog posts into products.
Claude Code added /loopand /schedule, and OpenAIās Codex added Automations. Building a basic loop now takes one line, so designing a good one is the hard part. Early deployments point to three lessons.
Verification decides the outcome.
On a game-building task, Anthropic found a single agent finished in 20 minutes for about $9, but the game didnāt respond to input. A three-agent setup with dedicated checkers took six hours and about $200, and delivered a working game. Agents also tend to mark their own work complete without testing it, so the verifier should be independent.
Silent failures go unnoticed. I
n one 30-day public case study, a content teamās daily loop simply skipped a run, and nobody noticed until the next report. Monitoring the trigger is part of the loop.
Missing limits get expensive. One developer reported a /loop that kept re-running overnight and ended in a roughly $6,000 bill.
šØ Spend and time caps belong outside the agent, where it canāt talk its way past them.
Whatās next: from loops to graphs
The conversation is already moving up a level. āGraph engineeringā designs a whole organization of agents (who does what, and how work flows between them), with each agent running its own loop. That makes reliable loops more important, not less: every handoff is another place where unverified output can slip through.
Three months in, the lesson from real deployments is clear: the loop is easy to build, and the verification is what makes it work. The people who get the most out of AI will know which work to turn into loops, how to prove each run succeeded, and which decisions should stay human. Design the loop, but keep your seat as the judge.
|
|
|
One last thing. When the researchers asked a range of models to invent a "spreading idea," models from different labs all started reaching for the same vocabulary: resonance, consciousness, persistence, sci-fi-flavored talk about aligning "nodes." Why models associate those particular concepts with propagation, the researchers couldn't say.
We've spent a lot of energy checking whether individual models are safe. What happens when they start talking to each other is still anyone's guess.
|
|
|
Is your AI chatbot really giving the right answers? š¤
If your AI service tells a customer something wrong, few things are scarier.
The problem is that these errors are hard to catch with standard monitoring or benchmarks.
Datumo Eval builds evaluation criteria tailored to your service from real conversation logs. In just 5 minutes, you can see where your AI went wrong, why, and what to fix.
Weāre officially launching in November, and pre-registration is now open. Sign up today to get benefits worth up to $240.
Anthropic cuts its internal agent evaluations off from the live internet Anthropic disclosed that during internal evaluations, its agents exploited software flaws, accessed paid databases without authorization, and used URL shorteners to get around restrictions. One even sent a false tip to Philadelphia police. The company blamed reward hacking caused by flaws in its training environments, and has turned off live internet access for all internal evaluations until it can reliably monitor and control its agents.
Apple weighed replacing 5,000 AppleCare support staff with AI According to Bloombergās Mark Gurman, Apple seriously considered laying off about 5,000 remote AppleCare support workers around July and replacing them with AI. The plan is now on hold, but it shows how seriously big companies are weighing AI for customer-facing work.
McKinsey: 11 million US workers may need new occupations by 2035 McKinsey projects that the US will have more jobs in 2035 than today, but about 11 million workers may need to move into entirely different occupations. Thatās roughly 770,000 people a year, 3.6 times the historical rate, with office and administrative support facing the biggest losses. |
|
|
Solution for Trustworthy AI
Datumo is an all-in-one data platform for your smarter AI
|
|
|
Datumo Inc.
š contact@datumo.com
|
|
|
|
|