21 papers
Agent Architecture & Harnesses
The loop, the harness, and the plumbing that turns a model into a working agent.
- Papers
- 21
- Read time
- 5.6h
- Avg length
- 16m
ReAct: Synergizing Reasoning and Acting in Language Models
Let an LLM interleave free-text "thoughts" with real tool actions in a single prompt loop, and it plans, grounds itself in the world, and recovers from mistakes far better than reasoning-only or acting-only agents — this is the paper that defined the agent loop you already use.
- Read
- 16 min
- Source
- arXiv:2210.03629
Agent Harness Engineering: A Survey
The reliability of an AI agent depends as much on the plumbing wrapped around the model — sandboxes, tools, memory, control loops, tracing, evals, and guardrails — as on the model itself, and this survey names that plumbing "the harness," gives it a seven-part map (ETCLOVG), and grades 170+ real projects against it.
- Read
- 22 min
- Source
- arXiv:2507.15330
Dive into Claude Code: The Design Space of Today's and Future AI Agent Systems
A line-by-line reverse-engineering of Claude Code's TypeScript source that shows a production coding agent is not a clever model loop — it is a thin reasoning core (~1.6% of the code) wrapped in a dense deterministic harness for permissions, context compaction, extensibility, delegation, and persistence, and that harness is where all the real engineering (and your build/moat opportunity) lives.
- Read
- 22 min
- Source
- arXiv:2604.14228
A Practical Guide for Designing, Developing, and Deploying Production-Grade Agentic AI Workflows
A field-tested checklist of nine engineering rules that turn flaky LLM-agent demos into deterministic, observable, deployable production systems — distilled from building a real news-to-podcast pipeline.
- Read
- 16 min
- Source
- arXiv:2512.08769
A Comprehensive Taxonomy of Prompt Engineering Techniques for Large Language Models
Stop treating prompts as clever one-liners and start treating them as a four-layer
- Read
- 14 min
A Practical Approach for Building Production-Grade Conversational Agents with Workflow Graphs
Instead of stuffing every business rule into one giant system prompt, Kakao splits their e-commerce agent into a directed graph of small, single-purpose LLM states — then fine-tunes on the resulting conversations with a masking trick that stops each state's training data from contaminating the others.
- Read
- 15 min
- Source
- arXiv:2505.23006
AI Agents vs. Agentic AI - A Conceptual Taxonomy, Applications and Challenges
"Agentic AI" is not a smarter agent; it is a *team* of narrow agents plus an
- Read
- 12 min
- Source
- arXiv:2505.10468
An Empirical Study of Harness Design for Coding Agents
No harness component is "always good": context management pays off only when the window is tight, planning helps weak models finish and helps strong models stop, and predefined tools help models that are bad at bash while slowing down models that are good at it.
- Read
- 14 min
- Source
- arXiv:2609.20804
From Agent Behaviour to Agent-Friendly Documentation - An Empirical Study of How Coding Agents Discover, Read, and Write Technical Documentation
When you actually watch 557 real coding-agent sessions instead of guessing, agents spend 60.5% of their documentation time on files written *for* agents (AGENTS.md, CLAUDE.md, plans, `thoughts/`) and only 1.3% on API references — and almost none of the "read the docs, then write the code, then check the docs" behaviour everyone assumes actually shows up in the traces.
- Read
- 22 min
- Source
- arXiv:2608.20195
JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolution
JIT-Agent is a trained "meta-agent" that, given a task, writes a bespoke agent
- Read
- 15 min
- Source
- arXiv:2608.25593
Meta-Harness: End-to-End Optimization of Model Harnesses
Meta-Harness points a coding agent at a folder full of every previous harness's source code, scores, and raw execution logs, and lets it rewrite the harness itself — instead of hand-tuning prompts, it automates the harness-engineering job directly.
- Read
- 14 min
- Source
- arXiv:2603.28052
Model or Harness? An Interaction-Centric Taxonomy for Localizing Agent Failures
When your agent fails, this paper gives you a fixed vocabulary for saying *which two parts of the system were talking to each other* and *which of the two was actually wrong* — so the fix lands on the model, the scaffolding, the environment, or the test, instead of on whatever you guessed.
- Read
- 18 min
- Source
- arXiv:2607.28802
OpenJarvis: Personal AI, On Personal Devices
Swapping a cloud model for a local one breaks a personal AI assistant because the whole stack was built around the cloud model, not just the model; OpenJarvis turns the entire stack into an editable, searchable object so a cloud "teacher" can rebuild it around the local model instead.
- Read
- 14 min
- Source
- arXiv:2605.17172
Self-Refine: Iterative Refinement with Self-Feedback
Same LLM, three hats — write a draft, critique your own draft, rewrite it — looped a few times, and you get 5-40% better outputs with zero training, fine-tuning, or extra models.
- Read
- 14 min
- Source
- arXiv:2303.17651
Tendem: A Hybrid AI+Human Platform
Tendem runs an AI agent through a plan-act-observe-verify loop and only hands work to a paid human expert at specific "step gates" where risk or uncertainty is high, and on 94 real freelance-style tasks that combination beats both a pure AI agent and pure human freelancers on quality, speed, and cost at once.
- Read
- 9 min
- Source
- arXiv:2602.01119
The Scaffolding Matters More Than the Interface
They ran the same six-step GitHub task through seven agent harnesses, five models, and both tool interfaces, and found that which harness you pick changes your bill by up to 139×, while MCP-versus-CLI does not reliably change it at all.
- Read
- 22 min
- Source
- arXiv:2608.08654
Toolformer: Language Models Can Teach Themselves to Use Tools
A 6.7B model teaches itself, with no human labels, exactly when to call a calculator, search engine, translator, QA system, or calendar mid-sentence — by generating its own API calls, keeping only the ones that measurably make its next-word predictions easier, and fine-tuning on that self-curated dataset.
- Read
- 10 min
- Source
- arXiv:2302.04761
Toward Training Superintelligent Software Agents through Self-Play SWE-RL
A single coding LLM teaches itself to fix bugs by also learning to *create* bugs — playing both attacker and defender against itself inside real codebases — and gets steadily better at solving real GitHub issues it was never trained on.
- Read
- 22 min
- Source
- arXiv:2512.18552
Voyager: An Open-Ended Embodied Agent with Large Language Models
Voyager is a Minecraft agent that never stops playing — it picks its own next goal, writes JavaScript to pursue it, keeps every script that worked in a growing skill library, and uses that library to learn faster and faster, all without ever touching GPT-4's weights.
- Read
- 14 min
- Source
- arXiv:2305.16291
Web World Models
Instead of letting an LLM hallucinate an entire game/world, define the world's rules and state in ordinary web code and let the model only fill in the flavor — giving you infinite, controllable environments with no database.
- Read
- 16 min
- Source
- arXiv:2512.23676
WebGPT: Browser-assisted question-answering with human feedback
OpenAI gave GPT-3 a text-only web browser and a "quote" button, then used human preference data to train it to search, click, and cite its way to answers that beat human-written Reddit answers 69% of the time.
- Read
- 14 min
- Source
- arXiv:2112.09332