6 papers

Agent Architecture & Harnesses

The loop, the harness, and the plumbing that turns a model into a working agent.

Papers
6
Read time
1.9h
Avg length
19m
01
Agent Architecture & Harnesses

ReAct: Synergizing Reasoning and Acting in Language Models

Let an LLM interleave free-text "thoughts" with real tool actions in a single prompt loop, and it plans, grounds itself in the world, and recovers from mistakes far better than reasoning-only or acting-only agents — this is the paper that defined the agent loop you already use.

YAO, ZHAO, YU, DU, SHAFRAN, NARASIMHAN, CAO (PRINCETON + GOOGLE BRAIN) · ICLR 2023
Read
16 min
Source
arXiv:2210.03629
02
Agent Architecture & Harnesses

Agent Harness Engineering: A Survey

The reliability of an AI agent depends as much on the plumbing wrapped around the model — sandboxes, tools, memory, control loops, tracing, evals, and guardrails — as on the model itself, and this survey names that plumbing "the harness," gives it a seven-part map (ETCLOVG), and grades 170+ real projects against it.

LI, XIAO, ZHANG, LIU, ET AL. (CMU, UAB, TULANE, YALE, AMAZON, STANFORD + OTHERS) · 2026
Read
22 min
Source
arXiv:2507.15330
03
Agent Architecture & Harnesses

Dive into Claude Code: The Design Space of Today's and Future AI Agent Systems

A line-by-line reverse-engineering of Claude Code's TypeScript source that shows a production coding agent is not a clever model loop — it is a thin reasoning core (~1.6% of the code) wrapped in a dense deterministic harness for permissions, context compaction, extensibility, delegation, and persistence, and that harness is where all the real engineering (and your build/moat opportunity) lives.

JIACHENG LIU, XIAOHAN ZHAO, XINYI SHANG, ZHIQIANG SHEN (VILA LAB, MBZUAI / UCL) · APR 2026
Read
22 min
Source
arXiv:2604.14228
04
Agent Architecture & Harnesses

A Practical Guide for Designing, Developing, and Deploying Production-Grade Agentic AI Workflows

A field-tested checklist of nine engineering rules that turn flaky LLM-agent demos into deterministic, observable, deployable production systems — distilled from building a real news-to-podcast pipeline.

BANDARA, GORE, FOYTIK, SHETTY, MUKKAMALA, ET AL. (OLD DOMINION U., DELOITTE, FIU, NTU, EFFECTZ.AI) · DEC 2025
Read
16 min
Source
arXiv:2512.08769
05
Agent Architecture & Harnesses

Toward Training Superintelligent Software Agents through Self-Play SWE-RL

A single coding LLM teaches itself to fix bugs by also learning to *create* bugs — playing both attacker and defender against itself inside real codebases — and gets steadily better at solving real GitHub issues it was never trained on.

YUXIANG WEI, ZHIQING SUN, EMILY MCMILIN, JONAS GEHRING, ET AL. (META FAIR, META TBD LAB, UIUC, CMU) · DEC 2025
Read
22 min
Source
arXiv:2512.18552
06
Agent Architecture & Harnesses

Web World Models

Instead of letting an LLM hallucinate an entire game/world, define the world's rules and state in ordinary web code and let the model only fill in the flavor — giving you infinite, controllable environments with no database.

FENG, ZHANG, ZHANG, LU, LIU, WANG (PRINCETON AI2 LAB / UCLA / UPENN) · DEC 2025
Read
16 min
Source
arXiv:2512.23676