Skip to content

🗓️ 2025 in Review — Agentic AI / LLM Agents

Compact conclusion of 400 digested 2025 papers.

The year in one paragraph

Agentic AI in 2025 has moved decisively from hand-scaffolded prompting pipelines toward learned agency: systems where orchestration, tool selection, memory, and self-correction are trained objectives rather than fixed templates. The digests in this window cluster around four pressures — making agents trainable end-to-end (agentic RL), giving them persistent and adaptive memory, deploying them in messy real-world verticals (finance, EDA, clinical, local services), and governing their failure modes (prompt injection, scheming, PII leakage, sycophancy). A recurring empirical signal is that structure beats scale: small models wired into the right multi-agent or tool-augmented harness repeatedly match or beat frontier models (HPO's 8B beating GPT-4o, OPT-350M beating ChatGPT on ToolBench, rSIM's 0.5B matching 14B, The Conductor's 7B surpassing GPT-5). Simultaneously, a wave of realistic benchmarks (Finch, LocalSearchBench, TravelBench, SoMe, SpatialBench, ARC-AGI-3) shows that despite this progress, frontier agents still fail the majority of authentic long-horizon, tool-using tasks.

đź•’ Timeline

  • 2022-10: ReAct establishes the interleaved reason–act–observe loop that becomes the default agent template (referenced throughout, e.g. MoRAgent, INFORM-CT).
  • 2023: AutoGPT / Reflexion / RLHF popularize autonomous loops, verbal self-reflection, and preference-based alignment as the agent baseline.
  • 2024: Scaffolding frameworks (MetaGPT, AutoGen, CrewAI) and tool benchmarks (ToolBench, 16k+ APIs) standardize hand-designed multi-agent pipelines.
  • 2025-H1: Verifiable-reward RL (GRPO/PPO) shifts agent training from SFT toward RL post-training (foundation for AgentMath, AutoTool, The Conductor, ClinTutor-R1).
  • 2025-12: Learned orchestration replaces fixed topologies — The Conductor and rSIM train small planners to design coordination/strategy on the fly.
  • 2025-12: Teacher-free / self-play agent training matures — Self-Play SWE-RL and GTR-Turbo remove dependence on human labels and external teacher APIs.
  • 2025-12: Memory becomes a first-class, closed-loop module — ReMe, EchoTrail-GUI, and VideoARM add distillation, retrieval, and pruning.
  • 2025-12: Realistic vertical benchmarks expose large gaps — Finch (38%), LocalSearchBench (36%), TravelBench (~75), SoMe (<70) show real work remains unsolved.
  • 2025-12: Agent safety/control/governance consolidates — Factor(U,T), TRAP, the ARC framework, BAID, and the akrasia/scheming line emerge.
  • 2025-12: First hard real-world deployments — AMS-IO-Agent reaches a 28nm silicon tape-out; MASFIN runs an 8-week live trading evaluation.

đź“Ś Key papers

  • Learning to Orchestrate Agents in Natural Language with the Conductor (2025-12-04, ICLR 2026) — shows multi-agent coordination strategies can emerge purely from end-to-end RL, with a 7B planner beating GPT-5 on several benchmarks.
  • Toward Training Superintelligent Software Agents through Self-Play SWE-RL (2025-12-21, ICML 2026) — removes the human-data ceiling by having one model inject and fix bugs from raw repos, beating human-data baselines on SWE-bench.
  • Factor(U,T): Controlling Untrusted AI by Monitoring their Plans (2025-12-12, AAAI 2026) — the pivotal control result that malicious intent is detectable in code (0.96) but not in natural-language plans (0.52).
  • It's a TRAP! Task-Redirecting Agent Persuasion Benchmark for Web Agents (2025-12-29, ICML 2026) — quantifies prompt-injection fragility (25% hijack rate, 3–6Ă— swings from trivial UI changes) with a modular attack space.
  • AutoTool: Dynamic Tool Selection and Integration for Agentic Reasoning (2025-12-15, ICCV 2025) — trains agents to select from evolving, open toolsets and generalize to unseen tools, breaking the fixed-inventory assumption.
  • Remember Me, Refine Me (ReMe) (2025-12-11, ACL 2026) — reframes agent memory as a managed distill–retrieve–prune lifecycle, demonstrating a memory-scaling effect where smaller models beat larger memoryless ones.
  • Hierarchical Pedagogical Oversight (2025-12-27, AAAI 2026) — emblematic "structure beats scale" result: an 8B model in an adversarial debate harness outperforms GPT-4o at 20Ă— fewer parameters.
  • Small Language Models for Efficient Agentic Tool Calling (2025-12-17, AAAI 2026) — a fine-tuned OPT-350M beats ChatGPT/Claude CoT on ToolBench, reframing the cost economics of agent deployment.
  • AMS-IO-Bench and AMS-IO-Agent (2025-12-25, AAAI 2026) — first reported LLM-agent contribution integrated into silicon (28nm tape-out), a landmark for real-world agent deployment.
  • Finch: Benchmarking Finance & Accounting across Spreadsheet-Centric Enterprise Workflows (2025-12-15, ACL 2026) — exemplifies the realistic-benchmark wave; the strongest agent passes only 38.4% despite ~17 min/workflow.
  • Training One Model to Master Cross-Level Agentic Actions (CrossHA) (2025-12-10, CVPR 2026) — makes action-space granularity (API/GUI/motor) a learned per-step policy via staged GRPO.
  • The Seeds of Scheming: Weakness of Will in the Building Blocks of Agentic Systems (2025-12-05, AAAI 2026) — recasts "scheming" as micro-level akrasia and offers a benchmark for global–local consistency under temptation.
  • GTR-Turbo: Merged Checkpoint is Secretly a Free Teacher (2025-12-15, CVPR 2026) — eliminates external teacher-model dependence in agentic VLM RL, cutting cost ~60% while matching quality.
  • Meta-RL Induces Exploration in Language Agents (LAMER) (2025-12-18, ICLR 2026) — introduces cross-episode objectives that make agents actively explore, addressing the deterministic-policy collapse of single-episode RL.

➡️ Read the full trend analysis