AI Agent Arxiv Digest — 2026-10-26

🌏 繁體中文版

Today's Overview

"How complex should agent memory be" sounds like one question, but today's three papers show it's actually three different questions with three different answers. Conversational memory: Raw-RAG, a bare-bones dense-retrieval-plus-reranking baseline, beats 12 purpose-built agentic memory systems — most of the complex memory management work here turns out to be wasted engineering. Task-planning memory: MemPlan goes the opposite way, showing that letting an LLM remember its own interaction history isn't enough — memory has to be compiled into positive/negative constraints a symbolic planner can use before it wins. Multi-agent coordination memory: Muffin lands somewhere in between — agents don't need to exchange full reasoning traces the way traditional multi-agent debate does; a lightweight shared buffer of notes gets better accuracy while cutting token cost by more than 70%. Put together: there's no universal slogan that says memory should be "simple" or "complex" — you first have to know which role your memory is playing before you know which direction to design it in.

Terms worth knowing before this one

Paper 1 | Conversational memory doesn't need to be complex: Naive RAG beats 12 agentic memory systems

Is Complex Agentic Memory Always Needed? Naive RAG Is Stronger Than We Thought Zhengye Bao, Shengtao Zhang, Haokai Zhang et al. (Xi'an Jiaotong University) · arxiv: 2610.30755

Links: arxiv · alphaxiv

TL;DR

A bare-bones baseline, Raw-RAG — dense retrieval plus cross-encoder reranking, nothing else — ranks first in six of seven benchmark-model settings across four long-term conversation benchmarks (LoCoMo, LongMemEval, MEME, MemoryAgentBench), beating 12 purpose-built agentic memory systems including EverMemOS, Mem0, and MemOS; adding memory-management operations (fact extraction, summarization, graph construction) actually lowers accuracy.

Editorial judgment

Background

Recent agent long-term memory research has mostly pushed toward making memory "smarter" — using an LLM to extract facts, summarize, build knowledge graphs, and learn when to update or delete memories (systems like Mem0, MemOS, A-MEM). This paper steps back and asks a more basic question: are these complex operations actually better than the simplest possible approach — retrieval and reranking over raw conversation history?

Mid-level walkthrough

• The problem: Imagine a memory system handling a conversation history spanning months and thousands of messages. The common intuition is "there's so much information, you must organize, condense, and structure it first to find what matters" — but the organizing process itself can be where information gets lost.
• The method: The authors first run two diagnostic experiments. Auditing Mem0's write behavior on LoCoMo and LongMemEval, they find UPDATE and DELETE together account for only 2.46–4.39% of all write decisions; replacing these with append-only ADD/NONE actually raises accuracy from 67.36% to 69.42%. Testing on MEME's dynamic tasks, they find that given enough raw evidence, capable readers can resolve most state changes themselves. Building on both findings, they propose Raw-RAG: no LLM-based extraction or structuring at all — just dense retrieval of 128 candidate windows, cross-encoder reranking down to the top 15, handed straight to the reader.
• Why it matters: The key diagnostic is that "coverage" (whether the needed evidence was retrieved at all) explains performance differences far more than "utilization" (whether the model answers correctly once it has the evidence) — Raw-RAG leads in coverage on both benchmarks measured (45.29%/76.35%, both highest), while the utilization gap across systems is comparatively small. In other words, where systems actually lose is in "did you retrieve the needed raw information," not "can the model use it."

Deep-dive points

• Raw-RAG leads LoCoMo by 0.65–0.95 points, LongMemEval by 0.13 points, GPT-4o-mini MEME by 2.24 points, and MemoryAgentBench by 4.48–5.53 points; its only loss is DeepSeek-V4-Flash MEME, where MemMachine leads by 1.52 points
• Adding any of three memory-management operations lowers MemoryAgentBench's total score: atomic-fact extraction -19.62 points, summary augmentation -5.81 points, graph expansion -5.78 points; fact extraction specifically drops test-time-learning accuracy from 47.68% to 15.37%
• The efficiency gap is large: on a MEME subset, Raw-RAG finishes add+search in 305.91 seconds — 5.1× faster than the next system and 30.4× faster than EverMemOS; on a near-million-token streaming test (BEAM-1M), Raw-RAG's cumulative ingestion time is 0.33 hours versus 3.25 hours for the next-fastest (MemOS) and 26.95 hours for Memora ⚠️ (these efficiency numbers are self-reported by the authors and await external replication)
• On MEME tracking/cascade questions, Raw-RAG's conditional "path coverage" (retrieving the dependency chain needed to derive an answer, not just the value) reaches 62.34%, the highest among compared systems; MemU reaches only 9.62%
• Adoption threshold: quantify a dense-retrieval-plus-rerank baseline's real gain before investing in complex memory management — don't assume complexity automatically helps
• Limitation: evidence is limited to offline conversation tasks; the paper does not test interactive or multimodal settings, nor behavior under privacy/deletion constraints

Reviewer's one-line take

Comparing against 12 systems across 4 benchmarks gives this kind of myth-busting paper an unusually thorough methodological footprint; but the memory complexity discussed here is concentrated at the retrieval/structuring layer — it hasn't yet touched the privacy-deletion and multi-tenant permission complexity that real products also have to handle, so whether simple approaches can cover that too remains open.

Takeaways for you

• If you're designing or buying a long-term conversational memory system: ship a dense-retrieval-plus-rerank Raw-RAG baseline first, and measure any "complex memory management" product against it before paying for the extra engineering
• If your team already runs Mem0/MemOS-style systems: check the actual share and effectiveness of UPDATE/DELETE operations in your pipeline — this paper suggests they're often a small share of traffic yet a disproportionate source of instability

Paper 2 | How task-planning memory should be designed: MemPlan turns memory into planning constraints

MemPlan: Memory-Conditioned PDDL Planning for Partially Observable Text Environments Tengwei Song, Robert Hoehndorf (KAUST + Åbo Akademi University, Finland + ELLIS Institute Finland) · arxiv: 2610.30379

Links: arxiv · alphaxiv

TL;DR

MemPlan, accepted at NeurIPS 2026, restricts the LLM to parsing observations and grounding actions, and compiles interaction memory into "positive memory" (priority ordering over candidate hypotheses) and "negative memory" (excluding hypotheses the environment has already disproved) directly inside a fixed PDDL planning problem — beating pure language-memory agents and several PDDL-assisted baselines across TextWorld, ALFWorld, and Robotouille.

Editorial judgment

Background

Using an LLM as the main planner for long-horizon tasks is prone to hallucinated actions or losing track of earlier observations, while classical symbolic planners (e.g., Fast Downward) search reliably but need a complete symbolic state to operate — something partially observable text environments don't provide. Existing approaches either have the LLM guess a complete state before planning (expensive to recover from when the guess is wrong) or let the LLM rewrite PDDL files online (prone to malformed syntax or hallucinated facts). MemPlan takes a third path: keep the domain fixed, and let the memory mechanism decide how to rebuild the problem at each step.

Mid-level walkthrough

• The problem: Imagine an agent exploring an unfamiliar house to find a key for a box, without seeing the full layout — it has to explore step by step. Every time it guesses a drawer wrong, a naive approach can keep re-trying already-excluded locations, or wander aimlessly without knowing where to check next.
• The method: MemPlan keeps one PDDL domain fixed and rebuilds a closed PDDL problem at every step from parsed facts, unresolved candidate hypotheses, positive memory, and negative memory. Positive memory uses mContriever embeddings to score how relevant a candidate hypothesis is to the goal, converting that score into the planner's action cost — higher relevance means a lower cost to check, so the planner naturally tries those candidates first. Negative memory turns hypotheses the environment has already disproved into hard exclusion constraints, so the planner never reconsiders them. The whole system uses one frozen language-symbol interface purely for observation parsing and action grounding — the LLM itself never plans or rewrites the domain.
• Why it matters: Ablations show that removing the "placeholder" mechanism causes outright planning failure (an unobserved but required object can't even be represented in the PDDL problem), and removing negative memory causes the agent to keep retrying hypotheses already refuted. Compiling memory into costs and constraints the planner can act on directly — rather than feeding it to an LLM as extra context — produces better task completion and shorter interaction trajectories across all three environments.

Deep-dive points

• ALFWorld (134 episodes): MemPlan takes fewer interaction steps and uses fewer online tokens than GPT-5.1 ReAct and both PDDLEGO+ variants; LLM-DP still has the lowest online token cost
• TextWorld memory-agent comparison (7 task instances): MemPlan gets the highest normalized score among six memory-agent baselines — Full History, Summary, RAG, Reflexion, Simulacra, AriGraph ⚠️ (only 7 task instances; the authors explicitly flag this as evidence for this setting, not a broad claim)
• Robotouille sync/async tasks: MemPlan's lead over ReAct and LLM-DP is more pronounced in the asynchronous setting (delayed action effects), consistent with the intuition that memory-encoded exclusion constraints matter more when observations go stale faster
• TextWorld's PDDL domain was drafted offline by GPT-5.1; 5 of 7 (71.4%) were valid on the first attempt, with the remaining 2 fixed after one offline repair round — domain generation never touched the test instances' maps, object placements, or gold answers
• Adoption threshold: you need a (or the ability to offline-generate a) complete PDDL domain description, and negative memory's hard exclusion can misfire on ambiguous or mis-parsed feedback, requiring extra robustness design
• Limitation: MemPlan does not automate PDDL domain construction or online repair; evaluation is limited to simulated text environments, not safety-critical real deployment

Reviewer's one-line take

Compiling memory directly into costs and constraints a planner can use — instead of handing it to an LLM as extra context — is a methodologically clean design validated by peer review; but the TextWorld memory-agent comparison's sample size is small, and the system depends heavily on a correct, pre-given PDDL domain, a premise whose durability in real-world settings with incomplete domain descriptions remains to be seen.

Takeaways for you

• If you're building agents that need long-horizon planning (robots, process automation, complex multi-step tool use): assess whether your task's core constraints can be written as a PDDL domain, then use a MemPlan-style positive/negative memory mechanism to handle uncertainty, instead of handing every decision to the LLM
• If you already use an LLM memory agent for interactive tasks: note that "memory as context" and "memory compiled into planning constraints" are fundamentally different uses of memory — this paper's ablations suggest the latter is more robust for long-horizon, partially observable tasks

Paper 3 | Multi-agent coordination doesn't need full sharing: Muffin replaces debate with a lightweight shared buffer

Muffin - A Shared Memory Buffer for Asynchronous AI Agents Ping-Lin Kuo, Suman Navaratnarajah, Christian Frey et al. (University of Technology Nuremberg, Germany) · arxiv: 2610.31355

Links: arxiv · alphaxiv

TL;DR

Muffin has multiple agents exchange compact intermediate findings through an asynchronous shared memory buffer, instead of synchronously exchanging full reasoning traces the way traditional multi-agent debate does — winning the best accuracy in 17 of 20 settings across four reasoning benchmarks and four models, beating the strongest multi-agent debate baseline by 19.2 accuracy points while using 77.4% fewer tokens.

Editorial judgment

Background

Multi-agent debate is a common reasoning-boosting technique: multiple agents each answer, then revise their own answers after seeing each other's full output. But "seeing each other's full output" means synchronous waiting and heavy token overhead — and the paper notes that single- and multi-agent systems are often on par in target-driven reasoning tasks anyway. The problem is often not "whether to use multiple agents" but "how agents should exchange information."

Mid-level walkthrough

• The problem: Imagine three people solving a math problem together. The traditional debate approach has everyone read out their entire solution process to the other two, then revise — information-heavy and slow. Muffin tests whether sharing just "the one key insight I just found" as a compact note, instead of the full solution process, can be just as effective — or more so.
• The method: Muffin first uses an orchestrator to route a query by its expected reasoning demand — simple queries get answered directly, complex ones get sent into multi-agent collaboration. During collaboration, each agent keeps its private reasoning local and only writes intermediate findings into a shared buffer that other agents read asynchronously, without waiting for everyone to finish the same round. Finally, a summarizer combines each agent's compact summaries (not their full reasoning traces) into the final answer.
• Why it matters: The breakdown analysis shows that shared intermediate findings are most valuable early on — in the first round, a shared finding has a 51.6% chance of correcting a wrong answer to a right one, versus only a 14.2% chance of steering a right answer wrong. By later rounds, as the shared buffer accumulates more information, the correcting-versus-misleading ratio narrows to 34.8% versus 21.9%. This means the marginal value of compact sharing is concentrated early — it doesn't need to keep stacking full traces in later rounds.

Deep-dive points

• Across four models (gemma-4-E4B-it, gemma-4-31B-it, Qwen3.8-27B, Qwen3.5-4B) on four benchmarks (Chess Move Validity, MMLU-Pro, GPQA-Diamond, OlymMATH) — 20 settings total — Muffin gets the best accuracy in 17 and second-best in 3
• On OlymMATH-Easy, Muffin beats the strongest multi-agent debate baseline by 19.2 accuracy points while using 77.4% fewer tokens; the summarizer step alone lifts final accuracy from 44.9% to 59.2%
• Agent-count ablation: going from 2 to 3 agents raises accuracy from 50.6% to 59.3%, but 4 or 5 agents only reach 59.7%/58.7% while token usage keeps climbing ⚠️ (a diminishing-returns signal, not linear scaling — don't just keep adding agents)
• Versus full-trace sharing: at the final step, full-trace sharing pushes accuracy from 85.0% to 87.3%, but needs 73.9% more tokens (160.6K vs. 41.9K) — most of the sharing benefit is recoverable with compact notes alone
• The number of shared findings isn't "more is better": for the smaller model (gemma-4-E4B-it), k=10 beats k=5 by 5.0 points, but more than that hurts accuracy; the larger model (gemma-4-31B-it) is far less sensitive to this budget (±2.0 points)
• Adoption threshold: first confirm your task actually needs multi-step collaboration (the orchestrator's routing step can filter out simple queries that don't), then decide agent count and shared-note budget — don't assume "more agents, more sharing" is automatically better
• Limitation: evaluation is concentrated on QA/reasoning tasks; the authors explicitly flag that future work needs to test the shared buffer on tool use, planning, and long-horizon execution; compute constraints also limited model-combination coverage

Reviewer's one-line take

Directly quantifying "asynchronous compact sharing vs. synchronous full sharing," rather than just proposing a new architecture and claiming it's better, is this paper's methodological strength; but the task types are currently concentrated on QA and reasoning, the venue is still unconfirmed, and whether the shared buffer extends to tool-use or long-horizon multi-agent settings is, by the authors' own admission, the next step.

Takeaways for you

• If your multi-agent system currently uses synchronous debate or full-trace sharing: test an asynchronous version that shares only compact intermediate findings first — this paper suggests most of the accuracy gain doesn't require full traces, and you can likely save a large share of tokens immediately
• If you're deciding agent count and collaboration depth for a multi-agent system: don't assume "more agents, more sharing" monotonically improves results — run a small-scale ablation to find your task's diminishing-returns point before committing resources

Today's Takeaway

I used to think "how complex should agent memory be" had one universal answer. Today I learned the answer depends on which role the memory is playing: conversational memory (Raw-RAG beating 12 complex systems) and multi-agent coordination memory (Muffin's lightweight shared buffer beating full-trace debate) both point toward "simple is enough" — but task-planning memory (MemPlan needing memory compiled into PDDL positive/negative constraints to beat pure language-memory agents) points toward "you need structured design." What makes these three interesting together isn't which one is "right" — it's that together they show memory was never a single problem. Asking which role you're designing for matters more than reaching for either slogan, "more complex is better" or "simpler is better."

References

• Is Complex Agentic Memory Always Needed? Naive RAG Is Stronger Than We Thought (arXiv:2610.30755)
• Naive RAG vs Agentic Memory — alphaxiv
• Naive RAG vs Agentic Memory — Hugging Face Daily Papers
• MemPlan: Memory-Conditioned PDDL Planning for Partially Observable Text Environments (arXiv:2610.30379)
• MemPlan — alphaxiv
• MemPlan — official repository
• Muffin - A Shared Memory Buffer for Asynchronous AI Agents (arXiv:2610.31355)
• Muffin — alphaxiv
• Muffin — anonymous code repository