CARM++
Memory-aware LLM agents — testing how much conversational and task memory actually changes agent behavior, across seven controlled conditions.
01 General Idea
LLM agents that carry memory across a conversation or task face a tradeoff: too little memory and they forget useful context turn to turn; too much and they drown in irrelevant history, burning tokens and attention on things that don't matter anymore. CARM++ is an experiment in figuring out how much that memory setup actually matters in practice — running the same agent across seven controlled memory conditions (from no memory at all, to raw transcript, to more selective retrieval-style setups) and comparing how behavior and task performance actually shift.
The goal isn't to ship one "best" memory architecture — it's to get an honest, apples-to-apples read on which memory choices help, which are dead weight, and which actively hurt, before committing to a design.