MemoryAthena:在隐式与生成记忆之间做自适应路由

HuggingFace Daily Papers(社区热门论文)·2026-09-22 08:00·2天前
AI 导读

MemoryAthena 提出在直接 Engram 检索(E)之外,增加从检索线索生成(GE)和不查记忆表的因果主干状态生成(GH)两条路径,并用轻量因果路由头判断生成表示何时介入。

HuggingFace Daily Papers(社区热门论文)
34AI 编辑部评分,满分 100

MemoryAthena:在隐式与生成记忆之间做自适应路由

2026-09-22 08:00· 2天前
AI 导读

MemoryAthena 提出在直接 Engram 检索(E)之外,增加从检索线索生成(GE)和不查记忆表的因果主干状态生成(GH)两条路径,并用轻量因果路由头判断生成表示何时介入。

Learned-memory methods store information in an explicit table and consume it through a separate reader, allowing addressing, storage, and reading to be modified independently. We study whether useful memory can also be generated rather than only retrieved. MemoryAthena uses three pathways: direct Engram retrieval (E), generation from retrieved Engram cues (GE), and generation from causal backbone states without consulting the memory table (GH). Generated memory is conditionally useful: it can complement E in one context but interfere with it in another.

MemoryAthena therefore treats E as an anchor and learns when a generated representation should intervene. With the backbone, memory, generators, and readers frozen, a lightweight causal routing head is trained from counterfactual future-token likelihood advantages of GE and GH relative to E. At inference time, an admitted candidate modifies the E residual through bounded interpolation, while rejection recovers the direct pathway exactly. On question answering, MemoryAthena raises the five-task average from 37.65 to 39.28 over the direct pathway of the same checkpoint, while the six-task general-NLP average increases from 76.73 to 79.13.

The complete memory-side system contains approximately 201M parameters, excluding the frozen backbone. Further analyses show complementary strengths among E, GE, and GH across tasks and inputs. These results support generated memory as a selective correction to direct retrieval and highlight routing when, which, and how strongly to intervene as the central challenge.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org