Distillation

DuoMem: Towards Capable On-Device Memory Agents via Dual-Space Distillation

DuoMem teaches small on‑device agents to manage long‑term memory by distilling from larger systems in both embedding and token space. It shows strong gains on long‑horizon tasks while staying phone‑friendly. This is useful if you want agents that remember across sessions without streaming everything to the cloud.