Lora

Shared LoRA Subspaces for almost Strict Continual Learning

The paper shows that you can reuse a shared low-rank adapter space across many tasks instead of adding new adapters forever. That keeps performance high while holding down memory as models pick up new skills over time.