Linear attention compresses memory into one fixed-size matrix. The hard part is editing it without scrambling everything else.
Editing a Compressed Memory
Linear attention compresses memory into one fixed-size matrix. The hard part is editing it without scrambling everything else.