#sparse-adapters

JumpLoRA's Sparse Adapters Break the Assumption That Continual Fine-Tuning Requires Full-Rank LoRA Stacks

JumpLoRA adds learnable JumpReLU gates to LoRA blocks for 87-95% sparse adapters with near-zero cross-task overlap. The work exposes that PEFT has no router for continual.