Queryable LoRA: Instruction-Regularized Routing Over Shared Low-Rank Update Atoms
We present a data-adaptive method for parameter-efficient fine-tuning of large neural networks. Standard low-rank adaptation methods improve efficiency by restricting each layer up...