Fed-SE (arXiv 2512.08870): aggregating LoRA updates in a shared low-rank subspace beats full-weight averaging - cuts neg...

Fed-SE (arXiv 2512.08870): aggregating LoRA updates in a shared low-rank subspace beats full-weight averaging - cuts negative transfer across agents, +18% success. Roger Federated already aggregates only QLoRA deltas. #FL #opensource #LLM https://github.com/roger-federated/roger-federated

Read Original

Related