ProLand is a retraction-free optimizer that separates objective optimization from orthogonality restoration for LoRA fin...

ProLand is a retraction-free optimizer that separates objective optimization from orthogonality restoration for LoRA fine-tuning.Source: arXiv cs.LGhttps://arxiv.org/abs/2611.00236#MachineLearning

Read Original

Related