LoRA on a 16 GB card: what fits and what does not

A 7B model is the honest ceiling for LoRA fine-tuning on a 16 GB consumer card, not because anything...

Read Original

Related