A modern guide to preference-tuning SmolVLM2 with Direct Preference Optimization, TRL, PEFT LoRA adapters, and the current Transformers image-text API.
Human Preference Tuning for Small VLMs: SmolVLM2 + DPO in Transformers 5.12.1
Related
From five broken transformers versions to 4.45 seconds on the board: getting Qwen2-VL-2B's vision tower onto an RK3588
Two days ago this model wouldn't even export. Today its vision tower runs on a real RK3588 board: a...
Local AI models need to be a browser feature
I started thinking about the Web Models API while experimenting with building AI-native GUIs. I was...
Hybrid retrieval is decided by your tokeniser, not your fusion weights
Semantic search looks like it works until someone pastes a part number into the box. Ask a vector...