A local LLM chat app built on llama.cpp, Node and a hand-built web UI, plus what it took to make localhost secure and ship the same model on Android.
I built a private, offline AI chat you can run with one command: npx unmuzzled
Related
From five broken transformers versions to 4.45 seconds on the board: getting Qwen2-VL-2B's vision tower onto an RK3588
Two days ago this model wouldn't even export. Today its vision tower runs on a real RK3588 board: a...
Local AI models need to be a browser feature
I started thinking about the Web Models API while experimenting with building AI-native GUIs. I was...
Hybrid retrieval is decided by your tokeniser, not your fusion weights
Semantic search looks like it works until someone pastes a part number into the box. Ask a vector...