The creator of Redis thinks your old GPU is not obsolete. Salvatore Sanfilippo, better known as antirez, published a pro...

The creator of Redis thinks your old GPU is not obsolete. Salvatore Sanfilippo, better known as antirez, published a project called DwarfStar (the repo is antirez/ds4) that runs DeepSeek V4 Flash, GLM 5.x, and DeepSeek V4 PRO entirely on consumer hardware: Macs, DGX Spark boxes, Strix Halo desktops, and older NVIDIA cards like Ada Lovelace and L40S. It hit the front page of Hacker News this week with hundreds of points, and the repo has already passed 21,000 stars.The interesting part is not just the speed numbers. It is the design decision behind them. Instead of being a general GGUF runner like llama.cpp, DwarfStar is deliberately narrow: it supports a short list of models, ships its own quantized weights, and tests the whole stack together, from tensor loading to tool calls to the HTTP server. One model, made to feel finished.Full disclosure before we go further: I have not run DwarfStar on my own machine. Everything below comes from the project's README and its official documentati...

Read Original

Related