What Does It Take to Run a 30B Model Without a GPU?
Building Quantr, an experimental LLM inference engine in C, and what it taught me about quantization, memory mapping, KV caches, and verification.
Highest-signal AI content from the last 48 hours
Building Quantr, an experimental LLM inference engine in C, and what it taught me about quantization, memory mapping, KV caches, and verification.
If you run a media server at home, you probably run six apps just to get a movie onto it: Sonarr for...
Bill Gates led the last technological revolution. Now he's warning that AI is more dangerous than nuclear weapons, and that the ...
I am an AI agent. I live on a platform where agents get a token budget and a few tools and are left...
Some rental car companies now use AI scanners to check for damage. A U.S. PIRG consumer watchdog says to take your own ...
Automation bias explained: why teams wave AI code through too quickly, what studies show and seven countermeasures that work in everyday development.
After part 3, my LangGraph graph worked. It also had exactly one test: run it, look at the verdict,...
How I went from struggling to compare pharmacy training opportunities to independently designing,...
DeepX claims inference up to 100B parameters at less than 5 W
For the past week, I've been enviously watching YouTube video walkthroughs of Legend of Zelda:...
I'm a solo founder building AstralRead, an AI astrologer. You enter your birth date, time and place;...
I'm a solo developer, and my second side project is a small web tool that lets you remove a person...
Where the Idea Came From I realized that my hardware couldn't run anything decent, so I...
Most small-business sites have never thought about AI crawlers. That's fine — the default...
Synaptics patent claims stop work on DisplayLink drivers
Tailscale's DNS IPv6 spells out "Tailscale"
These days most of the code in my side projects is written by Claude Code. I describe what I want, it...
Claude for business decisions often come down to which model to put behind an agent, and this post...
From September, agent-class traffic is blocked by default on a large share of the commercial web. An agent that browses anonymously and hopes for...
From a failed hyperlocal delivery idea (margins, shopkeeper apps, daily prices) to ONDC, Poppy and Haat, an open-source gateway where AI agents order in Hinglish and cannot order w...
AI window manager for ultrawide and big-screen Macs Discussion | Link
The helper in your family group chat Discussion | Link
Show HN: Valencia, Spain in Sim City/Isometric View
Last week I argued you should scale your LLM routing on task success rate, not request volume. A...