Meet SolarAI LLM Server V2, now complete. Probably the world's first quad GPU, DDR3 based rig using HDDs for LLM storage that generates 33.4 tps with the Strata QWEN3.8-120b model, and it cost me about a grand USD.This is the hardware/software stack:-Asus Z9PE-D16 motherboard-CPU: 2x Intel Xeon E5-2620 V2 Processor-GPU: FOUR NVIDIA Tesla P100 16GB PCIe (64GB VRAM)-RAM: 128GB DDR3-Storage: 120GB SSD for OS-Storage: FOUR 500GB WD Velociraptor HDDs for models-OS: ubuntu-24.04.5 server amd64-CUDA 12 for PascalIt will run my Hermes/Home Assistant, and is not used to generate slop.#AI #homelab #homeassistant #llm #hermesagent #selfhosted #selfhosting
Meet SolarAI LLM Server V2, now complete. Probably the world's first quad GPU, DDR3 based rig using HDDs for LLM storage...
