I was unhappy with bloated #llm proxies, so I built my own: https://garrit.xyz/posts/2026-11-11-introducing-llmteeThe image is ~25 MB and Postgres is optional. Memory footprint is around ~40 MB and added latency is ~0.2 ms compared to ~8 ms with #LiteLLM.Try it out right now with:```docker run -d --name llmtee -p 8080:8080 -v llmtee-data:/data -e LLMTEE_ADMIN_PASSWORD=change-me ghcr.io/garritfra/llmtee```Then point #claude at it:```export ANTHROPIC_BASE_URL=http://localhost:8080/anthropicclaude```
Related
This has surely NOTHING to do with Microslop vibe coding their shit for the past year or so,or firing 40% of their staff...
This has surely NOTHING to do with Microslop vibe coding their shit for the past year or so,or firing 40% of their staff that actually did work.#Microslop #OutlookDown #LLM #Shitco...
The headlines on #YouTube political #videos are getting ever more ridiculous. Not only are the thumbnails usually #AI di...
The headlines on #YouTube political #videos are getting ever more ridiculous. Not only are the thumbnails usually #AI distortions of real images, but the captions always now tend t...
Very excited about this new track at #live360 next week! #ai combined with enterprise #architecture - business and tech ...
Very excited about this new track at #live360 next week! #ai combined with enterprise #architecture - business and tech and AI all coming together from a set of excellent speakers!...