Shipping a Local LLM API with FastAPI and Ollama

Phase 2 of the de-swarm project — how I turned a 3B text-to-SQL model into a production API for...

Read Original

Related