FIM Autocomplete at < 150ms: Tree-sitter, nomic Embeddings, and StarCoder2-3B on a Laptop

Step-by-step: build a < 150ms fill-in-the-middle autocomplete engine using Tree-sitter chunking, nomic-embed-text, Chroma, and StarCoder2-3B. Part 1 of building Dhi — the open-source AI coding IDE.

Read Original

Related