Running an LLM fully offline on Android with Kotlin coroutines

How I wrapped llama.cpp in a small, coroutine-first Kotlin API, and the three problems that took the most time: threads, cancellation and broken emoji.

Read Original

Related