llama-cli, from llama.cpp, is a nice tool for chatting with a downloaded LLM model and feel how much time/RAM it takes t...

llama-cli, from llama.cpp, is a nice tool for chatting with a downloaded LLM model and feel how much time/RAM it takes to have a conversation with a stochastic parrotNote that llama.cpp is open source, distributed under the MIT License, git clone https://github.com/ggml-org/llama.cpp#LLM

Read Original

Related