Note: This entire post is hand written. No AI or LLM touched this thought, but the author does self host LLMs as a curio...

Note: This entire post is hand written. No AI or LLM touched this thought, but the author does self host LLMs as a curiosity more than a "productivity tool"My personal favorite question around AI consciousness is where is it conscious?Let's assume that LLMs as they currently are are conscious. Whatever consciousness is, LLMs like Claude and ChatGPT has it, but in what part of the prompting process is it conscious?# How does an LLM work?## Loading into RAMFor those that don't know, LLMs aren't always on. When you start a program like Ollama, the LLM you have downloaded is off.Then you tell it to run a model like Gemma4. So Gemma loads into your RAM or VRAM so it can operate faster than off of your SSD. If its a small model it can take up only a few gigs of RAM or there's infinitely scalable ones like Qwen and Kimi that take up as much compute and ram as you allow.If you're using a more powerful tool on top of it like OpenWebUI you can give that bot access to libraries of specialized inf...

Read Original

Related