i've found a few narrow uses for #llm tools that can be provided by locally hosted, open-weight models and provide good ...

i've found a few narrow uses for #llm tools that can be provided by locally hosted, open-weight models and provide good value to mei'm using Gemma-4 26B A4B Q4_K_Mtext summariesmay require the same "kind" of text, as I iterated on my prompt several times, tweaking it based on a qualitative review of the output. doing that was tedious - but effective. not perfect, but neither are my own summaries. code reviewi'm working on a library and i gave the LLM my example code that shows how to use it, and the i got excellent criticism of how i structured the user-facing API. i'll be implementing its suggestions and it will make it a better library.therapy homeworkit's pretty good at helping with cognitive behavioural therapy homework, i.e.: help with thought records. it can help narrow down to the "hot thought" if that's difficult.

Read Original

Related