Ask HN: How do you use local LLMs?
What applications(as in use cases, not in software names) have you found for local LLMs that you use yourself on a daily basis, and which LLMs do you use?
What applications(as in use cases, not in software names) have you found for local LLMs that you use yourself on a daily basis, and which LLMs do you use?
not exactly daily, but I use llama3.2-vision (via ollama) to generate a .txt file alongside every photo I take, containing a description of the photo. then I can just grep for, say, "selfie":
or to do a slide show:You might be able to load up all the txt files into the embedded vector db in `llm` so that you could also query them semantically.
Great idea!