https://evildevops.com/dev/ Recent content in Dev on evilDevOps Hugo en-us Mon, 21 Sep 2026 12:00:00 +0200 https://evildevops.com/dev/localllm/ Mon, 21 Sep 2026 12:00:00 +0200 https://evildevops.com/dev/localllm/ <h2 id="my-own-llm-at-home">My own LLM, at home</h2> <p>I have a GPU box in the homelab. An RTX 3080 with 10 GB of VRAM and a Core Ultra 7 265KF. For a long time it was mostly there to be a GPU box.</p> <p>Now it runs a local LLM, and it is live right now. The model and the chats run on my own hardware.</p> <p>It is all in one Git repo, if you want to run it yourself: <a href="https://github.com/JEA666/local_LLM">github.com/JEA666/local_LLM</a></p>