- Serve the model with either Ollama or LM Studio (the latter 'hides' their traditional Studio on the download page for the agentic one they are preferring you use).
- For the model, Gemma 4 E4B is a nice combination of performance and speed with a decent context size. Not good enough for complex coding needs, but the Qwen models work okay for that (10GB GPU gets you less than you might think).
- For the interface I'd suggest either OpenCode or Pi.
Personally I run LM Studio and in the UI switch on its built-in OpenAI compatible API, then point OpenCode at that and run it alongside (not in) my IDE.
If you go Ollama be aware that its default context size is tiny, so if your model seems like an idiot that's the first thing to change.
- Serve the model with either Ollama or LM Studio (the latter 'hides' their traditional Studio on the download page for the agentic one they are preferring you use).
- For the model, Gemma 4 E4B is a nice combination of performance and speed with a decent context size. Not good enough for complex coding needs, but the Qwen models work okay for that (10GB GPU gets you less than you might think).
- For the interface I'd suggest either OpenCode or Pi.
Personally I run LM Studio and in the UI switch on its built-in OpenAI compatible API, then point OpenCode at that and run it alongside (not in) my IDE.
If you go Ollama be aware that its default context size is tiny, so if your model seems like an idiot that's the first thing to change.