Hacker News
points by t0mas88 4 days ago | 0 comments
Realistically a 32GB card is what you need to run Gemma4:31b well. Doing it in 24GB leaves almost no room for context / KV cache.
[–] ActorNightly 4 days ago
32k context is plenty fine. thats 50 pages of single spaced text
[–] leansensei 1 day ago
Not if you preserve reasoning in the KV cache, 32k ctx is nothing.