▲
Hacker News
new
|
best
|
ask
|
show
|
jobs
points by
t0mas88
4 days ago | 0 comments
Realistically a 32GB card is what you need to run Gemma4:31b well. Doing it in 24GB leaves almost no room for context / KV cache.
[–]
ActorNightly
4 days ago
32k context is plenty fine. thats 50 pages of single spaced text
[–]
leansensei
1 day ago
Not if you preserve reasoning in the KV cache, 32k ctx is nothing.
[–] ActorNightly 4 days ago
[–] leansensei 1 day ago