Hacker News
Show HN: Maple – Sub-2-BPW Moe Pruning to Run Gemma 4 26B at 45 TPS on a 6GB GPU(github.com)
6 points by AmSach 5 hours ago | 2 comments
[–] tamnv 1 hour ago
I really like topics about optimization like this one. Great job, OP!
[–] peter_d_sherman 3 hours ago
Looks absolutely stellar!

Another step forward for local AI / local LLM inferencing on (very!) resource-constrained consumer GPU hardware!