Hacker News
points by slashtom 2 days ago | 0 comments
I appreciate it, just started getting into 'vibe' coding converting some non arm (mac) apps into arm and it's pretty magical on this 128gb m5 max, a little slow but it can run deepseek flash 1017 pretty well.

Watched a few youtube apps about a 'harness' and I still haven't dived too deep into it but using openchamber to work with the code is awesome. Next step is MCP to various apps and seeing what it can do.

[–] ricardobeat 2 days ago
> it can run deepseek flash 1017 pretty well.

What do you mean? DeepSeek Flash 1017 is well over 200GB even at 1 bit quantization, how are you running it locally?

[–] selcuka 2 days ago
SSD offloading [1]:

> Unsloth Desktop + llama.cpp enables ~3x faster DeepSeek-V4.1 inference than other CPU/VRAM/ngram repos. DeepSeek and runs locally on 128GB+ RAM setups or 64GB RAM (slower).

[1] https://unsloth.ai/docs/models/deepseek-v4.1-flash