Hacker News
points by selcuka 2 days ago | 0 comments
SSD offloading [1]:

> Unsloth Desktop + llama.cpp enables ~3x faster DeepSeek-V4.1 inference than other CPU/VRAM/ngram repos. DeepSeek and runs locally on 128GB+ RAM setups or 64GB RAM (slower).

[1] https://unsloth.ai/docs/models/deepseek-v4.1-flash

Aún no hay comentarios.
Hacker News