Hacker News

points by pxmpxm 4 days ago | 0 comments

Err strata is just a fork of llama cpp with fancier uis, right?

Strata manages MoE expert offloading completely differently, which for QFN means ludicrous speed.