Hacker News
points by UncleOxidant 4 days ago | 0 comments
That's the one I'm running using a fork of the gufo inference engine as gufo upstream doesn't support that quant.
[–] Zetaphor 4 days ago
I'm running a regular Q4, what about that quant format justifies the fork?
Hacker News