points by npodbielski 2 days ago | 0 comments
2) I am running Qwen Flash Next on Strix Halo with Halogen inference server. This is great setup that can get you 4 concurrent agents for 300W of power with 1k prefill and 30-80tk/s decode. I do not fill like using subs that I have from work with this.
Aún no hay comentarios.