Hacker News

points by 999900000999 4 days ago | 0 comments

>Oddly, the direction of the problem flips depending on power source. Unplugged, Linux hit around 61 to 67 tokens per second on LM Studio, comparable to Windows. Plugged in, that same test dropped to about 15 tokens per second.

Absolutely hilarious.

This is just incompetence. No reason Nvidia with its TRILLIONS of market cap couldn't of tested and fixed this on Linux before shipping.

Or a day one patch.

I have no doubt that'll it'll work right eventually. Long after RTX Spark laptops flop and can be purchased for half off.

Last night I pulled out my 5070TI laptop and installed CachyOS. I was running various models within about 20 minutes.

That 12GB of VRAM is a hard limitation, Unsloth can't split jobs between vram and system memory.

[–] crest 4 days ago

What makes you think this was an oversight?

[–] 999900000999 3 days ago

Because they also could of just locked the bootloader fully if they didn't want Linux to work.

Even from the article I'm guessing you could write a script to automatically extract the encryption keys while on Windows and the load those in Linux.

This is only mildly inconvenient for anyone who'd use this in a data center cluster.

[–] throw1234567891 4 days ago

> couldn't of tested

Could have tested.

[–] anonym29 3 days ago

Thanks, I had absolutely no idea what GP was saying, it was completely incomprehensible until you published this Rosetta Stone here.

[–] throw1234567891 3 days ago

Enjoy.