Hacker News

points by NitpickLawyer 3 days ago | 0 comments

> a flood of 8x B300 will be homelab ready in a few months

Haha, that's beyond wishful thinking, I'm afraid. We're not even seeing a flood of A100s (6 yo and several generations old). Every GPU is still being squeezed right now, and the trend will probably continue for the foreseeable future.

[–] throwup238 3 days ago

Last I checked AWS still sells EC2 instances using 2018 era GPUs. Most people underestimate just how much long tail demand there is and how long these cards last, despite the higher power consumption.

[–] fauigerzigerk 3 days ago

Yes, but if data center space gets tight, it creates an incentive to replace old inefficient models with better ones, i.e. sqeueeze more performance out of limited data center space.

[–] thway15269037 3 days ago

IIRC some companies were running campaigns like "we buy your old hardware so you won't sell it in aftermarket and crash the prices". It all ends in landfill.

I wouldn't be surprised if RAM cartel or nvidia will attempt something like that, plus nvidia already talks about license-locking GPUs.

Also, again, IIRC, IBM hardware already works this way. There are almost no aftermarket when I last checked for them because it's all locked up and useless.

[–] largbae 3 days ago

Maybe, but A100s and H100s were air cooled. Space is just part of the problem.