Hacker News
points by orangecat 14 hours ago | 0 comments
Just give us back our RAM prices so that everyone can afford 256GB DDR5 and run their models locally!

And Sam's (correct) point is that that doesn't work. If everyone tried to run the same amount of inference locally with the same size models that they're currently doing, the shortage would be even worse.

Aún no hay comentarios.
Hacker News