points by OccamsMirror 2 days ago | 0 comments
> LLMs comparable to today's state of the art are going to be running on $1-2K machines in a few years
This is a huge claim. What makes you think this will be the case?
[–] timschmidt 2 days ago
[–] hedora 2 days ago
I'm drawing the line into the past. Back when Biden was president, a computer that currently runs Flash Next 125B well cost $1400.
But yeah, I assume that when the economy gets back to normal-ish, in 2024-equivalent dollars, we'll be at 500B-1T for < $2000. That'll be 3-4 Moore's Law doublings since computer prices were sane. 125B * 2 ^ 4 = 2T.
Seems like he's just drawing that line into the future. Which seems sensible enough.