I guess maybe another anecdotal comment, but I'm an engineer myself, have a home server for simple stuff, and I pay $200 a month to chatGPT for a pretty simple usage and really don't see myself go and run my own open source model, especially at the speed at which they evolve and change.
99% of the world will not setup their own open source model, just like 99% of the world is not setting up their own servier with ssh copy whatever the dropbox comment was saying.
[–] anon373839 1 day ago
[–] compass_copium 1 day ago
[–] dofm 1 day ago
If it were not for the x86 architecture they would almost have models that could answer those queries on their desks. (Gemma 4 E4B QAT is surprisingly good at this stuff; Gemma 4 12B QAT is great at it).
If I was Sam Altman I would consider giving Intel and AMD money to not develop unified memory architectures.
[–] singpolyma3 1 day ago