Hacker News

points by root_axis 1 day ago | 0 comments

> The better open models are the less you need frontier models

True in theory, but in practice hardware availability and cost will keep open source impractical for years to come.

It will be impractical to self host, but not to get one that's served from other providers (which won't have to recuperate loses from training).

[–] dontlikeyoueith 1 day ago

If your moat is "Our vendors aren't expanding fast enough to supply our competitors!", you don't have a moat.

[–] aleqs 1 day ago

It's already very practical lmao

[–] root_axis 1 day ago

It's really not. The hardware to support anything even remotely practical starts in the tens of thousands of dollars. Quantized 40b param models are impressive, but are basically toys.

[–] robotpepi 1 day ago

there are plenty of providers of open source models at lower prices than the frontier companies. you're just not well informed.