Hacker News

points by gkcnlr 3 days ago | 0 comments

The sole reason LLMs has gotten this good is because their aggressive expansion has been accompanied with literally this. The amount of uncredited information these models have been fed must be astonishing, also terrifying.

[–] synalx 3 days ago

I think the heavily subsidized subscriptions are exactly for this purpose - the training data they generate is worth the high subsidy.

[–] jpardoe 2 days ago

They're almost certainly making a profit on subscriptions.

[–] cj9 1 day ago

Right, but they are also certainly looking to make higher profits overall by avoiding having to pay for large amounts of (confidential and/or private) training data. Most of what they have would never be for sale either.

[–] jpardoe 1 day ago

Seems smart.

[–] red-iron-pine 3 days ago

i mean openai basically said as much, no? it's free for all so that they can train the models better and get real world interaction data.

[–] cma 3 days ago

Yes, Altman called it the data flywheel in 2022.

[–] terramauthe 3 days ago

yeah, but in 2026 the interaction data of the average user isn't adding much to training. only the really exceptional users.

[–] cma 1 day ago

They can filter for the exceptional users, but the data flywheel is also about getting access to private codebases, not just the interaction in the chat.

[–] MisterMunchkin 3 days ago

Why do you think they’re getting into consulting now?

Imagine all those tasty confidential IP and contract documents they have ingested. You couldn’t buy those.