points by codeulike 1 day ago | 0 comments
The existence of LLMs is telling us something, surely it means something. I'm not sure we've quite figured it out yet but its probably something along the lines of 'intelligence might not be as complicated as we thought' ... a fourth narcissistic blow to humanity after Copernicus, Darwin and Freud.
[–] goatlover 1 day ago
We train them on the sum of human knowledge available in digital format, so I'm not sure that's an indictment, and the large models are incredibly complicated to the point it's hard to reverse engineer how they work so well and what they're actually doing to build internal models to predict the next token. Several billion to several trillion parameters is anything but simple.
[–] codeulike 1 day ago
Right, we needed compute on a large and fast scale to make LLMs actually work. But the basic principles are quite simple: train on a huge dataset for long enough, using some fairly simple ML maths but across a very large dimensional space, and then out the other side you get something that can competently use language, and is capable of doing useful work. This is somewhat surprising, no?
[–] ckcheng 1 day ago
The narcissism might not be in thinking 'intelligence might not be as complicated as we thought’ - the narcissism might be in thinking ‘LLM intelligence is the way we thought’.
[–] trgn 1 day ago
I understand the charge, but it's soemwhat unfair. It's more like we start to see a correspondence which even 20 years ago was barely considered
[–] goatlover 1 day ago
It's also not the first time a breakthrough technology was compared to the human brain/mind, but we also know biologically animal nervous systems are not digital computers, telephone/telegraph networks or hydraulic systems.
[–] codeulike 1 day ago
I'm not saying LLMs work in the same way as us. But a few years ago humans used to be the only competent users of language on the planet. Now its humans + LLMs who are competent users of langauge. This is a big change, and I'm saying that it might be pointing to something deeper about complexity and how approaches to deal with complexity arise in the universe.
[–] trgn 20 hours ago
sure, but its facile to dismiss these breakthroughs as naive metaphors. physicans do understand now many bodily systems can be modeled with the same tools an engineer will model his machines. its not because these abstractions are incomplete, they are wrong.
[–] peterfirefly 1 day ago