Hacker News
points by iagiagiag 7 hours ago | 0 comments
It makes me sad because there are so many unexplored areas of AI research, even on text generation. Billions are invested in almost one idea, which very realistically isn't the most optimal way to do text generation, but a lot of companies are afraid of taking risks. I still wouldn't put $1b on JEPA but I prefer a world where we can try things like that.
[–] alansaber 7 hours ago
LLMs have very favourable exploration<>consolidation dynamics. An LLM alternative would need to display fundamental improvements at relatively large scales which is extremely challenging for new research.
[–] sidibe 3 hours ago
It's a lot easier to explore these other areas with the help of LLMs.