Why would this be the last juice? We’ll probably see 10x more scale and 10x more / better RL in the coming year. I’m very bullish that that will improve LLMs a lot.
The scaling laws say deminishing returns. 10x scale is not a 10x improvement, maybe more like 1.05x at this point.
I have a gut feeling this is the last juice because for 2 years now they have been "beating benchmarks" yet relatively simple tasks they still can't do sometimes
I have a gut feeling this is the last juice because for 2 years now they have been "beating benchmarks" yet relatively simple tasks they still can't do sometimes