> Why do we expect this to get better? The training data will degrade in quality if more people rely on LLMs so I'd expect models to eventually start getting worse even if they currently enjoy apparent improvements in output.

You are assuming that AI should be trained on speicific field to reason better but it actually doesnt need to.