> For which they should be dragged in front of a court and sued for millions and billions, if it is found out, that they were simply wrong. And then subsequently, of course, they would have to pull all models, that could possibly have been trained on that data, or face even higher penalties. Haha, but of course I am just dreaming here.

Nah, you got it backwards: the frontier labs don't answer to the courts. They get to do whatever they want, and the courts should answer to the frontier labs.