> for every doubling of model size the number of training tokens should also be doubled

Well, I don't think many claim that increasing the model size while also increasing the training tokens doesn't make sense.

The problem is how to get the training tokens...