The statement was that for many STOCHASTIC phenomena in science, the simplest model of them is a probabilistic model. The statement was not that probabilistic models are the simplest models.

(One could make a meta statement here about how faulty some human's modeling of their linguistic inputs is.)