James Madison who wrote the first damn draft of the commerce clause doesn't agree with you.

Not only was he was alive to see this clarified by SCOTUS in Gibbons v. Ogden, 7 years after he left the presidency -- in letters, he was himself arguing that congress should regulate shipping services.

https://founders.archives.gov/documents/Madison/99-02-02-154...

Now, Ogden was arguing what you are -- that it only applied to the movement of physical goods -- but this was found to be the losing argument. And this was quite early on in that document's history.