May 2023 is pretty much prehistory in AI time. No conclusions from that era about what AI cannot do are valid.

We're starting to approach four digits of LLM-made mathematical papers, cybersecurity being almost entirely taken over by AI redteaming, initial forays into physics, biotech and pretty much every field... and we're going to use some dude prompting GPT-4 about Velcro to form the basis of an opinion? Even back then, using the word "never" was intellectually questionable at best.

The mantra of AI not innovating is getting pretty tired at this point. It's simply wrong as a matter of fact. If the goalpost has shifted so much that solving millenium prize problems is not "innovating", then the goal is no longer on the same continent.