If I enter a "Make pottery" monthly challenge locally, and show up with a robot that produces mugs, I'm sure it'd spawn some interesting conversation nonetheless, but I'd also expect the organizers to tell me I didn't quite get the spirit of what they're doing.

It's pretty much the same here. The purpose of these "jams" or "challenges" isn't to see if LLMs can do those things, obviously they can, we all know this already. The point is for you to personally challenge yourself, and improve yourself. That's the spirit at least.