A lot of people are pretty puritanical about gambling in general. I think prediction markets just push themselves harder and have an air of tech bro douchebaggery about them, so that's why they are currently getting most of the hate.