points by DoesntMatter22 4 days ago | 0 comments
It's not considered a paper until it's vetted by others?
[–] davrosthedalek 4 days ago
In most fields of science, it's not a paper until it's accepted for publication in a journal. That normally includes peer review of some sort.
[–] NitpickLawyer 4 days ago
Yeah, that's not gonna happen in ML, where a positive result (even in blog form) can be (hopefully) trivially tested and confirmed.
From memory, yolo and roberta and ppo were initially rejected. After a quick google search, pagerank was initially rejected, word2vec got one weak and one strong reject in reviews, LSTM got rejected (90s but still), dropout, knowledge distillation, and many more such cases. All of these are extremely important, foundational and field defining papers that ended up on arxiv or other preprint places.
If that happened to those papers, there's 0 chance today that it'd be a good idea. The field is simply moving too fast, there's too much being published, and the "top venues" are simply swamped. Blog / preprint / carrier pigeon is ok atm, as long as someone can look at it, try it, and hopefully reproduce it.
[–] davrosthedalek 4 days ago
Yes, but I still think that a blog should have less weight (and I would also expect it to be less polished) than a preprint. I wouldn't necessarily expect that a blog has enough info in it to make it reproducible exactly, maybe just gets an idea across, while a preprint should be on the level of "the authors think a reviewer will accept it".
[–] mccoyb 4 days ago