Not a specific entry, but in four years, there's never been a clear advantage of multimodal models and the results have been extremely lackluckster, even when you allow unbounded images alongside a fixed quantity of text.
"This year, we have merged the Multimodal and Interaction tracks into the Strict and Strict-small tracks. This is for two primary reasons: Firstly, there were insufficient submissions to warrant standalone tracks. Secondly, none of the submissions in the Interaction track outperformed models submitted to the Strict track, and *none of the submissions from Multimodal outperformed our baselines*. We will still allow participants to use multimodal data or interactive training procedures if they choose, but such data or learning procedures must conform to the rules of the Strict or Strict-small tracks.
> none of the submissions from Multimodal outperformed our baselines
I think that's a pretty weak point to your argument. They are saying that none of the contestants outperformed their baseline multimodal models and that there was very little multimodal submissions in the first place.
[–] suddenlybananas 1 day ago
[–] lostmsu 22 hours ago
Any specific entries?
[–] suddenlybananas 18 hours ago
"This year, we have merged the Multimodal and Interaction tracks into the Strict and Strict-small tracks. This is for two primary reasons: Firstly, there were insufficient submissions to warrant standalone tracks. Secondly, none of the submissions in the Interaction track outperformed models submitted to the Strict track, and *none of the submissions from Multimodal outperformed our baselines*. We will still allow participants to use multimodal data or interactive training procedures if they choose, but such data or learning procedures must conform to the rules of the Strict or Strict-small tracks.
Emphasis mine.
[–] lostmsu 13 hours ago
I think that's a pretty weak point to your argument. They are saying that none of the contestants outperformed their baseline multimodal models and that there was very little multimodal submissions in the first place.