points by mydreamof 10 hours ago | 0 comments
One thing to consider is that even when some model has big gap between those two benchmark it doesn't mean it is much worse. It could be worse becasue he has assuptions based on training but on real scenario it wouldn't have it so it still could achive great results
But I agree witih you an important piece of the generalisation puzzle is missing.