points by i2talics 9 hours ago | 0 comments
Who has incentive to improve the quality of the benchmarks?
[–] rat9988 9 hours ago
AI Labs actually. They would love the perfect benchmar representing real usecase. I'd even dare and guess that they don't share much publically because it is a huge competitive advantage.
[–] adastra22 2 hours ago
> they would love the perfect benchmar
That right there is the problem.
[–] Bolwin 9 hours ago
The benchmark makers and anyone who relies on benchmarks
[–] adastra22 2 hours ago