Hacker News
points by _ache_ 5 days ago | 0 comments
That is NOT my experience. I used to have a dump of screenshots where Google AI from search is absolutely wrong. In my experience, it doesn't work and "quoting" things never told in the source (the exact contrary sometime), responding in hindi, responding in spanish, responding in mix of languages.

Most of the time it's quicker, sometimes it's just bad.

[–] kakugawa 5 days ago
It hallucinates so frequently, that I've found it unusable. Just ask it to provide sources for all of its claims, then watch how many times it reverses its original answer. It's mind-boggling to me. I've repeatedly tried to give Google AI Search a chance, but after weeks of seeing this behavior I can't trust it anymore.

Imagine winning search by being the fastest and most accurate, then replacing it w/ constant hallucinated errors.

[–] runarberg 5 days ago
For me, I use it maybe ones or twice a month when my traditional search on DuckDuckGo fails. And, anecdotally, it is overwhelmingly wrong, and worse, confidently so.

Given my sample is biased as I am using it for an outlier of difficult web searches (including web searches localized to Iceland). But I would think that if your parent was correct, at least majority of my uses would be correct, but in my experience, Gemini fails most of the the time traditional web search fails. So to me at least, it is effectively useless.

For people who use it in place of normal web search, it is probably worse then useless, because of how confidently wrong it is.

[–] panarky 5 days ago
The argument is not that Google's AI summaries are infallible.

The argument is that there's so much garbage on the open web that clicking through to the source has a lower signal-to-noise ratio than the AI summary.

This rings very true in my experience.

Google's AI summaries definitely make mistakes, but in most cases they're higher signal than the source websites.

[–] andrewflnr 5 days ago
You're underestimating how obviously, laughably wrong the AI summary often is.

I really think Google is making an error using such a lightweight model for the page. That's one of my only firsthand exposures to genAI, and it's awful. Use a decent model, or if that's too expensive don't put up a summary at all.

[–] kakugawa 4 days ago
They used to prioritize accuracy first, then speed second.

Now it's just speed. This is a grave error.

[–] _ache_ 4 days ago
Once it quotes a gov website, exactly the contrary of the official source. Why ? Because on the official website you have checkboxes and the div shown is the one corresponding to your case and most surely the AI summary didn't have information about which one is which and just mix everything up.
[–] dpoloncsak 5 days ago
I think they model the model they use for these, probably at more cost to them. They've been much better as of late, imo
[–] smallerize 5 days ago
They what the model?
[–] dpoloncsak 4 days ago
I meant 'upgraded'....oops haha. Too late to edit.

'I think they upgraded the model...."

[–] warkdarrior 5 days ago
The model they model to model this is modeled by a model they model.
[–] k12sosse 4 days ago
The police police police police the police police.