I recently searched for information on a potential pet poisoning. The google overview had the decimal spot in the wrong place.... confusing a lethal amount for a trivial amount. My pet was fine, but had it actually eaten more, and had I used the google answer as my yardstick, it could have not been.
Even the article acknowledges that the model used to do this test is flawed.
Google's AI Overview is incredible. It's an instant correct answer for self-verifying questions, and it's right most of the time for reasonably complex questions. If the first page of results would contain the answer to your question, and your question can be answered with only one prompt, it's right almost every time.
> If the first page of results would contain the answer to your question
You can find complaints on this site, not too long ago, that Google was failing to have good results anymore. I don't feel the ranking has particularly improved since then.
Considering the accuracy of journalists in general (contentious subject, but the studies I've seen seem to confirm the gell-mann amnesia effect to some degree), I'd say AI Overview isn't bad at least.
I recently searched for information on a potential pet poisoning. The google overview had the decimal spot in the wrong place.... confusing a lethal amount for a trivial amount. My pet was fine, but had it actually eaten more, and had I used the google answer as my yardstick, it could have not been.
Worst piece of enshitification in my daily life.
Even the article acknowledges that the model used to do this test is flawed.
Google's AI Overview is incredible. It's an instant correct answer for self-verifying questions, and it's right most of the time for reasonably complex questions. If the first page of results would contain the answer to your question, and your question can be answered with only one prompt, it's right almost every time.
> If the first page of results would contain the answer to your question
You can find complaints on this site, not too long ago, that Google was failing to have good results anymore. I don't feel the ranking has particularly improved since then.
Considering the accuracy of journalists in general (contentious subject, but the studies I've seen seem to confirm the gell-mann amnesia effect to some degree), I'd say AI Overview isn't bad at least.