You Should Still Fact-Check the 'Expert Advice' in Google's AI Summaries

Google's AI search is getting a handful of updates designed to highlight first-hand information sourced from discussion boards and social media posts along with your trusted news sources and subscriptions. Notably, AI responses will now show "expert advice" pulled from online forums like Reddit, highlighting specific quotes and linking to discussions related to your search queries. With this "preview of perspectives," you'll also see additional context for the discussion, including the creator's name, handle, or community name.

It should go without saying, but even when the results are billed as "expert advice" sourced from forums you'd typically go to for answers, you shouldn't blindly take them as fact. As TechCrunch notes, AI isn't great at detecting sarcasm and humor, and Google's AI Overviews have often recycled jokes made on Reddit as serious advice. In general, generative AI is also known to hallucinate, simply making things up and presenting everything from fake news summaries to non-existent legal advice with confidence. While AI Overview may be accurate around 90% of the time, according to a New York Times analysis, that means at least one in 10 responses will still contain errors.

In some ways, Google is facilitating fact-checking with other AI search updates: Source links will appear within AI responses next to the relevant text or bullet points, and you can hover over inline links to see a preview of the website before clicking through. AI Mode and AI Overviews will also highlight content from your news subscriptions first, so you know information is coming from sources you trust.

However, you should still do the extra legwork to ensure the information AI provides is legitimate. At the very least, click through to the source material cited to ensure it actually says what the AI claims it does, and assess whether the source itself is trustworthy. (Remember that "user-generated" doesn't necessarily mean "expert.") And use lateral reading strategies to find reputable sources supporting or refuting AI's claims.

View the full article