Study Finds Google AI Prefers YouTube Over Medical Sites for Health Queries
Recent research reveals that Google’s AI Overviews primarily references YouTube over established medical sites for health-related queries. This finding raises significant concerns about the reliability of the information provided by the AI tool, which is seen by approximately 2 billion users monthly.
Study Findings on AI Overviews
The study, conducted by SE Ranking, focused on over 50,000 health queries in Germany. Researchers discovered that YouTube accounted for 4.43% of AI Overview citations. This statistic highlights a reliance on a platform not dedicated to medical publishing, where anyone can upload video content.
Rank of Cited Sources
According to the analysis, the distribution of citations from AI Overviews is as follows:
- YouTube: 20,621 citations (4.43%)
- NDR.de: 14,158 citations (3.04%)
- Msdmanuals.com: 9,711 citations (2.08%)
- Netdoktor.de: 7,519 citations (1.61%)
- Praktischarzt.de: 7,145 citations (1.53%)
Researchers emphasize that YouTube is not a medical authority. It hosts content from various contributors, including wellness influencers and untrained creators, alongside professionals.
Concerns About Health Information
The implications are serious, as previous investigations have shown that misleading health information can pose risks to public health. For instance, Google once provided inaccurate details about liver function tests, potentially endangering individuals with underlying health conditions.
- 82% of health-related searches featured AI Overviews.
- The study only reflects German-language queries and cannot be generalized globally.
Expert Opinions
Hannah van Kolfschooten, a researcher in AI and health law, commented on the serious structural risks presented by AI Overviews. She noted that the findings suggest a preference for visibility over medical reliability in the AI’s design.
Google’s Response
In response to the concerns raised, a Google spokesperson defended the AI Overviews, arguing that reputable sources are still cited. They highlighted that 96% of the top 25 YouTube videos referenced in the Overviews came from medical channels.
Despite this reassurance, experts warn that these cited videos represent less than 1% of all videos linked by AI Overviews. Consequently, the accuracy of the remaining content remains uncertain.
The study signals a need for critical examination of AI-generated health information, particularly the reliance on platforms like YouTube for essential health guidance.
