While these results are unsurprising considering how often we see issues with news summarization tools at the moment, including Apple Intelligence's mix-ups that have led Apple to temporarily remove the feature in iOS 18.3, it's a good reminder not to believe everything you read from AI.
The BBC asked ChatGPT, Copilot, Gemini, and Perplexity to summarize 100 news stories from the news outlet and then rated each answer to determine just how accurate the AI responses were.
A new study from the BBC has found that four of the world's most popular AI chatbots including ChatGPT are inaccurately summarizing news stories.
While this research doesn't necessarily give us much more info, it validates the skepticism towards AI summary tools and emphasizes just how important it is to take information from AI chatbots with a pinch of salt.
Sam Altman said in a blog post yesterday that AI is progressing faster than Moore’s law and that means we'll continue to see constant improvements to software and how it interacts with the world around it.
