We Evaluated ChatGPT vs. Google on 500 Search Queries

A recent analysis compared the performance of ChatGPT and Google on search queries, revealing that despite not being optimized for search, ChatGPT often matches or surpasses Google's performance, particularly excelling in coding-specific queries. The study involved 100 evaluators who compared their recent informational searches on both platforms, finding that ChatGPT was preferred for 42% of the queries, while Google was favored for 40%. ChatGPT's strengths lie in its ability to synthesize information into concise, coherent responses without the clutter of ads, appealing to users seeking straightforward answers. However, the platform's tendency to present hallucinations and inaccuracies, especially in less common queries or those requiring up-to-date information, was noted as a significant drawback. The evaluation suggests that while ChatGPT shows promise as a competitor to Google, particularly with support from companies like Microsoft and startups like Neeva, You.com, and Kagi, it still requires improvements to fully challenge Google's dominance in the search engine market.