Google's AI advantage: why crawler separation is the only path to a fair Internet

The UK's Competition and Markets Authority (CMA) has initiated a consultation on proposed conduct requirements for Google, aiming to address issues of choice and transparency faced by publishers regarding Google's use of their content in generative AI services. These consultations are the first of their kind under the UK's Digital Markets, Competition and Consumers Act 2024, which allows the CMA to designate companies with Strategic Market Status (SMS) and impose conduct requirements to enhance competition. Google, holding a significant market share in search and AI applications, has been designated with SMS, enabling the CMA to propose rules that would give publishers control over the use of their content for AI purposes and ensure proper attribution. However, concerns remain that the proposed rules do not adequately empower publishers to manage their content independently, and suggestions have been made to separate Google's crawlers to prevent the misuse of publisher content. Cloudflare and other stakeholders advocate for stronger measures to ensure fair competition in the AI market and protect the interests of content creators, emphasizing the need for the CMA to enforce solutions that offer genuine control and promote a balanced digital ecosystem.