TheFork, a prominent European restaurant discovery and booking platform, leverages AI to enhance customer experiences and streamline operations, employing technologies like generative AI and LLMs to improve search retrieval and customer service. Key initiatives include a semantic search tool called "Ask TheFork" and an AI-powered chatbot for customer service, both of which utilize Arize AX on AWS for real-time evaluations and monitoring. TheFork uses Amazon SageMaker and OpenSearch for scalable data services, with Arize AX providing prompt-level tracing, automated evaluations, and drift alerts to maintain high service quality. By focusing on attribute-driven online evaluations, TheFork identifies and improves high-impact areas, reducing latency and enhancing retrieval quality. Since implementing Arize AX, TheFork has achieved significant operational gains, including reduced latency and better cost governance, enabling more efficient iterations and alignment across teams. Additionally, the platform's AI architecture emphasizes automated documentation and governance to ensure strategic alignment and data-driven decision-making, leading to tangible improvements in performance and cost management.