2025 State of AI Engineering Survey: Key Insights from the AI Engineer World Fair

The 2025 State of AI Engineering Survey by Barr Yaron from Amplify Partners provides an in-depth look at how engineering teams are developing, managing, and scaling large language model (LLM)-powered applications in production, revealing critical insights from 500 practitioners. The survey highlights the fast-paced iteration of models and prompts, with a significant number of teams updating models monthly or more frequently, and even more rapid updates to prompts. Despite the widespread use of prompt management tooling, a notable portion of teams still rely on ad-hoc solutions, indicating a gap in structured prompt management practices. The survey also underscores the dual utility of LLMs in both internal and customer-facing applications, while highlighting the challenges associated with deploying AI agents, which require more rigorous evaluation and monitoring strategies. Human review remains the preferred method for quality assessment, despite advancements in automated evaluation. OpenAI models dominate production deployments, and the survey indicates a trend towards the convergence of open-source and closed-source model capabilities. The findings suggest that as AI engineering becomes a core competency across teams, the need for robust observability and management platforms grows, with PromptLayer offering a comprehensive solution for prompt engineering and evaluation.