OpenTelemetry (OTel) is an open-source observability framework that provides standardized tools for monitoring and troubleshooting applications, including Large Language Model (LLM) applications, by collecting traces, metrics, and logs. The framework's adaptability and support for various exporters and backends enhance its utility in achieving better operational visibility, which is crucial for performance optimization and root cause analysis. LLM applications pose unique observability challenges due to their non-deterministic outputs and the need for real-time monitoring, which differ from traditional software systems that focus on exceptions and expected behaviors. The OpenTelemetry Special Interest Group (SIG) is working on standardizing semantic conventions and developing instrumentation libraries to address these challenges, with a focus on popular model vendors and frameworks. Despite facing issues such as large traces and diverse schema implementations, the potential for increased interoperability across platforms through OTel's standardized data model is promising. The ongoing efforts aim to crowdsource instrumentation, alleviate the burden on vendors, and enhance the consistency and reliability of observability across various LLM frameworks and platforms.