TRL v1.0: Post-Training Library Built to Move with the Field

TRL v1.0 represents a significant evolution from a research codebase to a robust library that supports production systems in the ever-changing field of post-training machine learning. This version reflects a deliberate shift to accommodate the dynamic nature of the field, which frequently redefines core components and methods, such as those used in preference and reinforcement learning. The library's design emphasizes stability and adaptability by minimizing abstractions and allowing for both stable and experimental features to coexist. This approach enables TRL to incorporate new methods rapidly while maintaining a stable infrastructure, evidenced by its substantial monthly downloads and widespread use in projects like Unsloth and Axolotl. Version 1.0 is not a claim of field stabilization but rather a commitment to adaptability, ensuring TRL can integrate emerging methods and technologies as the field evolves.