Generalist Robot Policy Evaluation in Simulation with NVIDIA Isaac Lab-Arena and LeRobot
Blog post from HuggingFace
The collaboration between NVIDIA and Hugging Face focuses on integrating NVIDIA's open robotics models and datasets with Hugging Face's LeRobot platform to advance open-source physical AI development. By combining NVIDIA's 2 million robotics developers with Hugging Face’s 13 million AI builders, the initiative aims to enhance the creation and evaluation of robotic policies using NVIDIA's Isaac Lab-Arena and the LeRobot Environment Hub. This integration allows developers to share, create, and evaluate simulation environments, facilitating the prototyping of complex robotic scenarios. Isaac Lab-Arena provides a scalable framework for robotic policy evaluation, and through the LeRobot platform, it supports the registration and sharing of custom environments. The partnership also promotes the use of open-source pre-trained models and datasets, such as the GR00T N vision language action models, which can be deployed on robot systems like the Reachy 2 humanoid. This initiative ultimately seeks to streamline robotics simulation and training processes, making them more accessible to the broader developer community.