Teleoperate and collect robot data with LiveKit Portal
Blog post from LiveKit
LiveKit Portal is a sophisticated framework designed to facilitate the remote operation and data collection of robots, addressing challenges such as security, latency, and synchronization. It enables teleoperation by seamlessly integrating observation syncing, which combines camera frames and joint states into coherent, real-time snapshots, ensuring clean and aligned training data. This capability is critical for robotics teams who operate robots they cannot physically reach, allowing them to collect teleoperation data and perform remote inference on real hardware. The system supports multiple operators and policies in a flexible, video-call-like environment, allowing easy handoffs between human operators and automated policies. LiveKit Portal provides observability by offering live metrics snapshots that aid in monitoring and optimizing the robot's performance and handling network variations. It is designed to work effectively both over the internet and within localized networks, offering high fidelity data collection through various video codecs. This versatility enables robotics developers to focus on robot functionality rather than the intricacies of network transport, making it a valuable tool for both local and distributed robotic deployments.