How Torc hit 90% GPU utilization and other stories on scaling AI with Ray from Discord, Cubist, and Coinbase
Blog post from Anyscale
Ray Day: NYC, a key event in Anyscale's 2026 Ray on the Road series, brought together AI practitioners, Ray developers, and the Anyscale team to explore the intricacies of scaling AI workloads using Ray. The event featured presentations from companies like Torc Robotics, Discord, Cubist/Point72, and Coinbase, each sharing their experiences of transitioning to Ray to overcome challenges in AI infrastructure. Torc Robotics highlighted their success in boosting GPU utilization for autonomous trucking, while Discord detailed its transition from open-source Ray to the Anyscale platform to manage its growing machine learning demands. Cubist/Point72 discussed their use of Ray for model fitting in quant finance, and Coinbase presented their journey of enhancing batch ML processes with Anyscale Job Queues, achieving significant improvements in job stability and cost efficiency. The day also included hands-on workshops on Ray's core features, distributed training, and robotics simulation, offering insights into the future of AI infrastructure.