Anyscale Blog - Plushcap

Blog URL

www.anyscale.com/blog

Posts YTD

46 ↑ vs 25 last year

Avg Posts/Month

4.4 since 2021

Monthly Post Volume

Start year:

Post Details

Search:

Title	Author	Published	Words	HN Pts
Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Models to Unique Applications	Kourosh Hakhamaneshi, Rehaan Ahmad	2023-08-11	5,637	308
How Ray and Anyscale Make it Easy to Do Massive-Scale Machine Learning …	Richard Decal	2022-11-08	1,563	--
Wildlife Studios Serves In-game Offers 3X Faster at 1/10th the Cost with …	Tricia Fu	2022-11-08	1,064	--
Announcing Ray 2.0	Anyscale Ray Team	2022-08-23	705	--
Building Highly Available and Scalable Online Applications on Ray at Ant Group	Tengwei Cai, Yang Liu, Chengxi Luo	2021-09-08	2,322	1
Four Reasons Why Leading Companies Are Betting On Ray	Zhe Zhang, Ion Stoica, Ben Lorica	2022-10-19	1,580	--
How Anastasia accelerated their ML processes 9x with Ray and Anyscale	Juan Roberto Honorato	2021-08-31	1,290	--
Online Resource Allocation with Ray at Ant Group	Xingyu Lu, Yang Liu, Tengwei Cai, Fengbin Fang	2021-03-30	1,838	1
Why you should build your AI Applications with Ray	Ben Lorica, Ion Stoica	2021-05-04	1,375	--
Autoscaling clusters with Ray	Ameer Haj Ali, Javier Redondo	2021-05-17	2,325	--
Anyscale Unveils Ray 2.0 and Anyscale Innovations at Ray Summit 2022; Adds …	-	2022-08-23	827	--
Ray Summit, the Industry Event for Scalable AI, Unveils New Innovations in …	-	2022-08-24	557	--
Machine Learning for Developers	Goku Mohandas	2023-07-26	688	--
Processing 2 Billion Images for Stable Diffusion Model Training - Definitive Guides …	Max Pumperla, Marwan Sarieddine	2024-05-14	4,209	--
Introducing Anyscale: The Future Is Distributed	Robert Nishihara	2021-12-07	702	1
Best Machine Learning Talks from Ray Summit 2021	Michael Galarnyk	2021-07-20	746	--
Ray Summit 2022 stories - ML Platforms	Anyscale Ray Team	2023-03-03	628	--
How to Speed Up Pandas with Modin	Michael Galarnyk	2021-03-03	1,041	--
Ray Forward 2022	Zhe Zhang	2022-08-18	1,855	--
Introducing Collective Communication Primitive APIs in Ray	Hao Zhang, Richard Liaw	2021-05-28	1,494	--
Running and Monitoring Distributed ML with Ray and whylogs	Anthony Naddeo, Danny Leybzon	2021-11-22	1,523	--
How Nixtla uses Ray to accurately predict more than a million time …	Nixtla Team	2022-06-13	1,152	--
Ray 1.13: Improving support for shuffling terabyte-scale and larger datasets	Stephanie Wang, Jiao Dong, Dmitri Gekhtman, Sang Cho	2022-06-09	680	--
LiveEO supercharges their ML infrastructure and accelerates their geospatial workloads practice	Toby Rahloff, Phi Nguyen, Alex Streed	2023-04-14	658	--
Serverless Kafka Stream Processing with Ray	Javier Redondo	2021-07-13	3,413	--
Reinforcement learning sessions at Ray Summit: A guided tour	Avnish Narayan, Christy Bergman, Jun Gong	2022-06-23	874	--
Building an end-to-end ML pipeline using Mars and XGBoost on Ray	Chaokun Yang, Yiming Yu	2022-01-05	2,161	--
Anyscale Endpoints: Embedding endpoint, Llama-2 70B fine-tuning and improved sign-up experience	Anyscale team	2023-11-30	376	--
The 2021 Ray Community Pulse Survey is Now Open	Michael Galarnyk	2021-05-12	432	--
Fine-Tuning LLMs: LoRA or Full-Parameter? An in-depth Analysis with Llama 2	Artur Niederfahrenhorst, Kourosh Hakhamaneshi, Rehaan Ahmad	2023-09-06	3,597	22
Announcing Ray 2.3: performance improvements, new features and new platforms	Richard Liaw, Cade Daniel, Jules S. Damji, Zhe Zhang	2023-02-24	1,329	--
Why I joined Anyscale	Jaikumar Ganesh	2021-11-29	791	--
Fast AutoML with FLAML + Ray Tune	Qingyun Wu, Chi Wang, Antoni Baum, Richard Liaw, Michael Galarnyk	2021-08-24	1,802	--
Building a Self Hosted Question Answering Service using LangChain + Ray in …	Waleed Kadous	2023-05-08	1,693	--
Ray 1.12: Ray AI Runtime (alpha), usage data collection, and more	Paige Bailey, Richard Liaw, Jian Xiao, Chandler Gibbons	2022-04-14	570	--
How to Speed Up XGBoost Model Training	Michael Galarnyk	2021-12-15	1,068	--
Siemens brings reinforcement learning to energy, transportation and logistics	Erik Martinez	2022-05-03	334	--
How Spotify Built a Robust Ray Platform with a Frictionless Developer Experience	Anyscale Ray Team	2023-11-09	1,259	--
How continuous batching enables 23x throughput in LLM inference while reducing p50 …	Cade Daniel, Chen Shen, Eric Liang, Richard Liaw	2023-06-22	3,568	110
Building an LLM open source search engine in 100 lines using LangChain …	Waleed Kadous	2023-04-18	1,780	3
What is hyperparameter tuning?	Juan Navas	2022-02-08	1,832	--
10 must-attend Ray Summit sessions: Generative AI, scalable ML workloads, and more	Jules S. Damji, Ben Lorica	2023-05-10	1,078	--
Improve Utilization and Simplify Cluster Management with Anyscale Job Queues	Dominic Catalano, Alexey Kudinkin	2024-07-23	735	--
Ray Summit 2021 CFP Now Open!	Zhe Zhang, Ben Lorica	2021-01-13	230	--
Ray 1.11: Redisless Ray, a docs redesign, and Python 3.9 support	Mingwei Tian, Chandler Gibbons	2022-03-09	701	1
Ray Summit 2024 Call for Proposals is now open	Anyscale team	2024-04-19	264	--
Deploying XGBoost models with Ray Serve	Simon Mo, Chandler Gibbons	2022-03-02	1,524	--
Anyscale and Meta Collaborate to Advance the Llama-2 Ecosystem	Robert Nishihara, Joe Spisak	2023-09-07	325	--
Open Source LLMs: Viable for Production or a Low-Quality Toy?	Anyscale Ray Team	2023-11-20	855	--
New in KubeRay 0.2.0: Autoscaling (alpha), simplified installation, and more	Jiaxin Shan, KubeRay Team	2022-04-19	524	--
How ByteDance Scales Offline Inference with multi-modal LLMs to 200 TB Data	Amog Kamsetty, Hao Chen, Liguang Xie	2023-08-14	1,872	7
Ray 2.5 features training and serving for LLMs, Multi-GPU training in RLlib, …	Richard Liaw, Jules S. Damji	2023-06-13	1,681	--
Llama, Scaling Up LLMs in an Open Ecosystem	Anyscale Ray Team	2023-10-16	1,246	--
Build and Scale a Powerful Query Engine with LlamaIndex and Ray	Jerry Liu, Amog Kamsetty	2023-06-26	2,524	--
Introducing Distributed XGBoost Training with Ray	Kai Fricke, Richard Liaw, Amog Kamsetty	2021-06-16	1,994	--
Deploy Ray Serve with up to 50% fewer nodes using Anyscale Replica …	Matt Connor, Akshay Malik, Cindy Zhang	2024-07-15	883	--
Training 175B Parameter Language Models at 1000 GPU scale with Alpa and …	Jiao Dong, Hao Zhang, Lianmin Zheng, Jun Gong, Jules S. Damji, Phi Nguyen	2023-03-22	2,713	--
Heterogeneous Training Cluster with Ray at Netflix	Anyscale Ray Team	2023-10-20	902	--
Reinforcement Learning with RLlib in the Unity Game Engine	Sven Mika	2021-01-19	2,133	--
Advances in Foundation Models — Technology, Society, and Applications	Anyscale Ray Team	2023-11-03	1,460	--
Ray 2.6 features streaming for Serve and Train and new Multi-GPU Learner …	Jules S. Damji, Richard Liaw	2023-07-25	1,426	--
Reinforcement learning with Deep Q Networks	Misha Laskin	2022-03-01	1,189	--
Comparing LLM performance: Introducing the Open Source Leaderboard for LLM APIs	Anyscale team	2023-12-21	1,202	2
Time Series Forecasting using an LSTM version of RNN with PyTorch Forecasting …	Christy Bergman, Amog Kamsetty	2021-12-21	2,157	--
Ray Serve: Tackling the cost and complexity of serving AI in production	Akshay Malik, Edward Oakes, Phi Nguyen	2023-09-25	2,392	--
We Pre-Trained Stable Diffusion Models on 2 billion Images and Didn't Break …	Max Pumperla, Marwan Sarieddine	2024-05-21	4,553	--
Reinforcement learning based on market simulation at JPMorgan	Erik Martinez	2022-05-03	287	--
Ray 1.10: Windows support beta, enhanced job submission, and more	Chandler Gibbons	2022-02-07	447	2
Now Available: The LLM Router Template	Amjad Almahairi	2024-07-19	256	--
Biolexis Boosts Their New AI/ML Drug Discovery Platform Using Anyscale’s Fully-Managed Ray …	Jake Carter, Phi Nguyen	2022-11-09	622	--
Simplify your ML Development Cycle with Anyscale and Weights & Biases	Phi Nguyen	2023-01-31	715	--
Why I Joined Anyscale: Solving Cutting-Edge Problems in a Time of Enormous …	Sidney Rabsatt	2023-04-19	260	--
Announcing Ray 2.4.0: Infrastructure for LLM training, tuning, inference, and serving	Richard Liaw, Jules S. Damji, Jiajun Yao	2023-04-27	1,692	--
Smart supply chain management with reinforcement learning at Dow	Erik Martinez	2022-05-03	329	--
Anyscale Endpoints Preview: Fast, Cost-Efficient, and Scalable LLM APIs	Ameer Haj Ali, Robin Singh	2023-08-03	363	--
Fine-tuning LLMs for longer context and better RAG systems	Artur Niederfahrenhorst, Kourosh Hakhamaneshi	2024-02-13	2,847	1
Building Production AI Applications with Ray Serve	Anyscale Ray Team	2023-10-24	1,213	--
Ray version 1.9 has been released	Michael Galarnyk	2021-12-06	395	--
How ThirdAI uses Ray for Parallel Training of Billion-Parameter Neural Networks on …	Vihan Lakshman, Pratik Pranav, Siddharth Jain, Tharun Medini	2023-08-29	1,643	78
Introducing Ray Lightning: Multi-node PyTorch Lightning training made easy	Amog Kamsetty, Richard Liaw, Will Drevo	2021-08-19	1,851	9
Ray 2.7 features major stability improvements to Ray AI Libraries and KubeRay …	Jules S. Damji, Richard Liaw	2023-09-18	1,798	--
Large-scale distributed training with TorchX and Ray	Mark Saroufim, Jules S. Damji	2022-03-24	1,385	--
Ray version 1.8 has been released	Michael Galarnyk	2021-11-04	527	--
Optimizing LLM Training with Airbnb's Next-Gen ML Platform	Anyscale Ray Team	2023-10-30	1,048	--
Data Processing Support in Ray	Sang Cho, Alex Wu, Clark Zinzow, Eric Liang, Stephanie Wang	2021-02-16	1,178	2
Accelerating AI: Harnessing Intel(R) Gaudi(R) 3 with Ray 2.10	Ramit Hora	2024-04-09	596	--
Attention Nets and More with RLlib's Trajectory View API	Sven Mika	2021-04-21	1,475	--
Distributed deep learning with Ray Train is now in Beta	Matthew Deng, Amog Kamsetty, Richard Liaw, Will Drevo	2022-01-25	2,105	--
Serving PyTorch models with FastAPI and Ray Serve	Simon Mo, Chandler Gibbons	2022-02-23	1,506	2
Ray Serve + FastAPI: The best of both worlds	Phi Nguyen	2022-08-02	1,229	--
Serving ML Models in Production: Common Patterns	Simon Mo, Edward Oakes, Michael Galarnyk	2021-10-01	2,759	--
Introducing Anyscale’s Unified Log Viewer	Alan Guo, Gene Su	2024-07-18	405	--
Cross-modal Search for E-commerce: Building and Scaling a Cross-Modal Image Retrieval App	Marwan Sarieddine, Natalia Czerep, Mateusz Kwasniak, Artur Zygadło	2024-06-04	3,253	--
Ray breaks the $1/TB barrier as the world’s most cost-efficient sorting system	Frank Sifei Luan, UC Berkeley	2023-01-25	1,257	36
Modern Distributed C++ with Ray	Guyang Song, Yu Qi	2021-11-11	2,651	--
The Emergence of Multi-cloud Native Applications and Platforms	Ben Lorica, Ion Stoica	2021-01-05	1,463	--
Adtriba Accelerates and Advances Media Mix Modeling Using the Anyscale Fully-Managed Ray …	Houssem Eddine Gharbi, Tim Kreienkamp, Phi Nguyen	2022-11-08	957	--
Reinventing Multi-Modal Search with Anyscale and MongoDB	Marwan Sarieddine, Kamil Kaczmarek	2024-07-25	5,145	--
How to tune hyperparameters on XGBoost	Juan Navas, Richard Liaw	2022-02-09	1,305	--
Infusing AI and ML into integrated circuit design for faster chip delivery, …	IBM Research Team	2022-06-16	1,390	--
Parallelizing Python Code	Dawid Borycki, Michael Galarnyk	2021-09-02	1,668	2
Retrieval Augmented Generation with Huggingface Transformers and Ray	Amog Kamsetty	2021-02-10	1,050	--
Practical Data Considerations for Building Production-Ready LLM Applications	Anyscale Ray Team	2023-10-19	1,116	--
New on Anyscale: Debug and Optimize Ray Applications Faster with Structured Logging	Jiajun Yao, Kai-Hsun Chen	2024-07-16	449	--
Ray Datasets for large-scale machine learning ingest and scoring	Clark Zinzow, Alex Wu, Jiajun Yao, Eric Liang, Chen Shen	2022-02-14	1,661	2
How to Speed up Scikit-Learn Model Training	Michael Galarnyk	2021-02-03	911	--
Ray + Arize, Productionize ML for Scale and Usability	Dat Ngo	2022-08-22	1,828	--
Gang Scheduling Ray Clusters on Kubernetes with Multi-Cluster-App-Dispatcher (MCAD)	Abhishek Malvankar (IBM Research) and Dmitri Gekhtman (Anyscale)	2022-11-16	1,406	1
Flexible, cross-language, distributed model inference framework: Ray Serve with Java API	Tengwei Cai, Yang Liu, Chengxi Luo, Xiaofeng Yang, Simon Mo	2022-12-13	910	--
Ray Distributed Library Patterns	Eric Liang, Zhe Zhang	2021-06-14	1,391	--
Biggest takeaways from our RL tutorial: Long-term rewards, offline RL, and more	Christy Bergman	2022-04-06	1,114	--
Easily Debug Ray Applications with Ray Distributed Debugger	Anyscale team	2024-05-15	624	--
Inference Graphs at LinkedIn Using Ray-Serve	Anyscale Ray Team	2023-11-09	1,267	--
End-to-end LLM Workflows Guide	Goku Mohandas	2024-06-17	4,910	1
Building Context-Aware Reasoning Applications with LangChain and LangSmith	Anyscale Ray Team	2023-10-18	1,214	--
Writing your First Distributed Python Application with Ray	Michael Galarnyk	2021-08-12	2,237	--
Ray 2.2: Improved developer experience, performance and stability	Richard Liaw	2023-01-23	789	--
Building an LLM-powered GitHub bot to improve your pull requests	Max Pumperla	2023-11-15	3,491	--
Configuring and Scaling ML with Hydra + Ray	Richard Liaw, Bill Chambers, Jieru Hu	2021-01-26	480	--
How Hutom.io uses Ray and PyTorch to Scale Surgical Video Analysis and …	Jihun Yoon	2021-10-26	1,575	--
Ray version 1.6 is released	Asawari Samant	2021-08-23	799	--
Introducing RLlib Multi-GPU Stack for Cost Efficient, Scalable, Multi-GPU RL Agents Training	Avnish Narayan, Kourosh Hakhamaneshi	2023-06-26	1,058	--
Building an LLM Router for High-Quality and Cost-Effective Responses	Amjad Almahairi	2024-07-01	4,430	1
An informal introduction to reinforcement learning	Misha Laskin	2022-02-22	1,187	3
Practical tips for training Deep Q Networks	Misha Laskin	2022-03-03	875	--
Don’t Miss: Hands-On Ray Training at Ray Summit 2024	Kamil Kaczmarek	2024-08-13	788	--
7 must-attend Ray Summit sessions: RL-powered traffic control, infra-less ML, and more	Jules S. Damji, Ben Lorica	2022-06-01	653	--
Low-latency Generative AI Model Serving with Ray, NVIDIA Triton Inference Server, and …	Neelay Shah, Akshay Malik	2024-03-13	642	--
What is distributed training?	Keith Pijanowski, Michael Galarnyk	2022-04-26	727	--
Considerations for Deploying Machine Learning Models in Production	Jules S. Damji, Michael Galarnyk	2021-11-16	1,791	--
Many Models Batch Training at Scale with Ray Core	Jules S. Damji, Antoni Baum	2023-01-19	2,178	--
Monitoring and Debugging Ray workloads: Ray Metrics	SangBin Cho, Alan Guo, Ricky Xu, Eric Liang	2022-11-08	1,221	--
Fine tuning is for form, not facts	Waleed Kadous, Kourosh Hakhamaneshi	2023-07-05	1,631	--
Introducing the Anyscale Snowflake Connector	Eric Greene	2023-07-20	745	--
Reducing the Cost of Pre-training Stable Diffusion by 3.7x with Anyscale	Yunxuan Xiao, Hao Chen	2024-05-09	2,176	5
Considerations for deploying machine learning models in production: Part 2	Jules S. Damji	2022-02-04	2,475	--
Cost Effective Machine Learning with Ray	Miha Jenko	2021-12-20	869	--
Ray version 1.7 has been released	Michael Galarnyk	2021-10-11	722	--
Riot Games and deep reinforcement learning in gaming	Erik Martinez	2022-05-03	364	--
Why I joined Anyscale: The vision, the tech, and the team	Sriram Sankar	2022-02-02	648	--
How Ray solves common production challenges for generative AI infrastructure	Antoni Baum, Eric Liang, Jun Gong, Kai Fricke, Richard Liaw	2023-03-20	1,494	--
5 reasons to attend this month’s Production RL Summit	Chandler Gibbons	2022-03-22	669	--
Streaming distributed execution across CPUs and GPUs	Eric Liang, Stephanie Wang, Cheng Su	2023-05-11	2,067	--
From Ray to Chronos: Build end-to-end AI use cases using BigDL on …	Wesley Du, Junwei Deng, Kai Huang, Shan Yu, Shane Huang	2021-11-02	1,594	--
Redis in Ray: Past and future	Mingwei Tian	2022-03-15	930	1
Multi-model composition with Ray Serve deployment graphs	Jiao Dong, Shreyas Krishnaswamy, Simon Mo, Edward Oakes	2022-05-18	2,554	--
The reinforcement learning framework	Misha Laskin	2022-02-24	921	--
An Introduction to Reinforcement Learning with OpenAI Gym, RLlib, and Google Colab	Michael Galarnyk, Sven Mika	2021-08-26	2,649	--
Ray Summit Series - Scaling Parallel Python Jobs	Anyscale Ray Team	2023-03-16	599	--
Foobot optimizes building energy efficiency by training fully autonomous control agents for …	Antoine Galataud, Phi Nguyen, Inouk Bourgon, Adrien Lafond	2022-12-19	751	--
Leveraging the Possibilities of Ray Serve in Implementing a Scalable, Fully Automated …	Tanja Bayer	2021-11-09	1,324	--
Forecasting at Scale	Phi Nguyen, Max Mergenthaler	2023-02-02	683	--
Introducing the Anyscale Databricks Connector	Eric Greene	2023-06-15	632	--
Ray Summit 2023 Call for Proposals is now open	Jules S. Damji	2023-01-12	777	--
Fast, flexible, and scalable data loading for ML training with Ray Data	Stephanie Wang, Scott Lee, Cheng Su, Hao Chen, Eric Liang	2023-09-15	3,238	4
Executing a distributed shuffle without a MapReduce system	Stephanie Wang	2021-03-22	1,675	--
Life @ Anyscale: Investing in our communities	Tyler Faust	2022-05-26	271	--
Anyscale and Lambda - Addressing AI Scarcity with Engineering	Anyscale team	2023-11-21	585	--
RAG at Scale: 10x Cheaper Embedding Computations with Anyscale and Pinecone	Scott Lee, Kyle Huang, Cheng Su, Hao Chen	2024-01-16	995	1
Ray 2.8 features Ray Data extensions, AWS Neuron cores support, and Dashboard …	Jules S. Damji, Richard Liaw	2023-11-07	791	--
The Third Generation of Production ML Architectures	Waleed Kadous	2021-09-15	2,388	3
Scaling Time Series Forecasting on Ray: ARIMA and Prophet on Ray	Christy Bergman	2021-11-23	2,725	--
Analyzing memory management and performance in Dask-on-Ray	Stephanie Wang	2021-06-29	2,784	1
Sailing to victory with reinforcement learning	Erik Martinez	2022-02-28	449	--
Update on Ray CVE-2023-48022: New Verification Tooling Available	Anyscale team	2024-03-27	606	--
Update on Ray CVEs CVE-2023-6019, CVE-2023-6020, CVE-2023-6021, CVE-2023-48022, CVE-2023-48023	Anyscale team	2023-11-30	508	--
Simplify your MLOps with Ray & Ray Serve	Phi Nguyen	2022-07-26	1,167	--
Ray Spotlight Series: Multitenant Serve Applications with Runtime Envs as Containers	Sam Chan, Cindy Zhang	2024-06-13	800	--
How to fine tune and serve LLMs simply, quickly and cost effectively …	Waleed Kadous, Jun Gong, Antoni Baum, Richard Liaw	2023-04-10	2,055	--
Turbocharge LangChain: guide to 20x faster embedding	Amog Kamsetty, Philipp Moritz	2023-05-03	1,934	--
Direct Preference Optimization with Synthetic Data on Anyscale	Franklin Wang, Sumanth Hegde, Kourosh Hakhamaneshi	2024-08-21	9,249	1
Model Batch Inference in Ray: Actors, ActorPool, and Datasets	Eric Liang, Jules S. Damji, Zhe Zhang	2022-11-03	2,084	4
Anyscale Endpoints: JSON Mode, Function calling, New models: Llama Guard and Mistral-7B-OpenOrca	Endpoints Team	2023-12-12	186	--
Portkey ♥️ Anyscale Endpoints	Endpoints Team	2023-12-12	564	--
Getting Started with Distributed Machine Learning with PyTorch and Ray	Michael Galarnyk, Richard Liaw, Robert Nishihara	2021-03-02	1,360	--
Scaling Model Batch Inference in Ray: Using Actors, ActorPool, and Ray Data	Eric Liang, Jules S. Damji, Zhe Zhang	2023-05-16	1,856	--
Numbers every LLM Developer should know	Waleed Kadous	2023-05-17	1,423	95
Handling files and packages on your cluster with Ray runtime environments	Archit Kulkarni, Edward Oakes	2022-05-05	860	--
Three ways to speed up XGBoost model training	Antoni Baum, Chandler Gibbons	2022-02-17	1,609	--
Deep Dive: Data Ingest in a Third Generation ML Architecture	Eric Liang, Chen Shen, Clark Zinzow, Waleed Kadous	2021-11-30	1,783	--
Automatic and optimistic memory scheduling for ML workloads in Ray	Clarence Ng, Jules S. Damji	2023-03-02	2,423	--
Ray Summit 2022 Call for Papers is now open	Jules S. Damji, Chandler Gibbons	2022-03-23	585	--
Ray Summit 2022 Stories - Large Language Models	Anyscale Ray Team	2023-02-16	680	--
LLM-based summarization: A case study of human, Llama 2 70b and GPT-4 …	Justin Olsson, Waleed Kadous	2023-11-09	1,195	1
Welcome Keerti	Robert Nishihara	2024-07-31	743	2
Offline Batch Inference: Comparing Ray, Apache Spark, and SageMaker	Amog Kamsetty, Eric Liang, Jules S. Damji	2023-05-04	2,042	--
How Ikigai Labs Serves Interactive AI Workflows at Scale using Ray Serve	Jaehyun Sim, Amar Shah	2021-08-19	2,040	--
Introducing Distributed LightGBM Training with Ray	Antoni Baum, Will Drevo	2021-08-10	1,149	22
Introducing Elastic Distributed Training on Anyscale	Matthew Deng, Justin Yu	2024-07-22	478	--
Ray & MLflow: Taking Distributed Machine Learning Applications to Production	Amog Kamsetty, Archit Kulkarni	2021-01-13	1,091	--
How to distribute hyperparameter tuning using Ray Tune	Juan Navas, Richard Liaw	2022-02-15	3,064	--
Why I Joined Anyscale: Powering an Open Source AI Revolution	Lance Walter	2023-04-28	799	--
Anyscale Endpoints: JSON Mode and Function calling Features	Endpoints Team	2023-12-12	2,050	2
Announcing Anyscale Private Endpoints and Anyscale Endpoints Fine-tuning	Matt Connor, Robin Singh	2023-10-24	467	3
Cloud Infrastructure for LLM and Generative AI Applications	Yifei Feng, Sriram Sankar, Siddharth Venkatesh, Ameer Haj Ali	2023-09-14	1,868	4
Three Key Elements of a Scalable ML Platform	Phi Nguyen	2022-12-16	1,733	--
How Ant Group uses Ray to build a Large-Scale Online Serverless Platform	Tengwei Cai, Yang Liu, Chengxi Luo, Xiaofeng Yang	2022-12-12	2,353	3
Faster stable diffusion fine-tuning with Ray AIR	Kai Fricke	2023-03-28	1,627	--
Challenges of deploying ML models in production	Phi Nguyen	2022-07-14	959	--
Why I’m joining Anyscale	Waleed Kadous	2021-01-04	757	--
Announcing Aviary: Open Source Multi-LLM Serving	Waleed Kadous	2023-05-31	743	24
Reproducible Performance Metrics for LLM inference	Waleed Kadous, Kyle Huang, Wendi Ding, Liguang Xie, Avnish Narayan, Ricky Xu	2023-11-01	2,495	2
Ray Spotlight: How we delivered Ray weekly releases	Sam Chan	2024-06-25	629	--
Inspecting Sewer Line Safety Using Thousands of Hours of Video	Lance Walter	2023-05-22	814	--
Training One Million Machine Learning Models in Record Time with Ray	Eric Liang, Robert Nishihara	2022-12-17	2,124	1
Blue River Technology Developers Iterate 2.5X Faster with the Anyscale Fully-Managed Ray …	Uday Kanwar, Deb Daipayan	2023-02-27	608	--
Scaling Embedding Generation Pipelines From Pandas to Ray Data	Marwan Sarieddine	2024-09-04	2,154	--
Fine-tuning Llama-3, Mistral and Mixtral with Anyscale	Marwan Sarieddine and Kamil Kaczmarek	2024-09-11	2,256	--
Building a RAG Batch Inference Pipeline with Anyscale and Union	Kevin Su and Kai-Hsun Chen	2024-09-12	1,665	--
Roblox Guest Blog: Fast and Efficient Online Model Serving	Younes Abouelnagah	2024-09-19	2,925	--
RL for recommender systems	Michael Galarnyk	2021-07-20	769	--
Accelerated Metadata Fetching in Ray Data up to 4.5x Faster on Anyscale	Balaji Veeramani, Hao Chen, Richard Liaw, Matthew Connor and Praveen Gorthy	2024-10-01	607	--
Anyscale on Kubernetes: Simplifying AI Workloads on User-Managed Infrastructure	Dominic Catalano and Yifei Feng	2024-10-01	792	--
Anyscale Now Available on AWS Marketplace and Achieves Generative AI Competency	The Anyscale Team	2024-10-01	510	--
Batch LLM Inference on Anyscale slashes AWS Bedrock costs by up to …	Cody Yu, Scott Lee, Ricky Xu, William Lin, Praveen Gorthy and Richard Liaw	2024-10-01	1,180	--
Ray Data GA	Hao Chen, Richard Liaw and Praveen Gorthy	2024-10-01	1,037	--
Anyscale’s New User Experience: A Comprehensive Overview	The Anyscale Team	2024-10-01	1,161	--
Anyscale Now on GCP Marketplace	The Anyscale Team	2024-10-01	381	--
Autoscaling Large AI Models up to 5.1x Faster on Anyscale	Christopher Chou, Austin Kuo, Richard Liaw, Edward Oakes and Chris Sivanich	2024-10-01	1,260	--
Enterprise Governance and Observability on Anyscale	The Anyscale Team	2024-10-01	479	--
Announcing RayTurbo	Akshay Malik, Praveen Gorthy and Richard Liaw	2024-10-01	1,453	--
Ray Summit 2024: Breaking Through the AI Complexity Wall	The Anyscale Team	2024-10-03	1,600	--
Ray Compiled Graphs: Optimized AI Workloads with Native GPU Communication	Sang Cho, Sam Chan and Stephanie Wang	2024-10-07	1,910	--
Unlocking the Power of Scalable Machine Learning with Anyscale and Astronomer	The Anyscale Team	2024-10-29	1,063	--
Anyscale Named a Cool Vendor for AI Engineering by Gartner®	The Anyscale Team	2024-11-13	399	--
Deploying DeepSeek R1 on Anyscale	The Anyscale Team	2025-02-12	995	--
Introducing the Ray Kubectl Plugin: A Simpler Way to Manage Ray Clusters …	The KubeRay Team	2025-02-20	1,182	--
KubeRay v1.3.0: Enhancing Observability, Reliability, and Usability	The KubeRay Team	2025-02-20	2,151	--
uv + Ray: Pain-Free Python Dependencies in Clusters	Christina Zhu and Philipp Moritz	2025-02-27	1,718	44
Announcing the Anyscale Technical Webinar Series: Learn Ray and Distributed AI	The Anyscale Team	2025-03-06	413	--
Introducing the Ray for Practitioners Course and Private Training from Anyscale	The Anyscale Team	2025-03-19	596	--
Announcing Native LLM APIs in Ray Data and Ray Serve	The Anyscale Team	2025-04-02	1,038	2
Simplifying AI Development at Scale: Google Cloud Integrates Anyscale's RayTurbo with GKE	Gabe Monroy, VP & GM Cloud Runtimes and Keerti Melkote, CEO of Anyscale	2025-04-09	579	--
Anyscale Adds First-Class Support for Azure Kubernetes Service and Streamlines Operations for …	Dominic Catalano	2025-05-20	1,244	--
New: Joins & Hash-Shuffle in Ray Data	Alexey Kudinkin, Praveen Gorthy and Richard Liaw	2025-05-20	1,054	3
RayTurbo Data Improvements Deliver Up to 5x Faster Data Processing for AI …	Alexey Kudinkin, Hao Chen, Praveen Gorthy and Richard Liaw	2025-05-20	1,227	--
Streamline Distributed AI Monitoring and Debugging with New Ray Train & Ray …	Alan Guo, Cuong Nguyen, Justin Yu, Matthew Deng, Matthew Owen and Richard Liaw	2025-05-20	1,951	--
Ray Summit 2025: Call for Proposals Closes on June 30th, 2025	Christina Zhu	2025-05-30	431	--
Building Scalable RAG Pipelines with Ray and Anyscale	Kunling Geng	2025-06-04	2,092	--
Ray on Alibaba Cloud: Building an ML Platform	Kun Wu (Alibaba Cloud)	2025-06-12	1,545	--
An Open Source Stack for AI Compute: Kubernetes + Ray + PyTorch …	Robert Nishihara	2025-06-12	3,073	3
Introducing KubeRay v1.4	The KubeRay Team	2025-07-21	1,906	--
Large-Scale Deployment of Ray in Tencent’s Weixin AI Infrastructure	Weixin Astra Team	2025-07-01	4,303	2
Your Data and AI Frameworks Evolved – What About Your Distributed Compute …	Julian Forero	2025-06-24	1,948	--
Open Source RL Libraries for LLMs	Tyler Griggs	2025-07-01	3,745	1
Anyscale now available on Microsoft Azure Marketplace	The Anyscale Team	2025-09-02	655	--
Ray Serve: Reduce LLM Inference Latency by 60% with Custom Request Routing	Seiji Eicher	2025-09-15	1,709	1
The 2021 Ray Community Pulse Survey is Now Open	Michael Galarnyk	2021-05-12	560	--
Deploy DeepSeek‑R1 with vLLM and Ray Serve on Kubernetes	The Anyscale Team	2025-08-11	882	1
Massively Parallel Agentic Simulations with Ray	Philipp Moritz	2025-09-10	5,654	2
Ray Task Monitoring at Scale: Announcing Persistence for +10k Tasks on Anyscale	Nikita Vemuri	2025-09-12	1,442	--
Fine-tuning a Text-to-SQL Model with Tinker and Ray	Robert Nishihara	2025-10-01	1,438	--
Benchmarking Multimodal AI Workloads on Ray Data	Richard Liaw	2025-10-03	2,932	--
Announcing the Ray Foundations Certification	Julian Forero	2025-10-09	552	--
Ray is Joining The PyTorch Foundation	Robert Nishihara	2025-10-22	690	--
Introducing Label Selectors: Improved Scheduling Flexibility in Ray	Mengjin Yan	2025-10-30	1,329	--
Announcing Ray Direct Transport: RDMA Support in Ray Core (Part 1)	Stephanie Wang	2025-11-03	2,766	--
Anyscale and Microsoft Partnership	Keerti Melkote, CEO of Anyscale	2025-11-04	1,114	--
Anyscale Announces Lineage Tracking for Faster End-to-End Tracing and Debugging of Ray …	Philip Wang	2025-11-04	1,820	--
Ray Data: Scalable Data Processing for AI workloads	Alexey Kudinkin	2025-11-04	2,438	--
Announcing Anyscale First-Party Offering on Azure: Build, Run and Scale AI-Native Workloads …	Julian Forero	2025-11-04	1,276	--
Ray Train V2: Unified Distributed Training on Ray	Matthew Deng	2025-11-04	824	--
Ray Summit 2025: Anyscale Platform Updates	Philip Wang	2025-11-04	2,033	--
Announcing Anyscale Runtime for Faster, Cheaper and More Resilient AI, Powered by …	Richard Liaw	2025-11-04	1,446	--
Ray Serve: Advancing Flexibility with Async Inference, Custom Request Routing, and Custom …	Abrar Sheikh	2025-11-11	2,068	--
Introducing Token-Based Authentication for Ray	Emre Saglam	2025-11-21	965	--
Ray Serve LLM on Anyscale: APIs for Wide-EP and Disaggregated Serving with …	Seiji Eicher	2025-11-26	1,281	1
AI with Ray and Anyscale at AWS re:Invent 2025	Julian Forero	2025-11-25	590	--
30% Faster Multimodal AI Training with Ray and Disaggregated Hybrid Parallelism	Masahiro Tanaka	2025-12-09	1,900	--
Introducing KubeRay v1.5	KubeRay Team	2025-12-17	2,402	--
GPU (In)efficiency in AI Workloads	David Wang	2026-01-21	1,946	--
Scalable Distributed Training: From Single-GPU Limits to Reliable Multi-Node Runs with Ray …	Julian Forero	2026-01-28	1,474	--
Scaling Vision-Language-Action (VLA) Pipelines for Robotics with Ray on Anyscale	Omar Shorbaji	2026-02-10	1,467	--
Ray Serve’s New Grafana Dashboard: Debugging That Wasn’t Possible Before	Abrar Sheikh	2026-02-16	1,162	--
Ray Data LLM enables 2x throughput over vLLM’s synchronous LLM engine at …	Jeffrey Wang	2026-02-19	1,732	--
Breaking the RAG Bottleneck: Scalable Document Processing with Ray Data and Docling	Ana Biazetti (RedHat)	2026-02-27	1,239	--
Major upgrades to Ray Serve: Online Inference with 88% lower latency and …	Seiji Eicher	2026-03-24	3,023	2
Announcing DP Group Fault Tolerance for vLLM WideEP Deployments with Ray Serve …	Jeffrey Wang	2026-04-02	2,689	--
How Notion cuts embedding costs by 80% and other stories on scaling …	Philip Wang	2026-04-09	1,309	--
Introducing Anyscale Agent Skills: Build faster, debug smarter, and optimize AI workloads …	Kunling Geng	2026-04-22	2,295	--
Introducing Vision-Language Reinforcement Learning in SkyRL	Nithin Chalapathi	2026-04-24	1,293	--
AI agents on Ray Serve: Single to multi-agent architecture	Kunling Geng	2026-05-07	3,338	--
Architecting Data Pipelines for Multimodal Datasets at Scale	Marwan Sarieddine	2026-05-14	3,353	--
Introducing the Anyscale Agent Skill for LLM Post-Training	Kunling Geng	2026-05-14	1,807	--
Monitor and debug Ray workloads with fully persisted Cluster and Actor dashboards …	Carolyn Wang	2026-05-15	2,500	--
Reimagining ML Operations with Agent Skills: a new maturity model for on-call	Christian Stano	2026-05-21	2,618	--
Anyscale on Azure Enters Public Preview: Build and Deploy AI at Scale …	Katarina Stanley	2026-06-02	1,742	--
20x Faster Training Data Reads with Alluxio and Ray Data: A Cross-Region …	Elizabeth Hu	2026-06-03	1,962	--
Achieving Up to 67% Cost Savings with Prefill-Decode Disaggregation Using Ray + …	Kourosh Hakhamaneshi	2026-06-12	2,090	4
How Torc hit 90% GPU utilization and other stories on scaling AI …	Katarina Stanley	2026-06-10	1,476	--
Inside FSDP with PyTorch and Ray: Scaling Model Training with Fully Sharded …	Suman Debnath	2026-06-12	7,949	--
Stop reading logs: Debugging Ray on Anyscale with Agent Skillsan	Aydin Abiar	2026-06-11	2,561	--
How Adyen trains a Transaction Foundation Model (TFM) on 51 trillion tokens …	Katarina Stanley	2026-06-11	1,496	--
Data Processing is Becoming a GPU Workload	Robert Nishihara	2026-06-16	1,752	2
High Performance Distributed Inference with Ray Serve LLM	Seiji Eicher	2026-06-18	1,691	3
Scale Robot Policy Evaluation with Ray	Ian Jordan, PhD	2026-06-26	2,829	--
Ray Data 2.56: Improving Reliability for AI Data Pipelines	Balaji Veeramani	2026-06-30	1,418	--
Enhancing Ray Cluster Stability With Resource Isolation	David Dai	2026-07-14	2,777	--
Introducing the Anyscale Physical AI Skill	Kunling Geng	2026-07-23	4,026	--
Maximizing the Power of NVIDIA GB300 NVL72: NVLink Domain-Aware Placement Groups in …	Joshua Lee	2026-08-13	1,603	--
Async inference in practice: a video-indexing service on Ray Serve	Harshit Agarwal	2026-08-18	2,256	--
Using Ray Direct Transport for Fast and Easy Weight Syncing in Reinforcement …	Stephanie Wang	2026-08-18	3,444	--
CVE-2025-62593 and the CISA KEV listing: what Ray users need to know	Emre Saglam	2026-08-19	950	--
GPU-Native Operators in Ray Data	Richard Liaw	2026-08-25	1,430	--
Introducing KubeRay v1.6 and v1.7	KubeRay Team	2026-08-25	3,190	--
FP8 Reinforcement Learning in SkyRL: Preserving Policy Consistency Across Training and Rollout	Jinghan Yao	2026-08-25	3,097	--
Announcing Native Sandboxing in Ray	Philipp Moritz	2026-08-25	2,254	--
Introducing Ray History Server: Post-Mortem Observability for Ray on Kubernetes	Andrew Sy Kim (Google)	2026-08-25	1,851	--
Optimizing LLM Serving Efficiency: Moving Beyond KV Cache Reuse to Token-Load Awareness …	Jeffrey Wang	2026-08-25	2,655	--
Scaling Ray for AI workloads to 10k node clusters	Yicheng Lu	2026-08-25	3,830	--
Shuffle V2 in Ray Data: Faster, Fault-Tolerant Joins and Aggregations	You-Cheng Lin	2026-08-25	2,593	--
Introducing Anyscale GPU Health Observability: From app to hardware	Mike Tower	2026-08-25	1,804	--
Introducing Anyscale KubeRay Connect: Doubling down on Kubernetes	Elizabeth Hu	2026-08-25	1,360	--
Learning Loops: The Path to Owning Your Intelligence	Christian Stano	2026-08-25	1,158	--
Ray Summit 2026: Physical AI, RL, and the infrastructure that runs them …	Philip Wang	2026-09-08	2,742	--
Llama 2 is about as factually accurate as GPT-4 for summaries and …	Waleed Kadous	2023-08-23	2,933	19
Anyscale signs definitive agreement to join Nscale	Robert Nishihara	2026-07-30	855	3
Loading Llama-2 70b 20x faster with Anyscale Endpoints	Yi Cheng, Cade Daniel, Chen Shen, Liguang Xie	2023-10-11	1,961	3
Building RAG-based LLM Applications for Production	Goku Mohandas, Philipp Moritz	2023-10-25	10,794	2

Plushcap, by Matt Makai. 2021-2026.