|
Inference Graphs at LinkedIn Using Ray-Serve
|
Anyscale Ray Team |
2023-11-09 |
1,267 |
--
|
|
How Spotify Built a Robust Ray Platform with a Frictionless Developer Experience
|
Anyscale Ray Team |
2023-11-09 |
1,259 |
--
|
|
Ray 2.8 features Ray Data extensions, AWS Neuron cores support, and Dashboard improvements
|
Jules S. Damji, Richard Liaw |
2023-11-07 |
791 |
--
|
|
Advances in Foundation Models — Technology, Society, and Applications
|
Anyscale Ray Team |
2023-11-03 |
1,460 |
--
|
|
Reproducible Performance Metrics for LLM inference
|
Waleed Kadous, Kyle Huang, Wendi Ding, Liguang Xie, Avnish Narayan, Ricky Xu |
2023-11-01 |
2,495 |
2
|
|
Optimizing LLM Training with Airbnb's Next-Gen ML Platform
|
Anyscale Ray Team |
2023-10-30 |
1,048 |
--
|
|
Building RAG-based LLM Applications for Production
|
Goku Mohandas, Philipp Moritz |
2023-10-25 |
10,794 |
2
|
|
Announcing Anyscale Private Endpoints and Anyscale Endpoints Fine-tuning
|
Matt Connor, Robin Singh |
2023-10-24 |
467 |
3
|
|
Building Production AI Applications with Ray Serve
|
Anyscale Ray Team |
2023-10-24 |
1,213 |
--
|
|
Heterogeneous Training Cluster with Ray at Netflix
|
Anyscale Ray Team |
2023-10-20 |
902 |
--
|
|
Practical Data Considerations for Building Production-Ready LLM Applications
|
Anyscale Ray Team |
2023-10-19 |
1,116 |
--
|
|
Building Context-Aware Reasoning Applications with LangChain and LangSmith
|
Anyscale Ray Team |
2023-10-18 |
1,214 |
--
|
|
Llama, Scaling Up LLMs in an Open Ecosystem
|
Anyscale Ray Team |
2023-10-16 |
1,246 |
--
|
|
Loading Llama-2 70b 20x faster with Anyscale Endpoints
|
Yi Cheng, Cade Daniel, Chen Shen, Liguang Xie |
2023-10-11 |
1,961 |
3
|
|
Ray Serve: Tackling the cost and complexity of serving AI in production
|
Akshay Malik, Edward Oakes, Phi Nguyen |
2023-09-25 |
2,392 |
--
|
|
Ray 2.7 features major stability improvements to Ray AI Libraries and KubeRay and introduces RayLLM
|
Jules S. Damji, Richard Liaw |
2023-09-18 |
1,798 |
--
|
|
Fast, flexible, and scalable data loading for ML training with Ray Data
|
Stephanie Wang, Scott Lee, Cheng Su, Hao Chen, Eric Liang |
2023-09-15 |
3,238 |
4
|
|
Cloud Infrastructure for LLM and Generative AI Applications
|
Yifei Feng, Sriram Sankar, Siddharth Venkatesh, Ameer Haj Ali |
2023-09-14 |
1,868 |
4
|
|
Anyscale and Meta Collaborate to Advance the Llama-2 Ecosystem
|
Robert Nishihara, Joe Spisak |
2023-09-07 |
325 |
--
|
|
Fine-Tuning LLMs: LoRA or Full-Parameter? An in-depth Analysis with Llama 2
|
Artur Niederfahrenhorst, Kourosh Hakhamaneshi, Rehaan Ahmad |
2023-09-06 |
3,597 |
22
|
|
How ThirdAI uses Ray for Parallel Training of Billion-Parameter Neural Networks on Commodity CPUs
|
Vihan Lakshman, Pratik Pranav, Siddharth Jain, Tharun Medini |
2023-08-29 |
1,643 |
78
|
|
Llama 2 is about as factually accurate as GPT-4 for summaries and is 30X cheaper
|
Waleed Kadous |
2023-08-23 |
2,933 |
19
|
|
How ByteDance Scales Offline Inference with multi-modal LLMs to 200 TB Data
|
Amog Kamsetty, Hao Chen, Liguang Xie |
2023-08-14 |
1,872 |
7
|
|
Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Models to Unique Applications
|
Kourosh Hakhamaneshi, Rehaan Ahmad |
2023-08-11 |
5,637 |
308
|
|
Anyscale Endpoints Preview: Fast, Cost-Efficient, and Scalable LLM APIs
|
Ameer Haj Ali, Robin Singh |
2023-08-03 |
363 |
--
|
|
Machine Learning for Developers
|
Goku Mohandas |
2023-07-26 |
688 |
--
|
|
Ray 2.6 features streaming for Serve and Train and new Multi-GPU Learner API
|
Jules S. Damji, Richard Liaw |
2023-07-25 |
1,426 |
--
|
|
Introducing the Anyscale Snowflake Connector
|
Eric Greene |
2023-07-20 |
745 |
--
|
|
Fine tuning is for form, not facts
|
Waleed Kadous, Kourosh Hakhamaneshi |
2023-07-05 |
1,631 |
--
|
|
Introducing RLlib Multi-GPU Stack for Cost Efficient, Scalable, Multi-GPU RL Agents Training
|
Avnish Narayan, Kourosh Hakhamaneshi |
2023-06-26 |
1,058 |
--
|
|
Build and Scale a Powerful Query Engine with LlamaIndex and Ray
|
Jerry Liu, Amog Kamsetty |
2023-06-26 |
2,524 |
--
|
|
How continuous batching enables 23x throughput in LLM inference while reducing p50 latency
|
Cade Daniel, Chen Shen, Eric Liang, Richard Liaw |
2023-06-22 |
3,568 |
110
|
|
Introducing the Anyscale Databricks Connector
|
Eric Greene |
2023-06-15 |
632 |
--
|
|
Ray 2.5 features training and serving for LLMs, Multi-GPU training in RLlib, and enhanced Ray Data support
|
Richard Liaw, Jules S. Damji |
2023-06-13 |
1,681 |
--
|
|
Announcing Aviary: Open Source Multi-LLM Serving
|
Waleed Kadous |
2023-05-31 |
743 |
24
|
|
Inspecting Sewer Line Safety Using Thousands of Hours of Video
|
Lance Walter |
2023-05-22 |
814 |
--
|
|
Numbers every LLM Developer should know
|
Waleed Kadous |
2023-05-17 |
1,423 |
95
|
|
Scaling Model Batch Inference in Ray: Using Actors, ActorPool, and Ray Data
|
Eric Liang, Jules S. Damji, Zhe Zhang |
2023-05-16 |
1,856 |
--
|
|
Streaming distributed execution across CPUs and GPUs
|
Eric Liang, Stephanie Wang, Cheng Su |
2023-05-11 |
2,067 |
--
|
|
10 must-attend Ray Summit sessions: Generative AI, scalable ML workloads, and more
|
Jules S. Damji, Ben Lorica |
2023-05-10 |
1,078 |
--
|
|
Building a Self Hosted Question Answering Service using LangChain + Ray in 20 minutes
|
Waleed Kadous |
2023-05-08 |
1,693 |
--
|
|
Offline Batch Inference: Comparing Ray, Apache Spark, and SageMaker
|
Amog Kamsetty, Eric Liang, Jules S. Damji |
2023-05-04 |
2,042 |
--
|
|
Turbocharge LangChain: guide to 20x faster embedding
|
Amog Kamsetty, Philipp Moritz |
2023-05-03 |
1,934 |
--
|
|
Why I Joined Anyscale: Powering an Open Source AI Revolution
|
Lance Walter |
2023-04-28 |
799 |
--
|
|
Announcing Ray 2.4.0: Infrastructure for LLM training, tuning, inference, and serving
|
Richard Liaw, Jules S. Damji, Jiajun Yao |
2023-04-27 |
1,692 |
--
|
|
Why I Joined Anyscale: Solving Cutting-Edge Problems in a Time of Enormous Change
|
Sidney Rabsatt |
2023-04-19 |
260 |
--
|
|
Building an LLM open source search engine in 100 lines using LangChain and Ray
|
Waleed Kadous |
2023-04-18 |
1,780 |
3
|
|
LiveEO supercharges their ML infrastructure and accelerates their geospatial workloads practice
|
Toby Rahloff, Phi Nguyen, Alex Streed |
2023-04-14 |
658 |
--
|
|
How to fine tune and serve LLMs simply, quickly and cost effectively using Ray + DeepSpeed + HuggingFace
|
Waleed Kadous, Jun Gong, Antoni Baum, Richard Liaw |
2023-04-10 |
2,055 |
--
|
|
Faster stable diffusion fine-tuning with Ray AIR
|
Kai Fricke |
2023-03-28 |
1,627 |
--
|
