Home / Companies / Anyscale / Hacker News

Anyscale on HN

22 posts with 1+ points in 2023

Filters
Year:
Posts by Month (22 total)
Hacker News Posts
Title Points Comments Date
Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models 308 59 2023-08-11
Continuous batching to increase LLM inference throughput and reduce p50 latency 110 20 2023-08-15
Numbers every LLM Developer should know 95 18 2023-08-12
ThirdAI Uses Ray for Parallel Training of Billion-Parameter NN on Commodity CPUs 78 15 2023-08-30
Ray breaks the $1/TB barrier as the world’s most cost-efficient sorting system 36 8 2023-01-24
Anyscale's Aviary: Open-Source Multi-LLM Serving 24 1 2023-05-31
Fine-Tuning LLMs: LoRA or Full-Parameter? An In-Depth Analysis with Llama 2 22 2 2023-09-06
Llama 2 is about as factually accurate as GPT-4 for summaries and … 19 0 2023-08-23
ByteDance Scales Offline Inference with Multi-Modal LLMs to 200 TB Data 7 0 2023-08-15
Aviary: Compare Open Source LLMs for cost, latency and quality 6 0 2023-06-01
Scaling data loading for ML training with Ray Data 4 1 2023-09-15
Cloud Infrastructure for LLM and Generative AI Applications 4 0 2023-09-14
Loading Llama-2 70B 20x faster with Anyscale Endpoints 3 0 2023-10-11
How to build a LLM search engine using a self-hosted LLM 3 0 2023-04-21
Anyscale Private Endpoints and Anyscale Endpoints Fine-Tuning 3 0 2023-10-24
Comparing LLM Performance: Introducing the Open Source Leaderboard for LLM APIs 2 0 2023-12-21
Anyscale Endpoints: JSON Mode and Function Calling Features 2 0 2023-12-14
Reproducible Performance Metrics for LLM Inference 2 0 2023-11-02
Fine Tuning is for form not facts 2 0 2023-08-27
Ray solves common production challenges for generative AI infrastructure 1 None 2023-03-28
LLM summarization: A case study of human, Llama-2, & GPT-4 summarization quality 1 None 2023-11-10
Anyscale Endpoints: LLM inference and fine-tuning 1 None 2023-10-25