Together AI Blog

265 posts indexed since 2022

Posts YTD
98 ↑ vs 66 last year
Avg Posts/Month
4.4 since 2022
Monthly Post Volume
Monthly post counts
MonthPosts
1-20220
2-20220
3-20220
4-20220
5-20220
6-20220
7-20220
8-20220
9-20220
10-20220
11-20223
12-20222
1-20231
2-20231
3-20233
4-20234
5-20234
6-20233
7-20235
8-20232
9-20231
10-20232
11-20235
12-20234
1-20246
2-20242
3-20243
4-20243
5-20243
6-20245
7-20246
8-20243
9-20246
10-20246
11-20245
12-20244
1-20254
2-20254
3-20258
4-20259
5-20258
6-20256
7-20259
8-20256
9-20254
10-20255
11-20253
12-20259
1-20266
2-202611
3-202613
4-202614
5-20268
6-20265
7-202613
8-20268
9-20268
10-202610
11-20262
Post Details

265 matching posts

Title Author Published Words HN Pts
HELM: benchmarking large language models on the Together Research Computer Together 2022-11-17 1,045 --
Releasing GPT-JT powered by open-source AI Together 2022-11-29 895 --
NeurIPS 2022: Overcoming communication bottlenecks for decentralized training (1/2) Together 2022-11-30 2,211 --
NeurIPS 2022: Overcoming communication bottlenecks for decentralized training (2/2) Together 2022-12-05 2,188 --
Hungry Hungry Hippos: Towards language modeling with state space models Daniel Y. Fu, Tri Dao, Khaled K. Saab, Armin W. Thomas, Atri Rudra, Christopher Ré 2022-12-28 384 --
FlashConv: Speeding up state space models Dan Fu and Tri Dao 2023-01-23 1,100 --
Hyena Hierarchy: Towards larger convolutional language models Michael Poli, Stefano Massaroli, Eric Nguyen, Daniel Y. Fu, Tri Dao, Stephen Baccus, Yoshua Bengio, Stefano Ermon, Christopher Ré 2023-02-02 291 --
Announcing OpenChatKit Together 2023-03-10 2,765 --
FlexGen: High-throughput generative inference of large language models with a single GPU Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Daniel Y. Fu, Zhiqiang Xie, Beidi Chen, Clark Barrett, Joseph E. Gonzalez, Percy Liang, Christopher Ré, Ion Stoica, Ce Zhang 2023-03-13 317 --
OpenChatKit now runs on consumer GPUs with a new 7B parameter model Together 2023-03-30 2,310 --
RedPajama, a project to create leading open-source models, starts by reproducing LLaMA training dataset of over 1.2 trillion tokens Together 2023-04-17 1,032 --
How Together and Crusoe are reducing the carbon impact of generative AI Together 2023-04-20 737 --
RedPajama training progress at 440 billion tokens Together 2023-04-24 1,090 --
CocktailSGD: Fine-tuning foundation models over 500Mbps networks Jue Wang, Binhang Yuan, Luka Rimanic, Yongjun He, Tri Dao, Beidi Chen, Christopher Re, Ce Zhang 2023-04-24 234 --
Releasing 3B and 7B RedPajama-INCITE family of models including base, instruction-tuned & chat models Together 2023-05-05 3,989 --
RedPajama-INCITE-3B, an LLM for everyone Together 2023-05-09 2,281 --
Together’s $20M seed funding to build open-source AI and cloud platform Vipul Ved Prakash 2023-05-15 602 --
FlashAttention: Fast and memory-efficient exact attention with IO-Awareness Tri Dao, Daniel Y. Fu, Stefano Ermon, Atri Rudra, Christopher Ré 2023-05-17 347 --
Decentralized training of foundation models in heterogeneous environments Binhang Yuan, Yongjun He, Jared Quincy Davis, Tianyi Zhang, Tri Dao, Beidi Chen, Percy Liang, Christopher Re, Ce Zhang 2023-06-02 340 --
Fine-tuning language models over slow networks using activation compression with guarantees Jue Wang, Binhang Yuan, Luka Rimanic, Yongjun He, Tri Dao, Beidi Chen, Christopher Re, Ce Zhang 2023-06-02 336 --
RedPajama 7B now available, instruct model outperforms all open 7B models on HELM benchmarks Together 2023-06-06 1,595 --
Together AI launches full stack for developers to build with open-source AI Together 2023-07-14 645 --
Together AI and Snorkel AI empower enterprises to build proprietary LLMs Together 2023-07-17 664 --
Introducing Together AI Chief Scientist Tri Dao, as he releases FlashAttention-2 to speed up model training and inference Together 2023-07-17 2,001 2
Monarch Mixer: A new model architecture for increased efficiency Dan Fu, Simran Arora, Chris Ré 2023-07-25 1,981 --
Preparing for the era of 32K context: Early learnings and explorations Together 2023-07-28 1,831 84
Faster inference enables up to 5x price reduction on Together API Together 2023-08-11 379 --
Llama-2-7B-32K-Instruct — and fine-tuning for Llama-2 models with Together API Together 2023-08-18 1,092 2
Medusa: Simple framework for accelerating LLM generation with multiple decoding heads Tianle Cai*, Yuhong Li*, Zhengyang Geng, Hongwu Peng, Tri Dao (* Equal contribution) 2023-09-11 2,817 --
Flash-Decoding for long-context inference Tri Dao, Daniel Haziza, Francisco Massa, Grigory Sizov 2023-10-12 1,271 --
RedPajama-Data-v2: An open dataset with 30 trillion tokens for training large language models Together 2023-10-30 2,223 236
Growing to 20 exaflops, Together GPU Clusters help startups and enterprises accelerate generative AI development Together 2023-11-13 929 --
Announcing Together Inference Engine – the fastest inference available Together AI 2023-11-13 880 2
Announcing Together Custom Models. Build a state-of-the-art LLM with Together AI — and own the model. Together 2023-11-13 1,289 --
FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores Dan Fu, Hermann Kumbong, Eric Nguyen, Chris Ré 2023-11-13 1,804 --
Our $102.5M Series A VIPUL VED PRAKASH 2023-11-29 895 70
Paving the way to efficient architectures: StripedHyena-7B, open source models offering a glimpse into a world beyond Transformers Together 2023-12-08 1,712 221
Filter responses of any model with Llama Guard or your own safety model Together 2023-12-10 356 --
Can you feel the MoE? Mixtral available with over 100 tokens per second through Together Platform! Together 2023-12-11 323 --
Mamba-3B-SlimPJ: State-space models rivaling the best Transformer architecture Tri Dao, Albert Gu 2023-12-12 550 --
Building your own RAG application using Together AI and MongoDB Atlas Together AI 2024-01-11 1,249 --
Building your own RAG application using Together AI and LlamaIndex Together AI 2024-01-11 615 --
Long context retrieval models with Monarch Mixer Jon Saad-Falcon, Dan Fu, Simran Arora 2024-01-11 2,583 --
Building your own RAG application using Together AI and Langchain Together AI 2024-01-11 610 --
Introducing the Together Embeddings endpoint — Higher accuracy, longer context, and lower cost Together AI 2024-01-11 745 1
Announcing function calling and JSON mode Together AI 2024-01-31 1,861 --
BitDelta: Your Fine-Tune May Only Be Worth One Bit James Liu, Guangxuan Xiao, Kai Li, Jason D. Lee, Song Han, Tri Dao, Tianle Cai 2024-02-20 1,690 --
Evo: Long-context modeling from molecular to genome scale Eric Nguyen, Michael Poli, Matthew Durrant, Patrick Hsu, Brian Hie 2024-02-27 1,310 2
BASED: Simple linear attention language models balance the recall-throughput tradeoff Simran, Sabri, Michael, Aman, Silas, Dylan, James, Atri, Chris 2024-03-04 2,303 165
Sequoia: Scalable, Robust, and Hardware-aware Speculative Decoding Zhuoming Chen, Avner May, Ruslan Svirschevski, Yuhsun Huang, Max Ryabinin, Zhihao Jia, Beidi Chen 2024-03-12 616 --