Home / Companies / Ably / Blog / Post Details
Content Deep Dive

Appends for AI apps: Stream into a single message with Ably AI Transport

Blog post from Ably

Post Details
Company
Date Published
Author
Ably
Word Count
890
Language
-
Hacker News Points
-
Summary

Ably AI Transport has introduced a feature called appends, designed to enhance the efficiency of streaming AI output by consolidating multiple token messages into a single, progressively growing message. This approach addresses delivery challenges, such as handling disconnections, refreshes, and late client joins, which can complicate message history and require additional engineering efforts for reconstruction. By appending tokens to an initial response message, appends simplify the processing of real-time and historical data, allowing for seamless reconnections and reducing the burden on client-side logic. This method also enables better management of token rates and message capacity, with options to adjust for responsiveness and efficiency. The new feature requires enabling specific channel rules and offers a streamlined alternative to building custom message reconstruction systems, making it advantageous for developers of agentic AI applications.