Home / Companies / Vonage / Blog / Post Details
Content Deep Dive

Video + AI: Configurable Audio Processing for Video Applications

Blog post from Vonage

Post Details
Company
Date Published
Author
Karl Lingiah
Word Count
1,499
Language
English
Hacker News Points
-
Summary

The author of the article has updated their Node application that uses the Vonage Video API's Audio Connector feature to demonstrate additional use-cases beyond transcription. The new features include extracting questions, action items, and topics from audio data during a video call. These features are implemented using Symbl.ai's Streaming API and allow for configurable options for which parts of the audio to process. The application flow has been updated to provide checkboxes for selecting processing options, and a `SymblProcessor` class has been created to manage the configuration, handlers, and data storage for these new features. The article also highlights the importance of considering how to implement an application using Audio Connector when determining whether to send individual or combined streams.