October 2023 Summaries

The Studio application has been upgraded to include automatic audio normalization to comply with audiobook distributor standards, enhancing its comprehensive workflow, which facilitates editing videos and audio, adding voiceovers and music, transcribing to text, and publishing narrated, captioned productions. As of January 2025, the application previously known as Projects is now called Studio and is accessible to all free users. ElevenLabs, the team behind Studio, has also developed an AI Sales Development Representative (SDR) that effectively qualifies 78% of leads and operates in over 30 languages, providing instant responses and booking meetings. Additionally, ElevenLabs showcased their voice cloning technology in 12 Indian languages live at IIT Delhi, emphasizing the authenticity, ease, and speed of their platform.

ElevenLabs has announced a partnership with the Global Reporting Initiative (GRI) to enhance accessibility in sustainability reporting by developing e-learning courses that promote understanding of GRI Standards. This collaboration aims to further global sustainable development goals by providing diverse educational content tailored to different learning preferences. The initiative seeks to improve knowledge of sustainable practices worldwide, with over 10,000 organizations already utilizing GRI's standards as a framework for responsible growth. ElevenLabs emphasizes its commitment to using advanced technology for meaningful impact, helping to create a more informed and sustainable world through improved access to essential sustainability information.

ElevenLabs has partnered with Pictory AI to enhance video content by integrating advanced AI voice technology, allowing users to add realistic AI voices to their videos. This collaboration aims to elevate the video experience for creators, marketers, bloggers, and social media managers by combining ElevenLabs' voice capabilities with Pictory AI's text-to-video transformation algorithms. The partnership particularly focuses on English and German content, enabling high-quality outputs for a broad audience and offering applications such as converting blog content into videos and providing video summaries. Both companies emphasize innovation and the potential to set new standards in how content is created and consumed, with leaders from both organizations expressing excitement about the new possibilities, particularly in making videos with human-sounding voices suitable for various business applications.

ElevenLabs has introduced a metadata feature for its Studio platform, enabling users to automatically embed metadata in downloaded files, enhancing the workflow for editing videos and audio, adding voiceovers and music, transcribing text, and publishing narrated and captioned productions. Formerly known as Projects, Studio is now accessible to all free users as of January 2025, providing a comprehensive tool for creative and professional projects. The ElevenLabs team shares customer stories illustrating the platform's impact, such as Le Walk's use of ElevenLabs to create engaging digital tour guides and Voxpopme's enhancement of its AI Moderator with natural, trustworthy voices powered by ElevenLabs' Agents Platform, supporting over 10,000 research conversations.

ElevenLabs has recently made significant improvements to its dubbing system by enhancing translation accuracy and addressing issues related to speaking speed. Their platform, which supports over 10,000 research conversations, is now being used to enhance AI Moderator features through natural, trustworthy voices. In a bid to expand access to individuals with permanent speech loss due to conditions like ALS and cerebral palsy, the ElevenLabs Impact Program, launched a year ago, aims to provide one million voices and allows patients and clinicians to apply directly on their website.

ElevenLabs has launched a groundbreaking AI Dubbing feature that enables the translation of spoken content into over 20 languages while preserving the original speaker's voice characteristics, emotional tone, and timing. This innovation aims to eliminate language barriers and make content universally accessible by allowing creators, educators, and media companies to reach a global audience with minimal effort and cost. By combining multilingual speech synthesis, voice cloning, and advanced audio processing, the tool offers high-quality dubbing for audio and video content, maintaining the unique identity of each speaker. This development follows the release of ElevenLabs' Studio tool for long-form audio creation and editing, furthering the company's mission to enhance content accessibility and authenticity across various mediums such as streaming, gaming, and films.

ElevenLabs has announced the release of "Dubbing," a cutting-edge technology that converts content into multiple languages with automatic voiceovers, using sophisticated algorithms to ensure seamless translation. This innovation is available in over 30 languages and operates around the clock, allowing agents to respond and book meetings instantly, enhancing inbound sales processes by qualifying a high percentage of leads. Additionally, ElevenLabs has demonstrated its capabilities in voice cloning across 12 Indian languages, showcasing the authenticity and efficiency of its technology live at IIT Delhi.

The 23Labs Hackathon, scheduled for October 14-15 in San Francisco, is a collaborative event involving Cerebral Valley, Eleven Labs, and Twelve Labs, designed to explore the burgeoning field of Multimodal AI, which integrates voice, video, and other modalities to develop innovative applications. Participants will have access to APIs from Eleven Labs, known for its advanced text-to-speech technology, and Twelve Labs, which specializes in video understanding platforms, to build creative tools with the support of these pioneering startups. Eleven Labs focuses on making content accessible through realistic AI-generated speech, while Twelve Labs aims to enhance video comprehension using multimodal embeddings for tasks like natural language search and classification. This hackathon not only offers over $10,000 in prizes but also aims to push the boundaries of multimodal AI by combining these cutting-edge technologies, ultimately transforming digital interaction.

ElevenLabs, a leader in voice AI technology, has partnered with Loccus, a developer of voice authentication security systems, to enhance safety standards in audio AI through the development of deepfake detection systems. This collaboration aims to address ethical concerns and the potential misuse of AI, such as misinformation and fraud, by providing robust tools for detecting synthetic speech. The partnership seeks to involve AI labs, industry experts, and academic communities to maximize its impact and foster ethical AI practices. By integrating diverse perspectives and insights, ElevenLabs and Loccus aim to create a framework that empowers all stakeholders to actively participate in setting ethical standards and ensuring a responsible AI-driven ecosystem. This initiative represents a proactive step towards constructing a secure technological landscape, aligning with ElevenLabs' mission to promote ethical AI practices, as highlighted by CEO Mati Staniszewski.