November 2024 Summaries

Bertelsmann, a prominent European media company, has partnered with ElevenLabs to leverage artificial intelligence in enhancing storytelling and content production across its brands. This collaboration, aligned with Bertelsmann’s Tech & Data Alliance and AI Hub, utilizes ElevenLabs’ advanced AI technologies, including lifelike voice and sound generation, to streamline production processes, expand audience reach, and explore new creative avenues. The partnership aims to make storytelling more accessible through AI-driven dubbing, enabling content delivery in native languages and improving production timelines. Currently, 36 companies within the Bertelsmann Group benefit from ElevenLabs' technology, which helps maintain the creative focus of content creators rather than replacing them.

ElevenLabs has enhanced its ElevenReader app by introducing GenFM podcasts, allowing users to convert PDFs, articles, ebooks, and other texts into personalized audio content voiced by AI co-hosts in 32 languages. Available for free on iOS and Android, the app leverages ElevenLabs' advanced AI audio models to produce episodes rapidly, enabling users to stay updated on various topics or explore books and study materials through audio summaries and reviews. This feature supports language learning and improves listening skills by highlighting spoken text, catering to users who want to listen while commuting, working out, or performing daily tasks. The introduction of GenFM podcasts for Android is anticipated soon, furthering ElevenLabs' mission to make information universally accessible.

ElevenLabs has introduced several enhancements to its long-form text editor, including an auto-regenerate feature that automatically corrects audio mispronunciations and artifacts without additional cost, allowing users to enable this in settings or across entire projects. A thumbs-down feedback button has been added to refine error detection and improve future audio outputs, while a playback speed adjustment feature now enables quality-checking at up to twice the normal speed, reducing the time required by up to 70% for beta testers. Additionally, a rebranding of the Projects feature to Studio, now available to all free users, offers a comprehensive workflow for editing videos and audio, adding voiceovers and music, transcribing text, and publishing narrated productions.

Self-publishing audiobooks has become increasingly accessible and cost-effective due to advancements in AI-driven text-to-speech (TTS) platforms, which offer realistic, human-like narration. These platforms, such as ElevenLabs, Speechify, and Murf.ai, provide authors with the ability to produce high-quality audiobooks without the need for professional voice actors or expensive studio sessions. By using TTS technology, authors can maintain creative control, maximize earnings, and reach a growing audience of audiobook listeners, all while enjoying benefits like higher royalty rates, flexible production options, and multilingual narration capabilities. The ease of use and advanced customization options available with these platforms make audiobook production more efficient and inclusive, allowing authors to connect with international readers and visually impaired audiences. With careful selection of the right TTS tool, authors can transform their manuscripts into compelling audiobooks, thereby expanding their reach and reinforcing their personal brand.

WaveForms AI, a startup founded by former OpenAI and Google veterans, is focused on developing audio AI systems capable of passing the "Speech Turing Test," which measures whether listeners can discern between human and AI-generated speech. Led by CEO Alexis Conneau, the company aims to create systems that replicate human speech with emotional nuance, prioritizing Emotional General Intelligence to enhance empathy and connection. While WaveForms AI is in the development phase with plans to launch products next year, ElevenLabs has already achieved significant advancements in AI audio, offering production-grade Text-to-Speech technology that supports multiple languages and emotional expressiveness. Both companies address the technical and ethical challenges of indistinguishable AI speech, with ElevenLabs implementing safeguards like content moderation to responsibly manage these issues. WaveForms AI envisions its technology being used across diverse fields like education and entertainment, while ElevenLabs continues to lead in providing solutions that transform industries and meet current market needs.

OpenAI has introduced Sora Turbo, an advanced text-to-video generation model that allows users to produce realistic videos up to 1080p with features like frame-by-frame storyboard control and support for various aspect ratios, although it currently supports only short video durations and has usage restrictions. Sora Turbo is available through subscription tiers in ChatGPT Plus or Pro accounts, offering different levels of video quality and output capacity. Complementing Sora is ElevenLabs, which provides sophisticated AI audio tools, including lifelike voiceovers in 32 languages, sound effects, and AI dubbing, enhancing the storytelling quality of video projects. These tools allow creators to generate immersive content by pairing high-quality visuals from Sora with precise and contextually relevant sounds from ElevenLabs, making them suitable for applications in education, marketing, and entertainment by streamlining multilingual content production and enhancing narrative engagement.

Back-to-back Consumer AI Hackathons hosted in New York City and London showcased innovative uses of AI, with developers, designers, and AI enthusiasts collaborating to build practical applications. The NYC event, co-hosted with a16z, featured over 100 participants and highlighted projects like Kaizen, a fitness app using computer vision, and Two Somethin’, an AI for handling customer service calls. Meanwhile, the London hackathon at ElevenLabs HQ involved over 50 hackers, producing notable applications such as Runewell for creating custom voice casts and PersuAIsion, a tool for practicing social skills. These events emphasized the potential of AI in various domains and the impact of creative collaboration.

Wondercraft, in partnership with ElevenLabs, offers an intuitive platform for creating and personalizing high-quality audio content, suitable for a variety of uses such as podcasts, advertisements, and meditations, without needing technical expertise. Users have the ability to produce authentic audio using a Voice Library that supports personal voice cloning, diverse accents, and character voices, enabling them to control tone and expressiveness. Wondercraft's recent expansion includes editing support for Google’s NotebookLM podcasts, quickly attracting over 10,000 users who utilized its voice cloning features to personalize content. With significant adoption from major companies and creators, Wondercraft facilitates scalable production of content like host-read ads while maintaining security through features such as a “no-go” safeguard against unauthorized cloning. Juergen Berkessel of Polymash highlights how Wondercraft's integration has transformed his podcast production, allowing for efficient creation of custom audio and reducing initial hesitance towards synthetic voices.

Integrating ElevenLabs' Conversational AI with HubSpot offers a transformative approach to marketing automation by introducing natural voice capabilities to enhance content creation, customer engagement, and lead nurturing. HubSpot, known for its comprehensive marketing, sales, and customer service capabilities, benefits from this integration as it adds a dynamic audio layer to its existing AI-powered tools, allowing marketing teams to produce content more efficiently and engage audiences who prefer audio over text. ElevenLabs' Voice AI facilitates the conversion of written content into audio formats, provides personalized voice interactions, and automates content distribution, all while maintaining brand consistency. The seamless integration through Make's no-code automation platform enables businesses to set up workflows that trigger voice AI actions based on HubSpot events, thereby optimizing marketing strategies and improving data-driven decision-making. This combination not only enhances productivity and customer satisfaction but also points toward a future where marketing campaigns can communicate more personally and humanly with audiences.

CreatorKit, in partnership with ElevenLabs, has introduced Emotive AI Actors, a groundbreaking advancement in AI-driven video advertisements, offering hyper-realistic AI actors that can convey authentic emotions. Traditional AI video tools often struggled with emotional expression, but CreatorKit's new platform uses ElevenLabs' voice cloning technology to add emotional nuance, allowing businesses to create emotionally resonant video content by simply typing a script. This innovation has led to a 16% increase in conversion rates for videos utilizing these emotionally tuned voices, as each AI voice is crafted with permission and captures the necessary tone for authentic delivery. Kevin Natanzon, founder and CEO of CreatorKit, emphasizes the unique ability of ElevenLabs to maintain emotional authenticity in voice cloning, a crucial element for the success of Emotive AI Actors. This collaboration offers businesses a streamlined way to produce video ads that connect with audiences on a human level, enhancing the overall video creation process.

The Verdella program by WorkHaven, supported by the Office for Women in Queensland, aims to assist survivors of Domestic and Family Violence (DFV) by overcoming language barriers through the use of AI audio technology. In collaboration with ElevenLabs, Verdella has expanded its reach by creating audio guides in nine languages, including Arabic, Hindi, Korean, Punjabi, Tagalog, Vietnamese, and both Simplified and Traditional Chinese, alongside English. These audio files provide personalized guidance through the program's nine modules, ensuring that more survivors can access support in their preferred language. The translations are certified by 2M Language Services, and the program is distributed free of charge through local employers and services, enhancing accessibility for those in need. This initiative exemplifies how technology can make vital resources feel personal and familiar, thereby extending their impact and reach.

Integrating ElevenLabs' voice AI with Google Calendar offers a transformative approach to managing schedules through natural voice commands, enhancing convenience and efficiency for busy professionals. By using voice AI, users can create, modify, or cancel events hands-free, simplifying the scheduling process and mitigating conflicts by identifying potential double bookings and suggesting alternative times. This integration not only improves accessibility, especially when multitasking or on the go, but also enhances operational efficiency by automating routine tasks and reducing human error. The setup involves configuring voice AI agents through platforms like SureTriggers to establish workflows that automate calendar management, ultimately allowing users to focus on more important tasks.

Studio, a long-form text-to-audio creation platform, has introduced several updates to enhance the storytelling experience, making it faster and more personalized. The redesigned interface now features a refined UI/UX with a new navbar similar to 'Google Docs' for quick formatting adjustments, a Generation History button for restoring and downloading previous versions, and a lock button to secure completed sections. Users can now fine-tune specific audio outputs by regenerating selected words or sentences and have access to advanced voice controls that allow for the application of voice changes across multiple paragraphs. Multi-voice selection enables the inclusion of different voices within the same paragraph, ideal for character dialogue or varied voiceovers, and sentence delivery can be customized with speaker boost and stability settings. Additionally, the platform offers improved playback speeds and can generate multiple paragraphs at once, enhancing both the creation and review process for long-form audio content. As of January 2025, the platform previously known as Projects is now called Studio and is available to all free users, offering a complete workflow for editing videos and audio, adding voiceovers and music, transcribing to text, and publishing narrated productions.

Mark Wachholz, a filmmaker based in Berlin, utilized AI tools to enhance the auditory experience in his horror short film, "Unblind," which centers on a blind girl named Emily under her mother's control. By employing AI-generated voices and sound effects, Wachholz effectively crafted an immersive soundscape that deepens the narrative tension. He selected specific voice models, such as Anna - Female Classroom Teacher, for the mother's voice and used the Sound Effects model to create whispers and distant calls, pushing these tools to their limits to achieve highly expressive moments and an eerie ambience. Wachholz's innovative approach included using sound effects as voices and creating a haunting hum that serves as a recurring motif in the film, demonstrating his goal of maximizing the potential of AI tools rather than merely pushing boundaries. With a 20-year background in writing across various media, Wachholz continues to explore opportunities in AI-driven cinema, with "Unblind" serving as both a standalone piece and a part of a larger narrative being developed for potential collaboration with industry leaders.

Integrating ElevenLabs' voice AI with Intercom enhances customer communication by offering a more personalized, efficient, and accessible support experience. While Intercom excels in managing text-based interactions, incorporating voice AI capabilities allows businesses to deliver a human-like experience that increases customer engagement and satisfaction. Voice AI enables natural, lifelike interactions, improving the clarity and empathy of customer service, which is crucial for addressing sensitive or complex queries. By reducing the need for repetitive text exchanges, voice AI accelerates the resolution of customer issues and reduces the workload on support teams, allowing them to focus on more complex tasks. The integration also provides greater flexibility, enabling consistent service quality across multiple communication channels, from chat windows to phone calls. Businesses can tailor their support responses based on customer data and past interactions, thereby enhancing personalization and customer loyalty. As a result, the combination of Intercom's robust messaging tools and ElevenLabs’ advanced AI capabilities offers a seamless and unified customer support system that stands out in the competitive customer service industry.

Conversational AI is poised to revolutionize business communication by 2025 through the integration of Text-to-Speech, natural language processing, and advanced voice technology, enabling human-like interactions on a large scale. These AI systems promise to transform customer support, scheduling, and business operations by providing 24/7 availability, consistent brand voice, and multilingual capabilities, all while reducing operational costs and enhancing customer satisfaction. Modern conversational AI has evolved from rigid scripts to systems that understand intent, remember context, and adapt responses, with companies like ElevenLabs playing a pivotal role by incorporating realistic voice synthesis and emotion recognition. The technology allows businesses to handle thousands of simultaneous conversations with consistent quality, generate valuable data-driven insights, and facilitate seamless escalation to human agents for complex issues. Offering round-the-clock support and natural, personalized interactions, conversational AI enhances the user experience and provides businesses with a practical solution to maintain quality service while managing costs efficiently.

Microsoft Copilot and ElevenLabs offer distinct approaches to enhancing business communications through conversational AI. Microsoft Copilot integrates advanced Text-to-Speech and natural language understanding within the Microsoft 365 suite, enabling seamless voice interactions and contextual assistance across applications like Excel and PowerPoint. Its Copilot Studio allows businesses to create custom AI agents for streamlined workflows and enhanced productivity. In contrast, ElevenLabs specializes in creating highly natural voice interactions with a platform-agnostic approach, excelling in customer-facing applications by prioritizing sophisticated conversational experiences and advanced voice synthesis. While Copilot is tailored for internal productivity within the Microsoft ecosystem, ElevenLabs provides tools ideal for customer communication, offering multilingual support and the ability to maintain conversation context, making it a preferred choice for businesses focused on engaging customer interactions.

ElevenLabs is expanding its operations by investing in Poland and India to support local talent and drive AI development. In Poland, the company plans to invest $11 million over five years to develop the AI ecosystem, establish a Warsaw office as an R&D center and EU headquarters, and hire more than 130 employees over the coming years. The initiative also includes supporting educational initiatives and collaboration with local creators and dubbing actors. In India, ElevenLabs is building a local team to serve as one of the fastest-growing markets for AI, focusing on localizing technology capabilities, expanding Indic language coverage, and enhancing the Voice Library. These efforts aim to improve language accessibility and make a significant impact in both regions, aligning with the company's mission to enhance AI development globally.

ElevenLabs has announced a series of new products and updates, including Conversational AI for real-time voice interactions, enhancements to the ElevenReader app with personalized podcast generation, and the introduction of Workspaces for team collaboration. The company is expanding its market presence into Poland and India, investing $11 million in Poland over the next five years to develop the AI ecosystem and establish a new office in Warsaw. In India, ElevenLabs is localizing technology capabilities and expanding coverage for Indic languages. The Voice Library feature has surpassed $1 million in payouts to contributors, supporting passive monetization for voice actors. CEO Mati emphasizes the company's commitment to making meaningful content accessible globally, while CTO Piotr highlights the focus on solving real problems with audio AI to enrich user experiences.

Della Larsen, diagnosed with ALS in April 2023, embarked on a heartfelt mission to preserve her voice for her future grandchildren, whom she might never meet, by recording herself reading 30 children's books using voice banking technology. Each book is now accompanied by a QR code that links to a private recording, allowing her family to listen to her as if she were present. Beyond her personal efforts, Della shares her journey with ALS on social media, offering hope to others facing similar challenges. Her courage and dedication were recognized by the ALS Therapy Development Institute, which awarded her the Mary Lou Krauseneck Courage & Love Award. Della's acceptance speech utilized voice AI technology, supported by Bridging Voice and The Scott Morgan Foundation, highlighting the role of ElevenLabs in enhancing communication for those with speech impairments.

The integration of ElevenLabs' Conversational AI with Microsoft Teams aims to enhance productivity and streamline communication by transforming the platform into an intelligent workspace that responds to voice commands. This integration allows users to interact with Teams as if speaking to a personal assistant, reducing the need for navigating complex interfaces and enabling hands-free productivity through natural language task automation. The system supports various features such as real-time information retrieval, AI-powered meeting assistance, and workflow optimization, making Teams more accessible and reducing digital fatigue. With a focus on seamless integration using Make's workflow automation platform, organizations can customize and deploy voice-powered AI solutions to automate repetitive tasks, improve communication, and provide an inclusive, efficient work environment. ElevenLabs' Conversational AI supports multiple languages and offers tools for building conversational agents, ensuring scalability and adaptability to suit the specific needs of diverse teams.

Conversational AI and traditional chatbots represent two distinct approaches to automated communication, with the former offering more dynamic and context-aware interactions through advanced technologies like natural language processing (NLP) and text-to-speech (TTS). While traditional chatbots are rule-based and limited to scripted responses suitable for straightforward tasks, conversational AI can handle complex, open-ended questions and adapt to the flow of human-like conversations, providing a more engaging user experience. Businesses are increasingly adopting conversational AI to meet rising customer expectations for personalized service, as it offers scalability and the ability to remember past interactions, enhancing customer satisfaction and loyalty. Platforms like ElevenLabs enhance conversational AI by integrating high-quality, lifelike voice outputs, supporting multilingual and multimodal capabilities that are essential for international audiences. The decision between traditional chatbots and conversational AI ultimately depends on the complexity of the use case and the desired level of interaction, with conversational AI generally offering greater long-term value despite higher initial costs.

In 2025, text-to-speech (TTS) tools are revolutionizing content creation by providing efficient and cost-effective means to produce high-quality audio, with a focus on realistic voice quality, multilingual support, and customization options. Leading tools, such as ElevenLabs, Descript, Google Cloud Text-to-Speech, Amazon Polly, and Resemble AI, each offer unique advantages, making the choice dependent on factors like scalability, ease of use, and creative flexibility. As content creation becomes more competitive, TTS technology is vital for generating natural-sounding voiceovers with minimal effort, enabling creators to produce engaging videos, audiobooks, and multilingual content. The TTS market is saturated with advanced tools, and content creators prioritize ease of use, realistic voice replication, and personalization features to maintain their unique brand identity. Additionally, the affordability of TTS solutions is a key consideration, as creators seek to balance cost with the desired features. These tools are being employed in diverse applications, from audiobooks and podcasts to YouTube content and social media videos, highlighting their versatility and essential role in modern content production.

Integrating ElevenLabs' voice-powered AI with Zendesk can significantly enhance customer service by streamlining ticket management and improving communication. This combination leverages Zendesk's robust ticket handling capabilities with lifelike conversational AI, enabling real-time, personalized interactions that build trust and satisfaction among customers. The integration allows for faster ticket resolution and more personalized service by using detailed customer data and history, while also automating routine tasks to boost team productivity. Moreover, this setup provides valuable insights through analytics, helping businesses refine their support strategies. By incorporating voice AI, companies can ensure seamless communication across different channels, maintain their brand's voice, and offer a superior customer experience that aligns with their values.

In 2023, YouTube launched its Multi-Language Audio (MLA) feature, enabling creators to add multiple language tracks that adapt to viewers' preferences, significantly expanding their audience reach. By September 2024, many creators, including Drew Binsky, utilized this feature, resulting in substantial viewership growth for dubbed videos, especially in non-English-speaking regions. Drew Binsky's dubbed content in languages such as Spanish, Portuguese, Arabic, German, and Italian saw up to 1 million additional views for mature videos and a notable increase in audience engagement for newer content. The use of ElevenLabs' Dubbing Studio allowed for seamless localization across 29 languages while maintaining the original style and tone, offering creators the ability to reach global audiences effectively. The collaboration highlighted the importance of accurate localization, regular releases, data-driven language selection, and performance tracking to optimize the success of AI-dubbed content.

Integrating the ElevenLabs Conversational AI widget into a Wix website involves a series of steps that require a Wix Premium plan due to the necessity of embedding custom JavaScript. Users must first prepare the widget by setting up a conversational agent in their ElevenLabs account and copying the provided JavaScript embed code. With Wix's Dev Mode enabled, the code is added via the Custom Code settings in the Wix Editor. Common issues, such as widget disconnection or JavaScript errors, can often be resolved by ensuring proper Allowlist configurations and by checking that the JavaScript is correctly embedded. The guide also emphasizes the importance of testing the widget across different browsers and ensuring mobile responsiveness. For users encountering persistent issues, ElevenLabs offers support to assist in troubleshooting.

Enhancing a Ghost website with ElevenLabs' Conversational AI widget can significantly improve customer engagement by offering interactive and lifelike support conversations. The integration process is straightforward, requiring either the Code Injection feature for a site-wide widget or the plus sign in the Ghost Editor for embedding it on specific pages or posts. Users need a paid Ghost plan or a self-hosted instance, access to the Ghost admin panel, and an ElevenLabs account to obtain the necessary JavaScript embed code. Common integration issues include incorrect code placement or script conflicts, which can be resolved by verifying the code and testing for conflicts. Advanced users can customize widget placement with CSS and ensure mobile responsiveness and cross-browser functionality. The process does not require coding experience, making it accessible for anyone looking to enhance their Ghost site with conversational AI capabilities.

The guide offers a comprehensive walkthrough for integrating the ElevenLabs Conversational AI widget into a Framer website, aimed at enhancing user engagement and customer support through interactive AI-driven conversations. It details the necessary preparatory steps, including having a Framer account with custom code capabilities and an ElevenLabs account to configure the AI agent. The step-by-step instructions cover logging into ElevenLabs, copying the required embed code, and placing it within Framer’s site settings and specific pages using Embed Elements. Troubleshooting advice addresses common issues such as visibility problems and script errors, while advanced tips suggest customizing the widget's appearance with CSS and ensuring proper display across devices. The guide emphasizes the ease of implementation without extensive coding skills and highlights the need to publish the site to see the widget in action.

Integrating ElevenLabs' Conversational AI widget into a Webflow website is a straightforward process that can enhance customer engagement by enabling natural, human-like interactions. To implement the widget, users need an active Webflow account with a suitable plan and an ElevenLabs account to configure the voice agent and obtain the necessary embed code. The integration involves adding the widget's embed code to a Webflow page using the Embed Element for the widget's location and inserting a script snippet globally in the site's Footer Code section to ensure functionality across all pages. By publishing the site, users can verify the widget's appearance and operation, although custom code does not render in Webflow’s Designer. Troubleshooting common issues, such as widget display and alignment problems, can be managed through correct placement of code snippets and adjustments using Webflow’s Style Panel. For advanced customization, users can modify the widget's appearance with CSS and ensure responsive design across devices. The guide emphasizes that no coding experience is necessary, as the process mainly involves copying and pasting code snippets.

Integrating the ElevenLabs Conversational AI widget into a WordPress website can enhance user engagement through interactive, AI-driven experiences. The process involves using Custom HTML Blocks for specific pages and Code Injection for site-wide functionality, requiring at least a WordPress Business or Commerce plan for WordPress.com users or a self-hosted WordPress setup. Users must configure the Conversational AI in their ElevenLabs account, then incorporate the provided <script> and <div> snippets into their site. The guide explains adding the widget to specific pages via Custom HTML blocks and ensuring global functionality by adding the script through a plugin or directly into the theme's code. It also includes troubleshooting common issues related to widget display, alignment, and plugin conflicts, while offering advanced tips for customization and cross-device testing. Despite needing basic WordPress knowledge, the process is accessible to those with minimal coding experience, although more advanced customizations might require some coding skills.

Integrating ElevenLabs' Conversational AI widget into a Squarespace website can significantly enhance user engagement and customer support through conversational agents. The process involves configuring an AI agent on the ElevenLabs platform, copying the provided embed code, and utilizing Squarespace's Code Blocks and Code Injection features to add the widget to specific pages or across the entire site. Troubleshooting common issues, such as widget display problems or script errors, can be managed by ensuring correct snippet placement and using tools like Chrome DevTools for error identification. Advanced customization and testing across various devices ensure the widget functions seamlessly, aligning with the site's design. While basic familiarity with Squarespace's interface is recommended, the step-by-step guide simplifies the integration, making it accessible even to those with minimal coding experience.