Linus Tech Tips: Building Synthetic Linus
Blog post from Resemble AI
Linus Tech Tips experimented with synthetic audio and video technology to produce a video review of the CLEAVE keyboard without Linus's physical presence, using text-to-speech powered by Resemble. By leveraging existing audio of Linus, they created a synthetic voice that allowed for flexibility in script and post-production, without the need for studio time. The use of Resemble's platform enabled them to control emotional gradients and employ a feature called CopyPaste, which extracts speech patterns from another audio clip to apply to Linus's synthetic voice, allowing for creative variations in speech. This technology enabled Linus's voice identity to be maintained while allowing inputs from James Strieb's voice to influence the final output. For visuals, Linus's team used DeepFaceLab to synchronize the facial expressions with the synthetic audio, showcasing the potential for producing content without the actual presence of the host.