MediaPipe: Enhancing Virtual Humans to be more realistic

KDDI, a major Japanese telecommunications operator, is advancing the integration of text-to-speech and cloud rendering technologies to enhance the realism of virtual human avatars, known as VTubers. By leveraging MediaPipe's Face Landmarker solution, KDDI has successfully rendered realistic 3D face models that mimic user expressions in real-time, addressing challenges in achieving accurate movements and human-like facial expressions. The system captures facial features and extracts blendshapes using MediaPipe, storing them in Firebase Realtime Database, which then communicates with Google Cloud's Immersive Stream for XR to deliver low-latency, photorealistic 3D and AR experiences. This technological development is part of KDDI's broader initiative to blur the lines between the real and virtual worlds, offering services in the metaverse, live streaming, and virtual shopping, thereby fostering an ecosystem conducive to creative expression in the Web3 era.

No tracked trend matches for this post yet.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.