nemotron-halloween

MonsterHouse is an interactive Halloween installation that turns a garage door into a grumpy, pirate-themed character that listens to trick-or-treaters, responds conversationally, and becomes friendlier when visitors use manners. Built on NVIDIA’s Nemotron Voice Agent, the system combines Nemotron ASR for speech recognition, Nemotron 3.5 Bolt E4B with a custom LoRA adapter for dialogue, Magpie TTS Zeroshot for character voice generation, and Audio2Face-3D in Unreal Engine 5 for synchronized facial animation. It runs locally across two NVIDIA RTX PRO GPUs, using cached dialogue and audio to reduce response latency, while a custom control interface manages conversation flow, mood, audio effects, animation, and manual fallback modes. Optional visual capabilities use Nemotron 3 Nano Omni to describe costumes and YOLO with ByteTrack to detect and track visitors. Although the complete MonsterHouse code is not being released, the author outlines how developers can build comparable interactive characters with NVIDIA’s available models, voice pipeline, personality prompts or LoRA training, animation tools, and cached responses.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.