What is Code-Switching? A Complete Guide for ASR Builders

Code-switching, the alternation between languages within a single conversation, presents significant challenges for automatic speech recognition (ASR) systems, leading to error rates 1.5x to 11x higher than monolingual baselines on benchmarks. This issue arises because most ASR systems are designed for single-language use, failing at language boundaries where tokenizers, acoustic models, and downstream tasks degrade. Unified multilingual models, which can handle intra-sentential language switching, are suggested as more effective than cascade architectures that rely on language identification modules and routing, which can introduce latency and errors. Evaluation metrics like Mixed Error Rate (MER) and Point-of-Interest Error Rate (PIER) are crucial for measuring performance at language switch points, as standard Word Error Rate (WER) often obscures these critical failures. The guide stresses the importance of building evaluation pipelines with real production audio and emphasizes the need for ASR systems to adapt to the multilingual realities of the global market, particularly in high-volume voice verticals like contact centers and BPO sectors in multilingual regions.