Using Weaviate with Non-English Languages

The use of Weaviate with non-English languages is possible if the embedding models and large language models (LLMs) used support the chosen language. However, there are challenges when working with non-English languages in search or generative AI applications, such as the necessity of capable language models and character encoding issues for languages that cannot be ASCII encoded, like Chinese, Hindi, or Japanese. Weaviate can be used for semantic and generative searches with non-English languages by ensuring support from embedding models and converting escaped Unicode characters to human-readable ones. Currently, there are limitations in using Weaviate with non-English languages, mainly affecting keyword-based search functionality and hybrid search functionality.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.