NeoMME: an efficient Multimodal-native and Multilingual Encoder
Blog post from Hugging Face
NeoMME is a new open-source family of 260M- and 800M-parameter multilingual, multimodal encoders designed for efficient representation learning without separate pretrained vision towers or causal language-model decoders. Trained from scratch with a masked discrete-diffusion objective, each model processes text tokens and raw 32×32 image patches through a single long-context bidirectional Transformer that supports dynamic image resolutions and multilingual input. Its retrieval-focused version, NeoMME-Retriever, generates both compact dense embeddings and granular late-interaction embeddings in one pass for visual document retrieval, enabling page-image search that preserves layouts, tables, charts, and other visual information often lost through OCR. On ViDoRe benchmarks, the 260M model achieved the strongest reported score among evaluated models below 800M parameters, while the 800M model approached the performance of similarly sized competitors. The developers also report that the 260M model encodes roughly 51 2048×2048 document pages per second on an NVIDIA L40S, nearly twice the throughput of ColModernVBERT, and that pooling and quantization can reduce late-interaction storage from about 1.5 MB to 6 kB per page while retaining over 95% of baseline retrieval quality. Both model sizes, checkpoints, and Hugging Face Transformers support are released under the Apache 2.0 license.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| Vector Search | 22 | 1,674 | 383 | 126 | -31% |
| RAG | 8 | 865 | 208 | 85 | -29% |
| AI Model Fine-tuning | 4 | 741 | 184 | 68 | +29% |
| LLM | 3 | 6,051 | 1,178 | 246 | +14% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.