Content Deep Dive

NeoMME: an efficient Multimodal-native and Multilingual Encoder

Blog post from Hugging Face

Post Details
Company
Date Published
Author
Tony Wu and Aurélien Lac
Word Count
2,554
Company Posts That Month
84
Language
-
Hacker News Points
-
Post removed?
No
Summary

NeoMME is a new open-source family of 260M- and 800M-parameter multilingual, multimodal encoders designed for efficient representation learning without separate pretrained vision towers or causal language-model decoders. Trained from scratch with a masked discrete-diffusion objective, each model processes text tokens and raw 32×32 image patches through a single long-context bidirectional Transformer that supports dynamic image resolutions and multilingual input. Its retrieval-focused version, NeoMME-Retriever, generates both compact dense embeddings and granular late-interaction embeddings in one pass for visual document retrieval, enabling page-image search that preserves layouts, tables, charts, and other visual information often lost through OCR. On ViDoRe benchmarks, the 260M model achieved the strongest reported score among evaluated models below 800M parameters, while the 800M model approached the performance of similarly sized competitors. The developers also report that the 260M model encodes roughly 51 2048×2048 document pages per second on an NVIDIA L40S, nearly twice the throughput of ColModernVBERT, and that pooling and quantization can reduce late-interaction storage from about 1.5 MB to 6 kB per page while retaining over 95% of baseline retrieval quality. Both model sizes, checkpoints, and Hugging Face Transformers support are released under the Apache 2.0 license.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
Vector Search 22 1,674 383 126 -31%
RAG 8 865 208 85 -29%
AI Model Fine-tuning 4 741 184 68 +29%
LLM 3 6,051 1,178 246 +14%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.