Guest Post: Real-Time Big Data Ingestion with Meterial

Myntra's new processing and reporting framework, called Meterial, utilizes Apache Kafka, Data transformer based on Apache Spark streaming, SingleStore real-time database, and a UI built on React.js to provide real-time insights into rapidly growing data. The framework is designed to process unstructured/semi-structured data in real time with minimal latency, generating meaningful insights for business decisions. Meterial enables real-time user behavior analysis, traffic metrics, notification performance, and other key metrics, which are displayed through a dashboarding and reporting framework built on UDP APIs. The framework also supports ad-hoc analysis of commerce data with user data every 15 minutes, and is currently being explored for use in A/B testing and segmentation platforms.