Process transparency and error categorization at 1&1 by using the Elastic stack and ETL

1&1 Internet SE's Operations team has significantly enhanced its process transparency and error categorization using the Elastic Stack, comprising Elasticsearch, Logstash, and Kibana, alongside ETL tools like Pentaho Kettle. The team manages approximately 50,000 BPMN process instances weekly, generating about 50GB of logs daily, which the Elastic Stack allows them to analyze in real-time. This system provides vital insights into customer orders and supports the maintenance of process SLAs, like timely order provisioning. To comprehensively understand process errors, additional data from sources such as issue trackers is integrated, leading to a more efficient error detection and resolution process, improving the addressing rate from 60% to over 90%. The Kibana dashboard facilitates this improvement by offering a centralized view of errors across processes, linking to various tools for deeper analysis. Looking ahead, the team plans to integrate Apache Spark for real-time monitoring and KPI computation, enhancing order clustering and campaign estimation.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.