Company
Date Published
Author
Tony Sleva
Word count
921
Language
-
Hacker News points
None

Summary

SAP Concur, a leading travel and expense management solution, transitioned from a SQL-based logging system to a more scalable and efficient solution using the Elastic Stack to manage the immense volume of logs generated by its extensive user base. Initially, Concur's logging system struggled with performance issues due to the high data ingestion rates, reaching limits that caused substantial delays. To address this, Concur adopted the Elastic Stack, which offered speed, scalability, and user-friendly visualization through Kibana, replacing various costly and disparate visualization tools previously used by different teams. This transition enabled Concur to handle increased data volumes effectively, with adoption rates and data ingestion soaring to 60,000 documents per second by 2017. They further enhanced their system with cross-cluster search, improving security to meet GDPR requirements, and integrating machine learning for operational analytics. Concur's LAMA team, consisting of six engineers and two managers, manages this sophisticated logging environment, facilitating end-to-end application ownership and DevOps practices across the organization.