Airflow in Action: How Panasonic Energy is Accelerating the EV Transition With Data Engineering

Panasonic Energy has been accelerating the transition to sustainable energy through the production of lithium-ion batteries since 2017. The company's data engineering team uses Apache Airflow to automate and structure its workflows, enabling the creation of live dashboards for operational analytics. Panasonic has gone through three iterations with Airflow, improving standardization, breaking down monolithic DAGs into manageable task groups, and implementing GitLab CI/CD pipelines for consistent deployment. The company is now exploring the future of Airflow with Kubernetes and streaming workflows to facilitate real-time data processing and seamless data streaming from Manufacturing Execution System (MES) and MQTT brokers.