Real-Time Data Lineage at UBS

UBS created the Group Data Dictionary, a real-time data governance platform to track data origins and lifecycles, in response to the new BCBS 239 regulations. The team originally built the governance platform in Oracle but transitioned to Neo4j due to its natural persistence in handling highly connected data. Despite some challenges, such as circularity, complexity, coupling, and missing standards for graph formats, the UBS team has made progress in implementing a lineage generation algorithm using Neo4j's Cypher query language. The team is working on enhancements to reduce coupling with the presentation layer and improve performance. Despite the difficulties, the Group Data Dictionary has shown promise in ensuring data integrity and accuracy for UBS.