How NASDAQ built a governed intelligence layer with dbt and Databricks

NASDAQ has developed an advanced intelligence platform called NASDAQ Eclipse Intelligence, utilizing dbt and Databricks, to meet the demanding data needs of financial markets. This platform, initially built for NASDAQ's own operations, is now extended to its financial market infrastructure (FMI) customers, addressing issues such as scale, regulatory governance, and AI readiness. Handling massive data volumes, the platform ensures high data accuracy, crucial in financial services where errors can lead to severe consequences. The use of dbt allows non-engineering teams to create data products efficiently, reducing time to market by up to 40%, while maintaining stringent governance standards necessary for regulatory compliance. This infrastructure supports a semantic layer that enhances AI applications by providing clear data context, enabling accurate and reliable AI outputs. NASDAQ's approach allows FMI customers to bypass lengthy build processes, offering them a robust data foundation in a matter of months, thereby facilitating quicker adaptation to evolving market demands and regulatory requirements.