December 2023 Summaries

Onehouse reflects on a transformative 2023, highlighting advancements in the Universal Data Lakehouse (UDL) architecture, which positions lakehouses as central to data analytics and aims to free data from platform lock-in. Founded by Vinoth Chandar, creator of Apache Hudi™, Onehouse emphasizes its commitment to open-source development, as illustrated by the launch of Hudi 0.14 and the preview of Hudi 1.0. The company introduced OneTable to enable interoperability across different table formats and forged strategic technology partnerships to enhance its Open Data Stack. The year also saw increased customer adoption of its managed cloud service, significant funding rounds totaling $33M to boost its engineering capabilities, and the successful debut of the Open Source Data Summit, drawing significant engagement from the data community. Looking ahead to 2024, Onehouse anticipates further developments in its managed services and the continued evolution of the Universal Data Lakehouse architecture.

The blog post summarizes a presentation from the Open Source Data Summit 2023, where Ronak Shah and Sarfaraz Hussain discussed Apna's implementation of the Universal Data Lakehouse to enhance their data platform's efficiency and reliability. The new architecture, named Apna Analytics Ground (AAG), integrates the flexibility of a data warehouse with advanced analytics capabilities of a data lake, utilizing tools like Apache Hudi, Onehouse, and Kafka for streamlined data ingestion and processing. This innovation addresses previous limitations in Apna's data management, such as batch processing inefficiencies and high costs associated with complex ETL operations, by enabling near real-time data availability, improved data consistency, and reduced potential points of failure. The medallion architecture organizes data into bronze, silver, and gold layers, enhancing data accessibility for various use cases, including machine learning and business intelligence, while supporting diverse compute engines like Spark and Presto. The new system also provides custom alerts and monitoring, allowing Apna to decouple storage and compute resources, optimize costs, and maintain operational flexibility without vendor lock-in.