December 2013 Summaries

When designing a distributed system like SingleStore, predictability is key to optimizing performance and resource utilization. A shared-nothing architecture allows for easy scalability, low network congestion, and efficient I/O management. By understanding how reads and writes are handled across the cluster, developers can optimize the mix of aggregators and leaves to meet specific workload requirements. Capacity planning involves measuring and testing workloads to determine the optimal number of servers needed, making it straightforward to scale up performance testing. However, certain operations like DDL commands and large data transfers require special consideration to avoid bottlenecks.

The discussion between Carlos Bueno, a former Facebook engineer, and Carl Wright, a former CSO/CTO of the United States Marine Corps, will focus on how in-memory technologies are revolutionizing Big Data processing by enabling companies to manage large data sets in real-time. This is made possible by in-memory solutions like SingleStore that can process data faster than traditional disk-based storage systems. The experts will explore topics such as flexibility and incremental scale-out, agile responsiveness, and the use of SQL + JSON for real-time analytics on variable-structured data feeds. They aim to help businesses unleash the full potential of Big Data by consuming and returning data instantly.