Company
Date Published
Author
Emily Friedman
Word count
553
Language
English
Hacker News points
None

Summary

This release of SingleStore Ops includes performance features for Streamliner, their integrated Apache Spark solution. The latest release allows users to run Spark SQL inside the SingleStore database, enabling faster execution with improved NUMA-aware deployments and in-browser Python programming capabilities. By leveraging PySpark and a `pip` command, users can now prototype data pipelines much faster using Python syntax, which is widely used by developers. This focus on Python aligns with SingleStore's existing software written outside of the core database, allowing generalist developers to get up and running quickly. The release also includes performance boosts from running Spark SQL in SingleStore, where the optimized engine processes individual queries much faster than Spark can.