Company
Date Published
Author
Nicole Nearhood
Word count
859
Language
English
Hacker News points
None

Summary

At Spark Summit, SingleStore showcased its PowerStream application, which integrates with Apache Spark to process and analyze data from over 2 million sensors on 200,000 wind turbines worldwide. The SingleStore Spark Connector enables tight integration between SingleStore and Spark, allowing users to create DataFrames in Spark backed by SingleStore tables and persist DataFrames to SingleStore for easy storage. Streamliner is another key component that enables real-time ETL pipelines using Spark as a high-level language, allowing customers to write logic for data analytics pipelines and apply it to their SingleStore cluster instantly. PowerStream is an end-to-end pipeline for high-throughput analytics and machine learning, demonstrating how to deploy machine learning models in production and run them on incoming data in real-time.