Company
Date Published
Author
JK Kim
Word count
3871
Language
English
Hacker News points
None

Summary

GoGuardian is an Education Technology company that uses machine learning to moderate student web activities and improve the learning environment. The company faces significant challenges in handling the vast amount of data generated by its users, including 5 million students per day. These challenges include data duplication, high throughput, and aggregate queries that are not suitable for traditional relational databases. To address these issues, GoGuardian experimented with various solutions, including sharded SQL databases, Druid, Phoenix, BigQuery, Presto, Athena, Spanner, and finally SingleStore. After testing and evaluating the performance of each solution, GoGuardian found that SingleStore was the most suitable option for its use case due to its ability to perform joins and unions across row and columnar tables, high availability, speed, and friendly support from the vendor's engineering team. By adopting SingleStore, GoGuardian was able to improve its infrastructure's performance, reduce costs, and enhance its customers' experience.