Company
Date Published
Author
Wayne Song
Word count
332
Language
English
Hacker News points
None

Summary

SingleStore Loader is a powerful tool that solves common limitations of the LOAD DATA command in MySQL and SingleStore, allowing users to load files from remote data stores like Amazon S3 and Hadoop Distributed File System (HDFS), parallelizing the workload and retrying failed loads. The tool also deduplicates files and provides progress updates through commands such as `load` and `ps`. A binary version of the loader is available on the SingleStore website, but the project has been open sourced to make it more accessible to developers.