Bring Your Own Storage (Part 1)

Rescale's platform offers a comprehensive file management solution for cloud storage, utilizing major public cloud vendors with features like optimized transfer tools and encryption. It allows users to manage decrypted file content exclusively via Rescale's tools, but also supports integration with existing data pipelines and customer-controlled storage locations for simulations. The platform enables efficient compute resource allocation close to storage, supporting multiple cloud providers. A detailed example using Amazon S3 illustrates how users can set up a Design of Experiments (DOE) job, uploading input and output files to specified S3 directories, and configuring access through IAM policies. This setup involves creating local configuration files and scripts, which are encrypted and stored in Rescale-managed storage, while the core input and output files remain in user-specified buckets. Future developments aim to enhance integration with customer storage accounts.