May 2015 Summaries

Software development is a complex endeavor influenced by social structures, business goals, and limited knowledge, with the intricacies of these interactions reflected in code structure. Engineers must manage this complexity, anticipating future growth by employing techniques like writing small, focused classes and methods. A case study from Rescale's development team highlights the importance of early abstraction in code design, particularly when parsing third-party XML files. Initially, the parsing was straightforward, but as requirements expanded, the team introduced enums to centralize constants and handle attribute variations, such as different casing in XML node attributes. By preparing for unforeseen complexities, like inconsistent attribute naming, the team avoided cluttered code and maintained clarity, underscoring the necessity of expecting and managing complexity in software development.

Steve Conway's article highlights the increasing adoption of cloud computing in high performance computing (HPC) environments, growing from 13.8% in 2011 to 34.1% in 2015, with hybrid clouds also gaining traction. Despite improvements in data security, concerns persist about public cloud use, particularly for workloads that are not embarrassingly parallel. Rescale, founded in 2011, is a key player in this space, offering a business model that integrates public and private cloud resources with large HPC centers, supported by ISV partnerships across various industries. The company, led by experts in structural analysis and fluid-structure interactions, provides products like ScaleX Enterprise and addresses data security concerns with encryption and ITAR standards. Rescale's success is indicated by its threefold revenue growth in 2014, and IDC views its management team as well-positioned to capitalize on the anticipated growth in HPC cloud computing and outsourced services.

Cloud High-Performance Computing (HPC) faces the challenge of minimizing data transfer between on-premise machines and cloud-based systems due to slower and less reliable Wide Area Networks. To address this, it is advisable to perform post-processing remotely and transfer only necessary data. Users often run simulations and need to transfer output files, which are encrypted and stored in the cloud, allowing selective downloading. However, transferring individual files incurs overhead, and compressing data can optimize transfer times by reducing file size. Using compression tools, such as Jeff Gilchrist's MPI-compatible bz2 compressor, can significantly speed up the process by utilizing multiple cores for faster compression compared to single-core gzip. A compressed bz2 file can be up to five times smaller than an uncompressed tar file, significantly reducing download times, especially across slower internet connections. Automating these steps is expected to further streamline data handling in the future, enhancing efficiency for cloud HPC users.

Rescale has launched ScaleX Enterprise, a cloud-based high-performance computing (HPC) and simulation solution that allows CIOs and IT professionals to transform legacy on-premise systems into agile environments, enhancing product innovation and reducing time to market. This platform offers a secure and flexible solution by combining Rescale's simulation capabilities with a robust administrative portal and developer toolkit, enabling enterprises to deploy elastic hardware and software resources while maintaining full control across their IT infrastructure. It aims to meet the increasing demand for simulation by providing a scalable and secure environment, featuring integration with powerful technologies from Intel and NVIDIA, and offering access to over 120 cloud-enabled simulation applications from leading vendors. With an extensive network of global data centers, ScaleX Enterprise supports enterprises in developing innovative products and conducting advanced research and development, establishing itself as a leading provider of HPC solutions for various industries.