January 2014 Summaries

The text discusses the challenges and solutions related to scaling data analyses using the R programming language, particularly for large datasets. While R is favored for its natural and expressive framework for statistical analysis, it struggles with scalability due to its single-threaded nature. For data-intensive tasks, Hadoop is often more suitable, but with optimization techniques such as refactoring and using Rmpi, R's performance can be improved for moderately sized datasets. The text illustrates this by detailing the implementation of the PageRank algorithm, a fundamental link analysis method used by Google, using Rmpi on the Rescale platform, showing significant runtime improvements when parallelized across multiple threads. The experiments utilized the High Energy Physics Citation Network data set, demonstrating that while R may face limitations with very large datasets, it can effectively handle moderate ones with the right approach.

Rescale has joined MSC Software's Technology Partner Program, enhancing the compatibility of MSC Software tools, such as Adams, Marc, and MSC Nastran, with Rescale's cloud engineering platform. This partnership offers users expanded computing resources through Rescale's secure, web-based platform, which includes features like on-demand high-performance computing and integration with simulation tools. The collaboration aims to provide a flexible environment for using MSC Software's industry-leading solvers, benefiting sectors like aerospace, automotive, and life sciences. Founded in 2011 and based in San Francisco, Rescale emphasizes data security and offers its services on a pay-per-use model, enabling engineers and scientists to conduct large simulations efficiently.

In 2013, Rescale achieved significant milestones in security compliance, pricing flexibility, and tool expansion, including completing SOC Type 2 compliance audits and introducing reduced pricing tiers that can cut costs by over 50%. The company expanded its software library to over 30 simulation tools and improved its resources with updated tutorials and self-help videos. Looking ahead to 2014, Rescale plans to enhance its platform interface, introduce a Rescale API for better integration, and upgrade hardware for faster simulation speeds. They are also working on an on-premise solution that will allow users to utilize their own hardware or a hybrid setup with Rescale’s infrastructure. CEO Joris Poort, who has a background in engineering and management from Boeing and McKinsey & Company, leads the company as they continue to grow and recruit more team members.