Taming Frontier Data Part 3: How to prevent data storage and computing costs from overwhelming research IT budgets

Amid increasing technology budgets in the pharmaceutical sector, life sciences organizations face the challenge of efficiently managing vast amounts of data from sources like biobanks and clinical trials without overwhelming their research and IT budgets. A significant portion of IT spending is directed towards data storage and computing, prompting the need for cost-effective and scalable solutions. Rady Children's Institute of Genomic Medicine exemplifies this challenge, as it sought to diagnose critical illnesses rapidly in the NICU by analyzing large volumes of genomic data. Initially hindered by a costly and inefficient file-based approach, they transitioned to using TileDB on Amazon S3, which allowed them to manage and analyze their Variant Call Format (VCF) samples efficiently, achieving a 97% cost reduction. This transition enabled the institute to conduct genomic analyses within seven hours, significantly enhancing their diagnostic capabilities and facilitating data sharing with other hospitals. The success story highlights the potential of scalable database solutions in transforming data management and analysis in life sciences, as organizations strive to leverage frontier data effectively.