Got big JSON? BigQuery expands data import for large scale web apps

Google BigQuery has expanded its capabilities to support JSON, a popular data format for web applications, enabling more effective handling of nested and repeated data structures, which enhances the platform's ability to manage complex datasets without the need for data flattening as required with CSV files. This update allows for more efficient data ingestion of up to 1TB per load job, with each file supporting up to 100GB of uncompressed JSON or CSV, and removes previous rate limits on imports, significantly speeding up large data processing tasks as demonstrated by a 20x improvement in a case study. The announcement also highlights new documentation available to assist developers in importing and querying JSON data, alongside details of a trusted tester program for users looking to integrate data from the App Engine Datastore to BigQuery, as well as Google’s presence at big data conferences to discuss these advancements.