Quick and dirty test of Google BigQuery’s ability to scale

As a quick weekend experiment I thought it might be a good idea to look at how BigQuery scales. In order to test this out I made use of the dataset that I already created in BigQuery for my previous blog post comparing HDInsight + Hive against BigQuery. One of the first challenges with such […]

HDInsight + Hive vs BigQuery – A Detailed Comparison

A big thank you goes to Daniel Haviv for his suggestion to use ORC with Snappy compression over Tez (with Vectorised reads) as well as the advice he provided to easily set this up. I have updated the post with the figures from this configuration.   A while ago I wrote about using Google BigQuery […]