One Trillion Row Challenge

Feb 5, 2024 4m read Sarah Johnson Last month Gunnar Morling launched the One Billion Row Challenge with the task of writing a Java program for retrieving temperature measurement values from a text file and calculating the min, mean, and max temperature per weather station. This took off greater than anyone would expect, gathering dozens of submissions from different tools. We joined in the fun and made our own unofficial Python submission for Dask , which ran in 32.8 seconds on a MacBook.