How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Dask DataFrame is Fast Now

calendar_today May 14, 2024 person Patrick Hoefler domain coiled

May 14, 2024 10m read Patrick Hoefler Performance Improvements for Dask DataFrames Intro Dask DataFrame scales out pandas DataFrames to operate at the 100GB-100TB scale. Historically, Dask was pretty slow compared to other tools in this space (like Spark). Due to a number of improvements focused on performance, it’s now pretty fast (about 20x faster than before).

open_in_new Read original post