How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Utilizing PyArrow to improve pandas and Dask workflows

calendar_today June 5, 2023 person Patrick Hoefler domain coiled

Jun 5, 2023 14m read Patrick Hoefler Get the most out of PyArrow support in pandas and Dask right now Introduction This post investigates where we can use PyArrow to improve our pandas and Dask workflows right now. General support for PyArrow dtypes was added with pandas 2.0 to pandas and Dask . This solves a bunch of long-standing pains for users of both libraries.

open_in_new Read original post