Accelerating Apache Spark Queries (and Iceberg Rust Development) with Apache DataFusion Comet

Apache Iceberg’s ecosystem spans multiple query engines and language implementations that work together to give users a consistent experience across the data lakehouse. This post explores one integration within that ecosystem, Iceberg Rust and Apache DataFusion Comet , and the two benefits their relationship brings. Comet accelerates Apache Spark’s reads over Iceberg tables by running them natively through Iceberg Rust.