How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Automated Schema Evolution in Pinterest’s Next-Generation DB Ingestion Framework

calendar_today June 24, 2026 person Pinterest Engineering domain pinterest
Yisheng Zhou Software Engineer II Liang Mou Sr Staff Software Engineer Gabriel Raphael Garcia Montoya Staff Software Engineer Istvan Podor Staff Software Engineer Introduction In the first post of this series , we introduced Pinterest’s next-generation CDC-based ingestion platform built on Kafka, Flink, Spark, and Iceberg. In production, upstream schemas are constantly evolving, and in a distributed CDC pipeline, schema is not just metadata — it is a cross-system contract spanning ingestion, transformation, storage, and historical backfill. A schema change that is not handled carefully
open_in_new Read original post