Building a Robust Ingestion System for Any File of Any Size

A 300GB video does not fit on one machine, and a 4MB PDF can render into gigabytes of images. This is how our slicer and parser architecture processes arbitrary files with bounded compute and memory.