Doubling the GPUs on a training job rarely halves the time it takes. The first additions come close, each subsequent one returns less, and at some point the marginal GPU adds cost without moving the completion date enough to matter. The shape of that decline is a scaling curve, and where it bends decides whether […]