Lambda Bare Metal Instances: full hardware control with API-driven operations

The unit of AI compute has shifted from single hosts to rack-scale systems that integrate NVIDIA GPUs, CPUs, scale-up networking fabrics, and liquid cooling, such as the NVIDIA GB300 NVL72 and NVIDIA Vera Rubin NVL72. Teams at the frontier of training and serving models have three common needs: leading-edge compute for the best tokens per watt per dollar, bare-metal access for uncompromised performance and security, and cloud-grade usability so engineers can focus on building models rather than operating data centers. Today’s market forces a compromise.