Measuring Spatial Intelligence in LLMs

Snap is open-sourcing Spatial Benchmark, a benchmark for measuring how well language models reason about 3D space, with the benchmark, dataset, and evaluation code available on GitHub. It evaluates spatial reasoning that matters in AR, XR, simulation, games, and embodied tools, including placement, transforms, visibility, hierarchy, layout, and vector-based reasoning.