Ask a language model to find the closest bakery to Gunnersbury Park in London and it will give you a confident answer. Check that answer against a map, however, and you may find it’s nowhere near the closest. That’s because the model has inferred proximity from reviews and descriptions rather than calculating actual distances across the road network.