The use of large language models (LLMs) has moved from research labs into production systems faster than anyone predicted. A whole lot of companies and businesses are racing to figure out how to use AI on their own data without building custom infrastructure or hiring an army of engineers. The problem?