Problems With Prompts? Measurability & Predictability of LLM Accuracy

TL;DR: We are somewhat uncomfortable with prompt engineering, because it’s hard to know how accurate a given prompt really is, and responses can be inconsistent and unreliable. There are ways to mitigate this. There are a lot of factors you could consider in evaluating Large Language Models (LLMs) in contract analysis.