Digital Socrates: Evaluating LLMs through Explanation Critiques

Blog written by Yuling Gu Looking for an interpretable explanation evaluation tool that can automatically characterize the explanation capabilities of modern LLMs? Meet Digital Socrates at ACL 2024 ! A better way of evaluating explanations While large language models (LLMs) can provide explanations along with their answers, the nature and quality of those explanations are still poorly understood.