Getting to a ‘thank you’ with an AI agent

The world is full of metrics Every launch of a next-generation foundation model is always accompanied by a plethora of metrics: how well the new LLM does, compared to its peers, on a series of tasks that, together, embody a notion of ‘performance.’ Other than by direct comparisons (with leaderboards like LMSys), this is the best way that researchers currently have to calibrate how one LLM should…