How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Inter-Rater Reliability: Kappa, Alpha and Thresholds

calendar_today November 10, 2026 domain kili-technology

Measure inter-rater reliability for AI evaluation: percent agreement, Cohen’s and Fleiss’ kappa, Krippendorff’s alpha, gold answers and the thresholds to set.

open_in_new Read original post