How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Benchmarking Coding Agents on the Now Platform Codebase

calendar_today November 4, 2026 person Chris Hinckley domain servicenow

Thirty-seven model and harness combinations, 200 tasks mined from our own merged pull requests, and 34,000 graded attempts. What we learned about which agents to use, what they really cost, and whether the popular add-ons help.

open_in_new Read original post