Architecting with LLMs and other ML models: use plain old code when you can, a model when you must

I recently wrote about the Coding agent sandwich , which is an architecture for a coding agent harness. The architecture consists of a tasty filling of LLM invocations sandwiched between two slices of plain old code (POC). Its practical rule is: use POC when you can, LLMs when you must.