Compare the whole delivery path
A local model can have low marginal inference cost while the hardware remains underutilised or the output needs more remediation. A hosted model can have higher token cost while completing certain work with fewer iterations.
Cost per verified delivery combines execution cost with review, failure and delay.
- Model capability
- Context and tool fit
- Utilisation and queueing
- Review and remediation yield
