Why AI coding harnesses disagree over the right code context
The story in five sentences
- Ars Technica compares two approaches to supplying context for AI coding agents.
- Claude Code usually searches for the code it needs while working on a task.
- Augment Code indexes repositories in advance with embeddings, a retrieval model, and a vector database.
- Augment reports similar accuracy with 33 percent fewer tokens in its own Terminal-Bench comparison.
- The article warns that more autonomous agents do not replace human engineering judgment.
Full explanation
Ars Technica contrasts two philosophies for the harness surrounding an AI coding agent. The harness determines which code the model can see, which tools it can use, and how it interacts with a project. Anthropic keeps Claude Code comparatively lean and lets the agent search for relevant files as a task unfolds. Augment Code instead prepares repository context in advance with embeddings, a retrieval model, and a vector database.
Augment vice president Vinay Perneti argues that this indexed approach is especially useful for large private repositories. In the company’s own Terminal-Bench comparison, Augment reported a similar success rate while using 33 percent fewer tokens. That is a vendor benchmark rather than an independent evaluation. The compared setups also used partly different tools and optimization targets, which limits direct conclusions about relative quality.
Broader autonomy does not remove the need for experienced engineers. Humans still have to define useful specifications and assess whether an implementation fits the wider system. Coding agents may duplicate existing functionality when they lack architectural understanding. The expectation that inexpensive open-weight models will eventually handle more routine work is presented as a plausible direction, not a confirmed outcome.