Nvidia's Harness Beats the Model: Supervisor Agent Achieves 100% on ARC-AGI-3
Nvidia researchers achieved a perfect 100% score on the ARC-AGI-3 benchmark by deploying a custom supervisor harness around Claude Opus 5, proving the software wrapper outweighs the base model for long-horizon tasks.
Nvidia published research Friday demonstrating that a custom software harness, rather than the underlying AI model, is the primary driver of performance in long-horizon agentic tasks. By wrapping Anthropic's Claude Opus 5 in a system called Agentic Variation Operators (AVO), researchers secured a 100% score on ARC-AGI-3, an interactive reasoning benchmark consisting of instruction-free 2D games. Without this specific harness, the same model scored only 30%, which remained the highest baseline among all tested models. The results suggest that for complex, multi-step objectives requiring memory management and feedback loops, the scaffolding surrounding the model matters more than the model's raw parameters.
The critical architectural innovation in the AVO harness is the inclusion of a "supervisor" agent. Adel El Hallak, vice president of product in Nvidia's AI unit, described this component as acting like a CEO that nudges the primary agent when it deviates toward dead ends or begins re-exploring previously trod paths. This supervisory layer manages context and provides corrective feedback, addressing the common failure mode where agents become distracted or generate errors over extended operational windows. While single-layer harnesses like Claude Code or Codex are common, Nvidia's approach adds this distinct oversight layer to maintain trajectory during tasks that can span days of decision-making.
This finding aligns with recent industry data suggesting harness configuration significantly impacts both capability and cost. OpenAI recently reported tripling its own model scores on ARC-AGI-3 by tweaking two harness settings, though it failed to reach the perfect score Nvidia achieved. Similarly, Databricks research published in July indicated that choosing the wrong harness can double costs even when using the same model. Nvidia positions these results as an argument for open agent stacks, asserting that control over the runtime, infrastructure, and harness tools is necessary to drive accuracy and security, contrasting this with closed approaches that may limit user control over the full stack.