claude-opus-4-8
claude-opus-4-8 (Anthropic) scored 81.8% composite across 87 tasks. This run covers Australian accounting, Animation, Auth screens, Dashboards, Australian law, Marketing pages, Programming, SVG and graphics, svg-scene, UI components, Websites. Published 2026-07-21.
Agent harnessLow reasoning
Composite
81.8%
95% CI 74.4% - 88.7%
Est. cost
$3.11
USD
Tokens
163,926
generation
Wall clock
8 min
end to end
Gate pass
-
validated
Separation
-
good vs bad
By domain
Composite score per domain, weakest first. Judge is the vision model’s read, shown for the visual domains.
Websites
15 tasks
53.8%
composite
svg-scene
1 task
62.5%
judge
62.5%
composite
Programming
6 tasks
66.7%
composite
Animation
2 tasks
69.8%
judge
69.8%
composite
Marketing page
1 task
70.8%
judge
70.8%
composite
Auth screen
1 task
70.8%
judge
70.8%
composite
Australian law
5 tasks
80.0%
composite
Dashboard
1 task
83.3%
judge
83.3%
composite
Australian accounting
23 tasks
89.9%
composite
SVG and graphics
13 tasks
94.2%
composite
UI components
19 tasks
94.4%
composite
Outputs
The actual rendered output. Open any tile to view it in a popup, or compare the same task across every model.
53 results
Objective tasks
Programming, Australian legal and accounting, graded by execution. 27 of 34 scored a perfect 100.0%; the rest are below. Open the answer in a popup, or compare it across every model.