Traffic light with only the green light lit
One task across 30 published runs. Inspect the scores and outputs together, with each run's execution method shown.
- Task
- SVG-0006
- Domain
- SVG and graphics
- Difficulty
- medium
Leading published run: claude-opus-4-8 (low reasoning) at 100.0% composite. Lowest: gemini-3.5-flash at 0.0%. 30 published runs shown on this task.
How this task was evaluated
Results are ordered by this task's published score. API runs use one prompt and one completion; agent runs use a coding harness with tools and iteration. Inspect the execution method when comparing results.
Objective scores use the benchmark's execution checks. Judge scores use a vision panel's fixed rubric; the published score leaves out a model's own family. Missing values are labelled rather than treated as zero.
Read the brief
Draw a vertical traffic light in SVG. Show three lamps stacked top to bottom (red, amber, green). Only the green lamp at the bottom is lit (a bright green); the red and amber lamps are dark / off. Use a 40x100 viewBox. Build it from rectangles and circles only - do not use paths, raster images, or text. Write the result to `light.svg`.
