Banja Lab / Benchmarks / Test
SVG-0006SVG and graphics · medium
Traffic light with only the green light lit
The same task, run on 28 models. Compare the outputs side by side, or open any one in a popup to inspect it.
Top result: claude-opus-4-8 (low reasoning) at 100.0% composite. Lowest: claude-haiku-4-5 at 0.0%. 28 models compared on this task.
How it ran
- Each model was given the brief below in a fresh, isolated session with no access to our tools, and returned its answer from scratch.
- The rendered output was scored 1 to 5 on brief fidelity, visual design, craft, and impact by a four-family vision panel - Anthropic (Claude Opus 4.8), OpenAI (GPT-5.5), Google (Gemini 3.1 Pro), and xAI (Grok 4.3) - using one identical prompt so the scores compare. The published judge score is leave-one-family-out: a model is never scored by a judge of its own family, so same-family self-preference is removed.
The brief
Draw a vertical traffic light in SVG. Show three lamps stacked top to bottom (red, amber, green). Only the green lamp at the bottom is lit (a bright green); the red and amber lamps are dark / off. Use a 40x100 viewBox. Build it from rectangles and circles only - do not use paths, raster images, or text. Write the result to `light.svg`.
