Banja Lab / Benchmarks / Test
SVG-0001SVG and graphics · easy
Single-concept flat icon (coffee cup with steam)
The same task, run on 28 models. Compare the outputs side by side, or open any one in a popup to inspect it.
Top result: claude-opus-4-8 (low reasoning) at 100.0% composite. Lowest: deepseek-v4-flash at 100.0%. 28 models compared on this task.
How it ran
- Each model was given the brief below in a fresh, isolated session with no access to our tools, and returned its answer from scratch.
- The rendered output was scored 1 to 5 on brief fidelity, visual design, craft, and impact by a four-family vision panel - Anthropic (Claude Opus 4.8), OpenAI (GPT-5.5), Google (Gemini 3.1 Pro), and xAI (Grok 4.3) - using one identical prompt so the scores compare. The published judge score is leave-one-family-out: a model is never scored by a judge of its own family, so same-family self-preference is removed.
The brief
Create a clean, single-color flat SVG icon of a coffee cup with steam, suitable for a UI toolbar. Use a 24x24 viewBox. Use vector primitives only (paths, rects, circles). Do not include any text. Write the icon to `icon.svg`.
