Banja Lab / Benchmarks / Test
DIAGR-0002SVG and graphics · hard
Four-node pipeline flow graph with exactly four edges
The same task, run on 27 models. Compare the outputs side by side, or open any one in a popup to inspect it.
Top result: claude-opus-4-8 (low reasoning) at 100.0% composite. Lowest: deepseek-v4-flash at 100.0%. 27 models compared on this task.
How it ran
- Each model was given the brief below in a fresh, isolated session with no access to our tools, and returned its answer from scratch.
- The rendered output was scored 1 to 5 on brief fidelity, visual design, craft, and impact by a four-family vision panel - Anthropic (Claude Opus 4.8), OpenAI (GPT-5.5), Google (Gemini 3.1 Pro), and xAI (Grok 4.3) - using one identical prompt so the scores compare. The published judge score is leave-one-family-out: a model is never scored by a judge of its own family, so same-family self-preference is removed.
The brief
Draw a pipeline flow diagram in SVG using a 240x170 viewBox. Write it to `graph.svg`. There are four nodes, each a `<circle>` with the listed id, and four directed edges, each a `<line>` carrying class="edge": Nodes (id : label): - node-start : Start - node-parse : Parse - node-build : Build - node-test : Test Edges (exactly four `<line class="edge">` elements): - Start -> Parse - Parse -> Build - Parse -> Test - Build -> Test Layout rules: - Start is to the left of Parse; Parse is to the left of Build. - Build is above Test (Build has the smaller y). - No two node circles overlap. - Put each node's label in a `<text>` element (Start, Parse, Build, Test). - Vector primitives only: no raster images, no data: URIs, no base64, no <foreignObject>, no <script>, no external references.
