Skip to content
Banja Labs
HomeWorkWhat we doThe lab
Let's talk

Keyboard-operable select-only combobox with a listbox popup

One task across 30 published runs. Inspect the scores and outputs together, with each run's execution method shown.

All experimentsModel resultsDesigner buildsCompare models
Task
AYGAT-0002
Domain
UI components
Difficulty
hard

Leading published run: claude-opus-4-8 (extra-high reasoning) at 100.0% composite. Lowest: deepseek-v4-pro at 0.0%. 30 published runs shown on this task.

How this task was evaluated

Results are ordered by this task's published score. API runs use one prompt and one completion; agent runs use a coding harness with tools and iteration. Inspect the execution method when comparing results.

Objective scores use the benchmark's execution checks. Judge scores use a vision panel's fixed rubric; the published score leaves out a model's own family. Missing values are labelled rather than treated as zero.

Read the brief

Build a single self-contained page as one HTML file (`index.html`) that renders with no build step and no network calls (inline all CSS and JS, no external fonts or scripts). Build a select-only combobox (a button that opens a listbox of options, NOT a native <select>). Requirements: - The trigger has id="combo", role="combobox", aria-haspopup="listbox", and aria-expanded that is "false" while closed and "true" while the listbox is open. - The popup is a role="listbox" with id="listbox" containing at least four role="option" items; one option starts with aria-selected="true" and the rest aria-selected="false". Give the options the ids opt-starter, opt-team, opt-business, opt-enterprise. - With the combobox focused, ArrowDown opens the listbox (if closed) and moves the active option down; ArrowUp moves it up. The combobox keeps aria-activedescendant pointing at the id of the currently active option while open. - Enter (or Space) selects the active option: its aria-selected becomes "true" (and the previously selected option becomes "false"), the listbox closes (aria-expanded "false"), and focus returns to the combobox. Escape closes the listbox without selecting. The combobox must be fully operable with the keyboard alone. Use plain, accessible markup.

Anthropicclaude-opus-4-8
Extra-high reasoning
Agent harness2026-07-21
claude-opus-4-8 rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 100.0%
Open
Composite 100.0%Objective 100.0%
Open outputFull run
Anthropicclaude-opus-4-8
Max reasoning
Agent harness2026-07-21
claude-opus-4-8 rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 100.0%
Open
Composite 100.0%Objective 100.0%
Open outputFull run
Zhipuglm-5.2
default reasoning
API single-shot2026-07-17
glm-5.2 rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 100.0%
Open
Composite 100.0%Objective 100.0%
Open outputFull run
Anthropicclaude-fable-5
High reasoning
Agent harness2026-07-09
claude-fable-5 rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 99.1%
Open
Composite 99.1%Objective 99.1%
Open outputFull run
Anthropicclaude-opus-4-8
Medium reasoning
Agent harness2026-07-21
claude-opus-4-8 rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 98.1%
Open
Composite 98.1%Objective 98.1%
Open outputFull run
Anthropicclaude-opus-4-8
High reasoning
Agent harness2026-07-21
claude-opus-4-8 rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 98.1%
Open
Composite 98.1%Objective 98.1%
Open outputFull run
Moonshotkimi-k3
default reasoning
API single-shot2026-07-17
kimi-k3 rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 98.1%
Open
Composite 98.1%Objective 98.1%
Open outputFull run
Anthropicclaude-sonnet-5
High reasoning
Agent harness2026-07-21
claude-sonnet-5 rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 97.2%
Open
Composite 97.2%Objective 97.2%
Open outputFull run
Googlegemini-3.5-flash
default reasoning
API single-shot2026-06-23
gemini-3.5-flash rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 94.4%
Open
Composite 94.4%Objective 94.4%
Open outputFull run
xAIgrok-4.20-reasoning
default reasoning
API single-shot2026-06-25
grok-4.20-reasoning rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 94.4%
Open
Composite 94.4%Objective 94.4%
Open outputFull run
Anthropicclaude-sonnet-4-6
High reasoning
Agent harness2026-07-21
claude-sonnet-4-6 rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 88.8%
Open
Composite 88.8%Objective 88.8%
Open outputFull run
DeepSeekdeepseek-v4-flash
default reasoning
API single-shot2026-06-25
deepseek-v4-flash rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 88.8%
Open
Composite 88.8%Objective 88.8%
Open outputFull run
Anthropicclaude-opus-4-8
Low reasoning
Agent harness2026-07-21
claude-opus-4-8 rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run
Anthropicclaude-haiku-4-5
High reasoning
Agent harness2026-07-09
claude-haiku-4-5 rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run
Moonshotkimi-k2.7-code
default reasoning
API single-shot2026-07-17
kimi-k2.7-code rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run
OpenAIgpt-5.5
High reasoning
API single-shot2026-07-17
gpt-5.5 rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run
OpenAIgpt-5.4-mini
High reasoning
API single-shot2026-06-23
gpt-5.4-mini rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run
OpenAIgpt-5.6-sol
High reasoning
API single-shot2026-07-09
gpt-5.6-sol rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run
OpenAIgpt-5.6-sol
Max reasoning
API single-shot2026-07-09
gpt-5.6-sol rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run
OpenAIgpt-5.6-terra
High reasoning
API single-shot2026-07-09
gpt-5.6-terra rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run
OpenAIgpt-5.6-luna
High reasoning
API single-shot2026-07-09
gpt-5.6-luna rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run
Googlegemini-3.1-pro-preview
High reasoning
API single-shot2026-06-23
gemini-3.1-pro-preview rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run
Googlegemini-3.1-flash-lite
default reasoning
API single-shot2026-06-23
gemini-3.1-flash-lite rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run
xAIgrok-4.5
High reasoning
API single-shot2026-07-09
grok-4.5 rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run
xAIgrok-4.5
Medium reasoning
API single-shot2026-07-09
grok-4.5 rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run
xAIgrok-4.5
Low reasoning
API single-shot2026-07-09
grok-4.5 rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run
xAIgrok-4.3
default reasoning
API single-shot2026-07-03
grok-4.3 rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run
xAIgrok-build-0.1
default reasoning
API single-shot2026-06-25
grok-build-0.1 rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run
xAIgrok-composer-2.5-fast
default reasoning
Agent harness2026-06-25
grok-composer-2.5-fast rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run
DeepSeekdeepseek-v4-pro
default reasoning
API single-shot2026-06-25
deepseek-v4-pro rendering of the Keyboard-operable select-only combobox with a listbox popup benchmark - composite 0.0%
Open
Composite 0.0%Objective 0.0%
Open outputFull run

Product thinking,
design and engineering

An independent product lab, building in Australia.

hello@banja.au
HomeWorkWhat we doThe labStart a conversation
About the labProductsExperimentsJournalWebsites & brand? Norex
© 2026 Banja LabsBuilt together in Australia
PrivacyTermsLinkedIn ↗