Anzac Day 2026 substitute holiday trap
One task across 30 published runs. Inspect the scores and outputs together, with each run's execution method shown.
- Task
- AUSFA-0012
- Domain
- Australian accounting
- Difficulty
- hard
Leading published run: grok-composer-2.5-fast (default reasoning) at 100.0% composite. Lowest: deepseek-v4-flash at 0.0%. 30 published runs shown on this task.
How this task was evaluated
Results are ordered by this task's published score. API runs use one prompt and one completion; agent runs use a coding harness with tools and iteration. Inspect the execution method when comparing results.
Objective scores use the benchmark's execution checks. Judge scores use a vision panel's fixed rubric; the published score leaves out a model's own family. Missing values are labelled rather than treated as zero.
Read the brief
This is a benchmarking hypothetical, not legal advice. The facts are as at FY2025-26. Anzac Day in 2026 falls on a Saturday. A payroll officer asks whether there is an extra substitute public holiday on the following Monday for all employees across Australia. Answer correctly. Explain whether the additional Monday public holiday applies right across the country, or just in particular jurisdictions. Be specific about whether the additional Monday is a uniform entitlement everywhere, and about what an employee's answer turns on. Do not claim a single national substitute Monday that applies to everyone.