Labour Day 2026 jurisdiction trap
One task across 30 published runs. Inspect the scores and outputs together, with each run's execution method shown.
- Task
- AUSFA-0011
- Domain
- Australian accounting
- Difficulty
- hard
Leading published run: kimi-k2.7-code (default reasoning) at 100.0% composite. Lowest: grok-4.5 at 0.0%. 30 published runs shown on this task.
How this task was evaluated
Results are ordered by this task's published score. API runs use one prompt and one completion; agent runs use a coding harness with tools and iteration. Inspect the execution method when comparing results.
Objective scores use the benchmark's execution checks. Judge scores use a vision panel's fixed rubric; the published score leaves out a model's own family. Missing values are labelled rather than treated as zero.
Read the brief
This is a benchmarking hypothetical, not legal advice. The facts are as at FY2025-26. A payroll officer asks: on what single date does the Labour Day public holiday fall in Australia in 2026? Answer correctly. Explain whether one national date exists. Be specific that the answer depends on where the employee works, and that the day is set differently in different parts of the country, so a single confident national date would be wrong. Do not commit to one date that applies everywhere in Australia.