Easter Saturday 2026 public holiday trap
One task across 30 published runs. Inspect the scores and outputs together, with each run's execution method shown.
- Task
- AUSFA-0014
- Domain
- Australian accounting
- Difficulty
- hard
Leading published run: grok-composer-2.5-fast (default reasoning) at 100.0% composite. Lowest: grok-build-0.1 at 0.0%. 30 published runs shown on this task.
How this task was evaluated
Results are ordered by this task's published score. API runs use one prompt and one completion; agent runs use a coding harness with tools and iteration. Inspect the execution method when comparing results.
Objective scores use the benchmark's execution checks. Judge scores use a vision panel's fixed rubric; the published score leaves out a model's own family. Missing values are labelled rather than treated as zero.
Read the brief
This is a benchmarking hypothetical, not legal advice. The facts are as at FY2025-26. A payroll officer asks whether Easter Saturday in 2026, the Saturday between Good Friday and Easter Sunday, is a public holiday for all employees across Australia. Answer correctly. Explain whether Easter Saturday is a public holiday uniformly across the country, or whether its status changes between jurisdictions. Be specific about whether the answer is uniform nationally, and about what an employee's answer turns on. Do not assert a single national answer that applies to everyone.