Long service leave jurisdiction trap
One task across 30 published runs. Inspect the scores and outputs together, with each run's execution method shown.
- Task
- AUSFA-0013
- Domain
- Australian accounting
- Difficulty
- hard
Leading published run: claude-opus-4-8 (high reasoning) at 100.0% composite. Lowest: deepseek-v4-flash at 33.3%. 30 published runs shown on this task.
How this task was evaluated
Results are ordered by this task's published score. API runs use one prompt and one completion; agent runs use a coding harness with tools and iteration. Inspect the execution method when comparing results.
Objective scores use the benchmark's execution checks. Judge scores use a vision panel's fixed rubric; the published score leaves out a model's own family. Missing values are labelled rather than treated as zero.
Read the brief
This is a benchmarking hypothetical, not legal advice. The law is as at FY2025-26. A national-system employer covered by the Fair Work Act 2009 (Cth) asks how an employee's long service leave entitlement is worked out, and whether one figure applies the same way everywhere in Australia. Answer correctly. Explain which level of law actually governs long service leave for most employees. Be specific that there is no uniform figure that applies the same way across the whole country, and that the answer turns on the employee's location. Do not give a single national long service leave entitlement that is the same everywhere.