Long service leave federal or state trap
One task across 30 published runs. Inspect the scores and outputs together, with each run's execution method shown.
- Task
- LAW-0005
- Domain
- Australian law
- Difficulty
- medium
Leading published run: claude-opus-4-8 (low reasoning) at 100.0% composite. Lowest: deepseek-v4-flash at 100.0%. 30 published runs shown on this task.
How this task was evaluated
Results are ordered by this task's published score. API runs use one prompt and one completion; agent runs use a coding harness with tools and iteration. Inspect the execution method when comparing results.
Objective scores use the benchmark's execution checks. Judge scores use a vision panel's fixed rubric; the published score leaves out a model's own family. Missing values are labelled rather than treated as zero.
Read the brief
This is a benchmarking hypothetical, not legal advice. The law is as at FY2025-26. An employee works in Victoria for a national-system employer covered by the Fair Work Act 2009 (Cth), and asks how their long service leave entitlement is worked out. Explain which law governs the employee's long service leave entitlement. Be specific about the jurisdiction. Do not give a single national long service leave figure that applies uniformly across Australia, because long service leave is not set that way. Name the level of government whose law applies here.