Raycaster / evalsTask overviewAPEX-AgentsCategory

APEX-Agents · GPT-5.4 nano · dual

LawWorld417_NE_06

2/6Fail

GPT-5.4 nano on APEX-Agents: LawWorld417_NE_06 (dual harness). Browse score, rubric, and public trace.

2/6 · Fail
Law
AI Agents for Employment Law Analysis
Law World 417

Grader rubric

Criteria verdict

  1. States that the language in Section IV presents issues regarding potential remedies

  2. States that the attempt to use a pre-existing contractual obligation to offset potential WARN Act penalties is problematic

  3. States that the WARN Act (29 U.S.C. § 2104(a)(2)) allows offsets only for voluntary and unconditional payments not required by a pre-existing legal obligation

  4. States that because the notice specifies severance "as outlined in your employment agreement," it is a pre-existing obligation

  5. States that an employer cannot unilaterally terminate health care continuation rights based solely on internal restructuring

  6. States that the health coverage statement which says health care continues "unless changes in plan eligibility occur earlier as a result of restructuring" could misrepresent employees' rights

Prompt excerpt

Task context

We will layoff our Head of Production Sarah Rodriguez as part of the upcoming merger. Please review Section IV of Sarah's layoff and WARN Notice and let me know if the language violates WARN. Answer to me right back here.

Response trace

Agent response, tools, files, and edits

Open full trace

On mobile, open the full trace for the best view of the agent response, tool calls, file reads, edits, and grading context.

Open mobile trace