Raycaster / evalsBack to AI Agents for Employment Law Analysis

APEX-Agents · Law

World417_TS_04

0/3Fail

APEX-Agents task World417_TS_04 in AI Agents for Employment Law Analysis. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Employment Law AnalysisLaw World 417Dual harnessGrader: rubric
task_6caf6e9032174bac8f69edf07deb06f0
Law World 417
message_in_console
7 models · dual config

Task prompt

What the agent was asked to do

As part of the completed merger, ChasingStreams transferred to ParaZon thirty employees, who would continue the same work under ParaZon’s rate of pay and benefits, most of which were substantially similar to ChasingStreams. After Jaydon Cole was laid off by ParaZon, he filed a class action lawsuit, violation of the California WARN Act by failing to provide him and twenty other similarly situated employees 60 days’ notice of a “layoff.” ParaZon is considering a motion to dismiss on the grounds that the statue does not apply. Is ParaZon likely to succeed in its Motion to Dismiss? Reply to me here with your view, telling me: Yes/No, and then giving me a 1-2 sentence explanation.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual0/3Fail
fireworks models Kimi K2dual0/3Fail
Gemini 3 Flashdual0/3Fail
Gemini 3.1 Produal0/3Fail
GPT-5.4dual0/3Fail
GPT-5.4 minidual0/3Fail
GPT-5.4 nanodual2/3Fail

Grading rubric

Criteria and grader verdict (showcase run)

  1. States No, ParaZon is unlikely to succeed in its Motion to Dismiss

    Fail

    Evidence: TEXT_RESPONSE begins “Yes. California WARN generally requires…” Assessment: Criterion requires “States No, ParaZon is unlikely to succeed in its Motion to Dismiss”; fail because the response states the opposite conclusion (Yes, likely to succeed).

  2. States that a "mass layoff" may have occurred, triggering the California WARN Act

    Fail

    Evidence: TEXT_RESPONSE says the facts identify “21 employees total” and “The merger transfer itself also is unlikely to count as a layoff.” Assessment: Criterion requires stating that a “mass layoff” may have occurred, triggering California WARN; fail because the response says the threshold was not met and the Act likely does not apply.

  3. States that the combination of the number of laid off employees and the number of transferred employees meets the threshold for a "mass layoff"

    Fail

    Evidence: TEXT_RESPONSE says “only Jaydon Cole plus twenty others — 21 employees total — out of 30 transferred employees” and that the transfer is “unlikely to count as a layoff.” Assessment: Criterion requires stating the combination of laid off and transferred employees meets the mass-layoff threshold; fail because the response does not combine them to meet the threshold and instead denies the transfer counts.