APEX-Agents · Law
World417_TS_03
APEX-Agents task World417_TS_03 in AI Agents for Employment Law Analysis. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
Our client, Chasing Streams, LLC, needs to know whether or not it might be liable to either or both employees who filed suit against it for violation of the California and/or Federal WARN Act. Please juxtapose the provisions of the Act to the company files. Write your reply back to me so I can decide next steps.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 1/7 | Fail | Share pagePublic trace |
| fireworks models Kimi K2 | dual | 0/7 | Fail | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 3/7 | Fail | Share pagePublic trace |
| GPT-5.4 | dual | 0/7 | Fail | Share pagePublic trace |
| GPT-5.4 mini | dual | 0/7 | Fail | Share pagePublic trace |
| GPT-5.4 nano | dual | 1/7 | Fail | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States that the Federal WARN Act requires companies to provide employees of six months or more, who will be affected by a mass layoff, a notice that is dated at least 60 days prior to the termination date
FailEvidence: The response says Federal WARN requires notice to affected employees and others, quoting that an employer may not order a mass layoff until after “a 60-day period” following written notice. It also discusses federal thresholds excluding part-time employees. Assessment: The criterion requires stating notice to employees “of six months or more” affected by a mass layoff, dated at least 60 days before termination. The response covers affected employees and 60 days, but does not state the six-month-employment requirement. Fail.
States that the California WARN Act requires companies to provide employees of six months or more, who will be affected by a mass layoff, a notice that is dated at least 60 days prior to the termination date
FailEvidence: The response says California WARN “requires notice 60 days before a mass layoff” and quotes that an employer may not order a mass layoff unless “60 days before the order takes effect” it gives written notice. Assessment: The criterion requires stating California WARN notice is required for employees “of six months or more” affected by a mass layoff. The response does not mention the six-month-employment component. Fail.
States that William Ito's notice complied with the requirements of both Acts
PassEvidence: The response states: “Ito’s file supports a full 60-day notice period,” and under application: “Ito’s notice is dated ‘October 5, 2024’ for a December 4, 2024 separation. October 5 to December 4 is 60 days. If Chasing Streams can prove service on October 5, Ito’s WARN timing claim is weak.” Assessment: The criterion asks whether the response states Ito’s notice complied with both Acts. The response clearly conveys that Ito’s notice meets the 60-day timing requirement, albeit with a proof-of-service caveat, and discusses both federal and California 60-day requirements. Pass.
States that Streams cannot be held liable for William Ito's termination under the Federal WARN Act
FailEvidence: The response says “Ito as defensible if we can produce proof that his October 5 notice was actually served” and “If Chasing Streams can prove service on October 5, Ito’s WARN timing claim is weak.” Assessment: The criterion requires stating Streams cannot be held liable for Ito’s termination under Federal WARN. The response does not make that categorical conclusion; it qualifies non-liability on proof of service and only says the claim is weak/defensible. Fail.
States that Streams cannot be held liable for William Ito's termination under the California WARN Act
FailEvidence: The response says “Ito’s file supports a full 60-day notice period” and recommends treating “Ito as defensible if we can produce proof that his October 5 notice was actually served.” Assessment: The criterion requires stating Streams cannot be held liable for Ito’s termination under California WARN. The response does not expressly state no California liability; it gives a conditional defense based on proof of service. Fail.
States that Streams cannot be held liable for Yvonne Sanchez' termination under the Federal WARN Act
FailEvidence: The response says “The stronger liability exposure appears to be to Sanchez,” “Sanchez has a facial five-day WARN shortfall,” and “I would treat Sanchez as a real but potentially modest individual WARN exposure unless we can prove she also received the October 5 notice.” Assessment: The criterion requires stating Streams cannot be held liable for Sanchez’s termination under Federal WARN. The response states the opposite/qualified exposure. Fail.
States that Streams cannot be held liable for Yvonne Sanchez' termination under the California WARN Act
FailEvidence: The response says Sanchez’s notice was only 55 days before separation and “Sanchez has a facial five-day WARN shortfall,” with “real but potentially modest individual WARN exposure unless” timely notice can be proved. Assessment: The criterion requires stating Streams cannot be held liable for Sanchez’s termination under California WARN. The response does not state no liability and instead identifies likely exposure. Fail.