Raycaster / evalsTask overviewAPEX-AgentsCategory

APEX-Agents · GPT-5.4 mini · dual

LawWorld433_NAF_01

1/5Fail

GPT-5.4 mini on APEX-Agents: LawWorld433_NAF_01 (dual harness). Browse score, rubric, and public trace.

1/5 · Fail
Law
AI Agents for Healthcare and Senior Living Legal Risk
Law World 433

Grader rubric

Criteria verdict

  1. States that Heather Collins cannot legally allow her care staff to all take naps at the same time

  2. States any of the following as the relevant law: (1) the Texas Administrative Code at section TAC 553.253(c)(4)(A); and (2) that in a large, Type A assisted living facility, night shift staff must be "immediately available and awake"

  3. States that Heather Collins manages the night shift at the Grove-Austin facility

  4. States that the Grove-Austin facility is licensed as a Type A assisted living facility under the Texas Administrative Code

  5. States that the Grove-Austin facility qualifies as a large assisted living facility under the Texas Administrative Code

Prompt excerpt

Task context

Heather Collins has started to let her care staff all take naps at the same time. Legally, can she do this? Provide me with a brief explanation of your answer, citing the relevant sources. Reply back to me with your view in here.

Response trace

Agent response, tools, files, and edits

Open full trace

On mobile, open the full trace for the best view of the agent response, tool calls, file reads, edits, and grading context.

Open mobile trace