APEX-Agents · Law

World421_KA_01

3/4Fail

APEX-Agents task World421_KA_01 in AI Agents for Cross-Border Regulatory Review. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Cross-Border Regulatory ReviewLaw World 421Dual harnessGrader: rubric

Task IDtask_8dc8e0ec2a204b1ba18f068967cee6dc

WorldLaw World 421

Expected outputmessage_in_console

Published runs7 models · dual config

Task prompt

What the agent was asked to do

Would you please review the 50-State Survey of Telemarketing Laws document and identify whether or not there are any states missing from the list in the document? Then, send me the list the of missing states that have enhanced senior protections. Write out your reply in here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

Model	Harness	Score	Result	Links
GPT-5.5showcase	dual	3/4	Fail	Share page Public trace
fireworks models Kimi K2	dual	1/4	Fail	Share page Public trace
Gemini 3 Flash	dual	3/4	Fail	Share page Public trace
Gemini 3.1 Pro	dual	2/4	Fail	Share page Public trace
GPT-5.4	dual	0/4	Fail	Share page Public trace
GPT-5.4 mini	dual	3/4	Fail	Share page Public trace
GPT-5.4 nano	dual	2/4	Fail	Share page Public trace

Grading rubric

Criteria and grader verdict (showcase run)

States Yes, there are states missing from the 50-State Survey of Telemarketing Laws document that have enhanced senior protection laws
Pass
Evidence: TEXT_RESPONSE says, “the ‘States with Enhanced Senior Protections’ table is underinclusive” and “the table lists only 8 states,” followed by “The missing states I would add…” Assessment: The criterion asks whether the response states yes, there are states missing that have enhanced senior protection laws. Pass, because the response clearly identifies missing enhanced-senior-protection states despite noting the overall 50-state rollout list is complete.
States that a state with enhanced senior protection laws that is missing from the 50-State Survey of Telemarketing Laws document is Wyoming
Fail
Evidence: The response’s final list is “New York, Arizona, and Indiana.” Wyoming is not mentioned anywhere. Assessment: The criterion asks whether the response states Wyoming is a missing state with enhanced senior protection laws. Fail, because Wyoming is omitted.
States that a state with enhanced senior protection laws that is missing from the 50-State Survey of Telemarketing Laws document is New York
Pass
Evidence: The response lists “1. New York” and concludes, “my list of missing enhanced-senior-protection states is: New York, Arizona, and Indiana.” Assessment: The criterion asks whether the response states New York is a missing state with enhanced senior protection laws. Pass.
States that a state with enhanced senior protection laws that is missing from the 50-State Survey of Telemarketing Laws document is Indiana
Pass
Evidence: The response lists “3. Indiana” and concludes, “my list of missing enhanced-senior-protection states is: New York, Arizona, and Indiana.” Assessment: The criterion asks whether the response states Indiana is a missing state with enhanced senior protection laws. Pass.