APEX-Agents · Management Consulting
World 128_RG_02
APEX-Agents task World 128_RG_02 in AI Agents for Cross-Border Regulatory Review. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
Calculate the change in the chances of success for each of the frontier business units. Use the formula 0.25 × the sum of all operational constraints. The numerical values of the operational constraints are available in the attached file. Please provide your answer right here. Round all final answers to 2 decimal places, i.e., 0.01%
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 4/4 | Pass | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 4/4 | Pass | Share pagePublic trace |
| GPT-5.4 | dual | 4/4 | Pass | Share pagePublic trace |
| GPT-5.4 mini | dual | 4/4 | Pass | Share pagePublic trace |
| GPT-5.4 nano | dual | 4/4 | Pass | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States that the absolute change in the chances of success for AmensaDrive is 0.00%
PassEvidence: <TEXT_RESPONSE> table lists AmensaDrive with “Change in chances of success | 0.00%”. Assessment: Criterion asks whether it states the absolute change for AmensaDrive is 0.00%; pass because the response clearly states that value.
States that the absolute change in the chances of success for Skylink Atmos is 1.00%
PassEvidence: <TEXT_RESPONSE> table lists “SkyLink Atmos” with “Change in chances of success | 1.00%”. Assessment: Criterion asks whether it states the absolute change for Skylink Atmos is 1.00%; pass despite capitalization difference because the required unit and value are clearly conveyed.
States that the absolute change in the chances of success for AmensaMech is 0.75%
PassEvidence: <TEXT_RESPONSE> table lists AmensaMech with “Change in chances of success | 0.75%”. Assessment: Criterion asks whether it states the absolute change for AmensaMech is 0.75%; pass because the response clearly states that value.
States that the absolute change in the chances of success for SolisOne is 3.25%
PassEvidence: <TEXT_RESPONSE> table lists SolisOne with “Change in chances of success | 3.25%”. Assessment: Criterion asks whether it states the absolute change for SolisOne is 3.25%; pass because the response clearly states that value.