APEX-Agents · Investment Banking

World246_RL_09

0/1Fail

APEX-Agents task World246_RL_09 in AI Agents for Tax Due Diligence. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Tax Due DiligenceInvestment Banking World 246Dual harnessGrader: rubric

Task IDtask_fc51bd4130bf475faa36a5d45a96adb3

WorldInvestment Banking World 246

Expected outputmessage_in_console

Published runs4 models · dual config

Task prompt

What the agent was asked to do

Replace the risk-free rate in the DCF model with the average of the 10 year and 20 year treasury rates as of 12/22/2025, and assume that the cost of debt is this average value plus 150 basis points. Finally, assume that the tax rate is revised up by 50 basis points for the projection period. What is the absolute difference in terminal value in the original calculation and this updated one? Output your result as a reply here, with millions rounded to two decimal places.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

Model	Harness	Score	Result	Links
GPT-5.5showcase	dual	0/1	Fail	Share page Public trace
Gemini 3.1 Pro	dual	1/1	Pass	Share page Public trace
GPT-5.4 mini	dual	1/1	Pass	Share page Public trace
GPT-5.4 nano	dual	1/1	Pass	Share page Public trace

Grading rubric

Criteria and grader verdict (showcase run)

States the absolute change in terminal value is $4,368.61 million
Fail
Evidence: <TEXT_RESPONSE> states "$4,447.19 million". Assessment: Criterion requires stating the absolute change in terminal value is "$4,368.61 million"; the provided value does not match, so this fails.