Raycaster / evalsBack to AI Agents for Maritime and Environmental Liability

APEX-Agents · Investment Banking

world219_tg_05

0/1Fail

APEX-Agents task world219_tg_05 in AI Agents for Maritime and Environmental Liability. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Maritime and Environmental LiabilityInvestment Banking World 219Dual harnessGrader: rubric
task_6ed4c4d326c04e3c9ef66be237b8dcbe
Investment Banking World 219
message_in_console
4 models · dual config

Task prompt

What the agent was asked to do

Can we see what the DCF per share value is if the terminal value is based on EV / AUM of the peer set? Let's exclude AMG and JHG for purposes of this exercise. Assume that AUM grows linearly with management fees, round to the nearest cent. Print your answer back here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual0/1Fail
Gemini 3.1 Produal0/1Fail
GPT-5.4 minidual0/1Fail
GPT-5.4 nanodual0/1Fail

Grading rubric

Criteria and grader verdict (showcase run)

  1. States that DCF per share value is $30.70

    Fail

    Evidence: <TEXT_RESPONSE> says “the DCF per share value is **$36.29**.” Assessment: The criterion requires stating that the DCF per share value is $30.70; the response gives a different value, so it fails.