Raycaster / evalsBack to AI Agents for Take-Private Analysis

APEX-Agents · Investment Banking

World224-HS-11

0/3Fail

APEX-Agents task World224-HS-11 in AI Agents for Take-Private Analysis. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Take-Private AnalysisInvestment Banking World 224Dual harnessGrader: rubric
task_2299b89dcaf64a4da4f3d03f8aac7215
Investment Banking World 224
edit_existing_sheet
4 models · dual config

Task prompt

What the agent was asked to do

Assess if the sponsor can still meet the 20% IRR target at the Year 5 exit, given higher cost of revenues. 1. Increase subscription cost as % of subscription revenues by 1 percentage point in Year 1, then keep it constant in the remaining projection years. 2. Increase services cost as % of services revenues by 1 percentage point in Year 1, then keep it constant in the remaining projection years. Add a new worksheet to the Elastic NV LBO model. It must show Net Debt at Exit, Sponsor Equity Value at Exit, IRR %. All monetary results to be displayed in USD millions, rounded to two decimal places, and all percentages must be rounded to two decimal points.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual0/3Fail
Gemini 3.1 Produal0/3Fail
GPT-5.4 minidual0/3Fail
GPT-5.4 nanodual0/3Fail

Grading rubric

Criteria and grader verdict (showcase run)

  1. States Net Debt at Exit is $717.44M

    Fail

    Evidence: <TEXT_RESPONSE> states “Net Debt at Exit | $709.94 million.” Assessment: Criterion requires it states Net Debt at Exit is $717.44M; the response states a different amount, so fail.

  2. States Sponsor Equity Value at Exit is $26,068.66M

    Fail

    Evidence: <TEXT_RESPONSE> states “Sponsor Equity Value at Exit | $29,902.74 million.” Assessment: Criterion requires it states Sponsor Equity Value at Exit is $26,068.66M; the response states a different amount, so fail.

  3. States IRR % is 18.25%

    Fail

    Evidence: <TEXT_RESPONSE> states “IRR | 21.54%.” Assessment: Criterion requires it states IRR % is 18.25%; the response states a different percentage, so fail.