Raycaster / evalsBack to AI Agents for Tax Due Diligence

APEX-Agents · Investment Banking

Task 9l78fe75

0/1Fail

APEX-Agents task Task 9l78fe75 in AI Agents for Tax Due Diligence. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Tax Due DiligenceInvestment Banking World 225Dual harnessGrader: rubric
task_8f3b740a5b62455fbbf2f8e79aaabc60
Investment Banking World 225
message_in_console
4 models · dual config

Task prompt

What the agent was asked to do

Using the REIT model re-calculate the Implied REIT Price Per Share using the the 25th Percentile EV/EBITDA and 2025E Revenue Growth percentage of 5%. Return to me right here the price in $ for the same case used in the Executive Summary tab. Round to 2 decimal points.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual0/1Fail
Gemini 3.1 Produal0/1Fail
GPT-5.4 minidual0/1Fail
GPT-5.4 nanodual1/1Pass

Grading rubric

Criteria and grader verdict (showcase run)

  1. States that Implied REIT Price Per Share is $104.71

    Fail

    Evidence: <TEXT_RESPONSE> states “$118.19”. Assessment: The criterion requires the response to state that the Implied REIT Price Per Share is “$104.71”; it instead gives $118.19, so it fails.