Raycaster / evalsBack to AI Agents for Legal Contract Review

APEX-Agents · Management Consulting

World126_EFA_05

0/2Fail

APEX-Agents task World126_EFA_05 in AI Agents for Legal Contract Review. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Legal Contract ReviewManagement Consulting World 113.1Dual harnessGrader: rubric
task_7cec4caf8ace406da19eeb72688f43f6
Management Consulting World 113.1
message_in_console
5 models · dual config

Task prompt

What the agent was asked to do

Can you calculate the minimum gross returns Crown and Vision would have to achieve in order to deliver net returns equal to the average fund manager in the 80th percentile or better in terms of Sharpe ratio? Report numeric final answers to two decimal points. Write your answers out here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual0/2Fail
Gemini 3.1 Produal0/2Fail
GPT-5.4dual0/2Fail
GPT-5.4 minidual0/2Fail
GPT-5.4 nanodual0/2Fail

Grading rubric

Criteria and grader verdict (showcase run)

  1. States that the gross return Crown would need to achieve is 10.24%

    Fail

    Evidence: <TEXT_RESPONSE> states “Crown: 10.31%”. Assessment: Criterion requires stating Crown gross return is 10.24%; the response gives 10.31%, so this does not match.

  2. States that the gross return Vision would need to achieve is 8.85%

    Fail

    Evidence: <TEXT_RESPONSE> states “Vision: 10.57%”. Assessment: Criterion requires stating Vision gross return is 8.85%; the response gives 10.57%, so this does not match.