Raycaster / evalsBack to AI Agents for SEC Disclosure Analysis

APEX-Agents · Investment Banking

World221_TR_08

0/6Fail

APEX-Agents task World221_TR_08 in AI Agents for SEC Disclosure Analysis. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for SEC Disclosure AnalysisInvestment Banking World 221Dual harnessGrader: rubric
task_f18f9e5701bf47a6a835d7d7bd6c7024
Investment Banking World 221
message_in_console
4 models · dual config

Task prompt

What the agent was asked to do

Use "Comp Analysis – Modify" as a clean version of Comp Analysis. Replace peers WhiteHorse Finance (WHF) and TriplePoint Venture Growth BDC corps. (TPVG) and replace with SLR Investment Corp. (SLRC), Gladstone Capital (GLAD) and Stellus Capital Investment Corp (SCM). Use the attached SEC filings to complete the task. Retrieve the AUM, NAV / Share and Debt / Equity as of September 30, 2025, to complete the analysis. Calculate the mean and median for each key metrics considering BDCs with a Market Cap in the $350M to $900M range only. Get your answer back to me right here. Present the AUM in $M. All the final numbers must be rounded to 2 decimal places.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual0/6Fail
Gemini 3.1 Produal2/6Fail
GPT-5.4 minidual4/6Fail
GPT-5.4 nanodual3/6Fail

Grading rubric

Criteria and grader verdict (showcase run)

  1. States the Mean AUM is $2,635.91 million

    Fail

    Evidence: TEXT_RESPONSE says, “I’m sorry, but I can’t complete the requested analysis…” and provides no metric values. Assessment: Criterion requires stating Mean AUM is $2,635.91 million; fail because the response does not state this number.

  2. States the Mean NAV / Share is $17.27

    Fail

    Evidence: TEXT_RESPONSE says it “can’t complete the requested analysis” and includes no NAV / Share figures. Assessment: Criterion requires stating Mean NAV / Share is $17.27; fail because the response does not state this value.

  3. States the Mean Debt / Equity is 1.22x

    Fail

    Evidence: TEXT_RESPONSE provides only an inability statement and no Debt / Equity metrics. Assessment: Criterion requires stating Mean Debt / Equity is 1.22x; fail because the response does not state this value.

  4. States the Median AUM is $2,400.00 million

    Fail

    Evidence: TEXT_RESPONSE says, “I can’t complete the requested analysis…” and does not include AUM mean/median output. Assessment: Criterion requires stating Median AUM is $2,400.00 million; fail because the response does not state this number.

  5. States the Median NAV / Share is $17.40

    Fail

    Evidence: TEXT_RESPONSE contains no final numbers and no NAV / Share metric. Assessment: Criterion requires stating Median NAV / Share is $17.40; fail because the response does not state this value.

  6. States the Median Debt / Equity is 1.28x

    Fail

    Evidence: TEXT_RESPONSE only states lack of access and provides no Debt / Equity median. Assessment: Criterion requires stating Median Debt / Equity is 1.28x; fail because the response does not state this value.