Raycaster / evalsBack to AI Agents for ESG and Climate Risk Analysis

APEX-Agents · Management Consulting

World126_JD_04

0/4Fail

APEX-Agents task World126_JD_04 in AI Agents for ESG and Climate Risk Analysis. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for ESG and Climate Risk AnalysisManagement Consulting World 113.1Dual harnessGrader: rubric
Task IDtask_c5080c2d60fa457faeb309841b8b442a
WorldManagement Consulting World 113.1
Expected outputmessage_in_console
Published runs6 models · dual config

Task prompt

What the agent was asked to do

Please check how KO and MDLZ differ in expected upside once we apply the ESG and GLP-1 filters and account for each investor’s maximum allowable ESG risk level. Use the survey data and the ESG risk thresholds to determine which respondents are eligible to hold each company. Then calculate the confidence weighted average and standard deviation of expected annual return for KO and MDLZ. Show each company’s weighted average and standard deviation of expected annual returns. Round only the final results, going to two decimal places.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual0/4FailShare pagePublic trace
Gemini 3 Flashdual0/4FailShare pagePublic trace
Gemini 3.1 Produal0/4FailShare pagePublic trace
GPT-5.4dual0/4FailShare pagePublic trace
GPT-5.4 minidual1/4FailShare pagePublic trace
GPT-5.4 nanodual0/4FailShare pagePublic trace

Grading rubric

Criteria and grader verdict (showcase run)

  1. States that the Weighted Avg Expected Annual Return for KO is 6.31

    Fail

    Evidence: TEXT_RESPONSE table states for KO: “Weighted average expected annual return | 6.40%”. Assessment: Criterion requires stating KO weighted average expected annual return is 6.31; the response states 6.40%, so fail.

  2. States that the Weighted Avg Expected Annual Return for MDLZ is 6.71

    Fail

    Evidence: TEXT_RESPONSE table states for MDLZ: “Weighted average expected annual return | 6.44%”. Assessment: Criterion requires stating MDLZ weighted average expected annual return is 6.71; the response states 6.44%, so fail.

  3. States that the Weighted Stdev Expected Annual Return for KO is 2.59

    Fail

    Evidence: TEXT_RESPONSE table states for KO: “Weighted standard deviation | 2.78%”. Assessment: Criterion requires stating KO weighted stdev expected annual return is 2.59; the response states 2.78%, so fail.

  4. States that the Weighted Stdev Expected Annual Return for MDLZ is 2.77

    Fail

    Evidence: TEXT_RESPONSE table states for MDLZ: “Weighted standard deviation | 3.06%”. Assessment: Criterion requires stating MDLZ weighted stdev expected annual return is 2.77; the response states 3.06%, so fail.