APEX-Agents · Management Consulting
World127_AK_Task03
APEX-Agents task World127_AK_Task03 in AI Agents for Commercial Contract Risk. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
Based on the client’s SKU data, calculate the weighted average gross margin for each platform. Then determine the percentage price increase required for SKUs on the lowest-margin platform to raise their margin to match the weighted average gross margin of all other platforms combined. Reply to me with the analysis.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 9/10 | Fail | Share pagePublic trace |
| Gemini 3 Flash | dual | 10/10 | Pass | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 10/10 | Pass | Share pagePublic trace |
| GPT-5.4 | dual | 0/10 | Fail | Share pagePublic trace |
| GPT-5.4 mini | dual | 10/10 | Pass | Share pagePublic trace |
| GPT-5.4 nano | dual | 10/10 | Pass | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States weighted average gross margin for BYD e-Platform 3.0 is 31.8%
PassEvidence: TEXT_RESPONSE table lists “BYD e-Platform 3.0 ... 31.76%.” Assessment: Criterion requires stating BYD e-Platform 3.0 weighted average gross margin is 31.8%; 31.76% rounds to 31.8%, so pass.
States weighted average gross margin for Ford C2 is 31.1%
PassEvidence: TEXT_RESPONSE table lists “Ford C2 ... 31.07%.” Assessment: Criterion requires stating Ford C2 weighted average gross margin is 31.1%; 31.07% rounds to 31.1%, so pass.
States weighted average gross margin for GM Ultium is 30.8%
PassEvidence: TEXT_RESPONSE table lists “GM Ultium ... 30.81%” and says “GM Ultium, at 30.81%.” Assessment: Criterion requires stating GM Ultium weighted average gross margin is 30.8%; 30.81% rounds to 30.8%, so pass.
States weighted average gross margin for Hyundai E-GMP is 32.5%
PassEvidence: TEXT_RESPONSE table lists “Hyundai E-GMP ... 32.52%.” Assessment: Criterion requires stating Hyundai E-GMP weighted average gross margin is 32.5%; 32.52% rounds to 32.5%, so pass.
States weighted average gross margin for MLB Evo is 31.8%
FailEvidence: TEXT_RESPONSE table lists “MLB Evo ... 31.85%.” Assessment: Criterion requires stating MLB Evo weighted average gross margin is 31.8%; 31.85% would round to 31.9% at one decimal, not 31.8%, so fail.
States weighted average gross margin for MQB is 32.0%
PassEvidence: TEXT_RESPONSE table lists “MQB ... 32.03%.” Assessment: Criterion requires stating MQB weighted average gross margin is 32.0%; 32.03% rounds to 32.0%, so pass.
States weighted average gross margin for Stellantis STLA Medium is 31.8%
PassEvidence: TEXT_RESPONSE table lists “Stellantis STLA Medium ... 31.77%.” Assessment: Criterion requires stating Stellantis STLA Medium weighted average gross margin is 31.8%; 31.77% rounds to 31.8%, so pass.
States weighted average gross margin for TNGA is 31.6%
PassEvidence: TEXT_RESPONSE table lists “TNGA ... 31.60%.” Assessment: Criterion requires stating TNGA weighted average gross margin is 31.6%; the response states exactly 31.60%, so pass.
States weighted average gross margin for Volvo SPA2 is 32.3%
PassEvidence: TEXT_RESPONSE table lists “Volvo SPA2 ... 32.33%.” Assessment: Criterion requires stating Volvo SPA2 weighted average gross margin is 32.3%; 32.33% rounds to 32.3%, so pass.
States the percentage price increase on the GM Ultium platform required to match the weighted average gross margin of all other platforms is 1.6%
PassEvidence: TEXT_RESPONSE says “Required price increase = 1.57%” for GM Ultium. Assessment: Criterion requires stating the required GM Ultium price increase is 1.6%; 1.57% rounds to 1.6%, so pass.