APEX-Agents · Management Consulting
Shiva Task 01 World 129
APEX-Agents task Shiva Task 01 World 129 in AI Agents for Divestiture and Spin-Off Analysis. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
Using the estimated market share chart and Brightpath customer segmentation, please calculate the potential revenue for the SMB Accounting segment if it achieved the target share. Include an analysis stating the percentage point difference (rounded down) between Target and Actual Enterprise share for Consulting Firms and the revenue gap (to the nearest dollar) for Mid-Market IT Services. Return your findings in a short message here
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 2/3 | Fail | Share pagePublic trace |
| Gemini 3 Flash | dual | 1/3 | Fail | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 3/3 | Pass | Share pagePublic trace |
| GPT-5.4 | dual | 0/3 | Fail | Share pagePublic trace |
| GPT-5.4 mini | dual | 2/3 | Fail | Share pagePublic trace |
| GPT-5.4 nano | dual | 3/3 | Pass | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States the potential revenue for the SMB segment in the Accounting industry if it achieved the Target share is $670,508
PassEvidence: TEXT_RESPONSE says “SMB Accounting potential revenue at the 50% target share: $670,508.” Assessment: The criterion requires stating the SMB Accounting potential revenue at Target share is $670,508; pass because the response states exactly that value.
States the percentage points difference between the Target Enterprise share for Consulting Firms and the Actual Enterprise share is 4.
FailEvidence: TEXT_RESPONSE says “Consulting Firms Enterprise share gap: target 40% vs. actual 32.7%, so the rounded-down difference is 7 percentage points.” Assessment: The criterion requires the percentage point difference to be 4; fail because the response states 7 percentage points, not 4.
States the revenue gap if the company achieved targeted market share from share vs. actual data for Mid-Market in IT Services is $14,331
PassEvidence: TEXT_RESPONSE says “Mid-Market IT Services revenue gap: target ARR $539,489 vs. actual ARR $525,158, for a gap of $14,331.” Assessment: The criterion requires stating the Mid-Market IT Services revenue gap is $14,331; pass because the response states exactly that value.