APEX-Agents · Management Consulting
World112-1_Task05_SC
APEX-Agents task World112-1_Task05_SC in AI Agents for Comparable Company Analysis. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
Review industry reports to determine the range of industry-wide reductions in force (RIFs). Using Impact’s revised SG&A breakdown, calculate the cost savings Impact would achieve by reducing its sales force by comparable amounts, testing both the low and high ends of the range. Using 2024 figures, assess whether these reductions are sufficient to achieve a 20% total reduction in Sales & Marketing expense. If not, calculate the percentage reduction in the sales force required to reach the 20% Sales & Marketing cut. Round final answers to the nearest 0.01% or $0.01. Print out your findings to me here now.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 3/3 | Pass | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 1/3 | Fail | Share pagePublic trace |
| GPT-5.4 | dual | 3/3 | Pass | Share pagePublic trace |
| GPT-5.4 mini | dual | 3/3 | Pass | Share pagePublic trace |
| GPT-5.4 nano | dual | 3/3 | Pass | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States that if Impact were to cut sales force by 30%, it would save $216,339.30
PassEvidence: TEXT_RESPONSE table states for “30.00%” sales-force reduction, “Cost savings” = “$216,339.30.” Assessment: Criterion asks whether it states that cutting sales force by 30% would save $216,339.30; pass because the response states this exactly.
States that If Impact were to cut sales force by 50%, it would save $360,565.50
PassEvidence: TEXT_RESPONSE table states for “50.00%” sales-force reduction, “Cost savings” = “$360,565.50.” Assessment: Criterion asks whether it states that cutting sales force by 50% would save $360,565.50; pass because the response states this exactly.
States that the % reduction in sales force needed to reach 20% in Sales & Marketing cuts is 57.60%
PassEvidence: TEXT_RESPONSE conclusion says, “Impact would need to reduce its sales force by **57.60%**.” Assessment: Criterion asks whether it states the percentage reduction needed to reach 20% in Sales & Marketing cuts is 57.60%; pass because the response states this exactly.