APEX-Agents · Management Consulting
World133_ln_04
APEX-Agents task World133_ln_04 in AI Agents for Divestiture and Spin-Off Analysis. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
Give me the scores for Summit’s segments, using the Summit-Specific Survey. Your scoring system must follow these rules: - For the average satisfaction with status benefits from the file “14. Summit_Tier_Status_Experience_Raw_vtest.xlsx”, grant 1 point if it is greater than 2, grant 1 point if it has had no status loss in the past 2 years. Also grant 2 points if more than 23% of respondents in the segment have a current tier equal to "none". - Deduct 1 point if the loyalty score from the file “9. Summit_Loyalty_Outcome_Summary_Raw_vtest.xlsx” is below 2 but add 2.5 points if it's above 2. Present the results in a new one-slide deck. Give all answers rounded to one decimal point.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 0/3 | Fail | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 2/3 | Fail | Share pagePublic trace |
| GPT-5.4 | dual | 2/3 | Fail | Share pagePublic trace |
| GPT-5.4 mini | dual | 3/3 | Pass | Share pagePublic trace |
| GPT-5.4 nano | dual | 3/3 | Pass | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States the Business segment score is 3.5
FailEvidence: <TEXT_RESPONSE> says “Business: 4.0.” Assessment: Criterion requires “States the Business segment score is 3.5”; the response states 4.0 instead, so fail.
States the Family segment score is 5.5
FailEvidence: <TEXT_RESPONSE> says “Family: 6.0.” Assessment: Criterion requires “States the Family segment score is 5.5”; the response states 6.0 instead, so fail.
States the Younger Leisure segment score is 5.5
FailEvidence: <TEXT_RESPONSE> says “Younger leisure: 6.0.” Assessment: Criterion requires “States the Younger Leisure segment score is 5.5”; the response states 6.0 instead, so fail.