APEX-Agents · Management Consulting
Task 7
APEX-Agents task Task 7 in AI Agents for M&A Legal Due Diligence. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
I would like to analyze the current proportion of Brightpath Churn and Annual Recurring Revenue. 1. Based on the ARR from the discount approval file and the Churned ARR from customer segmentation file, calculate the required reduction in $ in Churned ARR for every Pricing Tier whose current Churned ARR proportion exceeds 0.5% of its Overall ARR, so that the proportion for that tier is reduced to exactly 0.5%. 2. Calculate the number of additional deals (each valued at the average ARR per deal from discount approval report) required to meet a target of 0.5% Churned ARR as a percentage of total ARR. Print your response here. Round final dollar amounts to the nearest whole dollar. Round the number of deals up to the nearest whole number.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 4/4 | Pass | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 4/4 | Pass | Share pagePublic trace |
| GPT-5.4 | dual | 4/4 | Pass | Share pagePublic trace |
| GPT-5.4 mini | dual | 4/4 | Pass | Share pagePublic trace |
| GPT-5.4 nano | dual | 4/4 | Pass | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States the reduction in Churned ARR required for the Business pricing tier to achieve 0.5% Churned ARR as a % of Total ARR is $35,833
PassEvidence: In the response table, Business row shows “Required Reduction” = “$35,833.” Assessment: Criterion asks whether it states the Business reduction is $35,833; pass because the value is stated exactly.
States the reduction in Churned ARR required for the Enterprise pricing tier to achieve 0.5% Churned ARR as a % of Total ARR is $46,204
PassEvidence: In the response table, Enterprise row shows “Required Reduction” = “$46,204.” Assessment: Criterion asks whether it states the Enterprise reduction is $46,204; pass because the value is stated exactly.
States the reduction in Churned ARR required for the Team pricing tier to achieve 0.5% Churned ARR as a % of Total ARR is $42,986
PassEvidence: In the response table, Team row shows “Required Reduction” = “$42,986.” Assessment: Criterion asks whether it states the Team reduction is $42,986; pass because the value is stated exactly.
States the number of deals that Brightpath requires to achieve 0.5% percentage of Churned ARR is 155
PassEvidence: The response concludes: “Additional deals required: 155 deals.” Assessment: Criterion asks whether it states the number of deals required is 155; pass because the response states exactly 155 deals.