APEX-Agents · Management Consulting

Word_129_PJ_01

1/1Pass

APEX-Agents task Word_129_PJ_01 in AI Agents for SaaS Due Diligence. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for SaaS Due DiligenceManagement Consulting World 129Dual harnessGrader: rubric

Task IDtask_0233800d9daf4459bc464ce2f1f822a8

WorldManagement Consulting World 129

Expected outputmessage_in_console

Published runs5 models · dual config

Task prompt

What the agent was asked to do

I want to forecast total annual revenue for ServiceNow based on the competition's price benchmarking information available to us. For this analysis, calculate revenue for each of their tier/plan (like ITIL User (Base), ITOM Module etc.) based on the attached information. Optimal price multiplier refers to the percentage points above the minimum price point where the tier/plan will be priced. Report total forecast revenue in $m, rounded to one decimal place. Print your response here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

Model	Harness	Score	Result	Links
GPT-5.5showcase	dual	1/1	Pass	Share page Public trace
Gemini 3.1 Pro	dual	1/1	Pass	Share page Public trace
GPT-5.4	dual	1/1	Pass	Share page Public trace
GPT-5.4 mini	dual	1/1	Pass	Share page Public trace
GPT-5.4 nano	dual	1/1	Pass	Share page Public trace

Grading rubric

Criteria and grader verdict (showcase run)

States the total forecast annual revenue for ServiceNow is $1,438.2 million
Pass
Evidence: TEXT_RESPONSE states “**Total forecast annual revenue: $1,438.2m**”. Assessment: The criterion requires stating the total forecast annual revenue for ServiceNow is $1,438.2 million; pass because the response gives exactly $1,438.2m.