APEX-Agents · Management Consulting
Task_128_PJ_04
APEX-Agents task Task_128_PJ_04 in AI Agents for Cross-Border Regulatory Review. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
The client wants to do market sizing for an autonomous ride-hailing service in Europe. Estimate the market size (in $ Mn) based on the lifetime value (LTV) and adoption rate (%) of users. - Use information available in the user survey, as well as additional information received from the agency. - Assume the total population of Europe is 700 million and the survey is a representative sample set of the entire population. - Take full LTV for market size estimation. Assume adoption % is only a function of the user's likelihood of using an autonomous ride-hail service. Present your findings to me as a message. Round the final numbers to the nearest integer.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 1/1 | Pass | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 1/1 | Pass | Share pagePublic trace |
| GPT-5.4 | dual | 1/1 | Pass | Share pagePublic trace |
| GPT-5.4 mini | dual | 1/1 | Pass | Share pagePublic trace |
| GPT-5.4 nano | dual | 1/1 | Pass | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States the estimated market size for autonomous ride hailing service in Europe is $410337 Mn
PassEvidence: <TEXT_RESPONSE> states under Result: “**Estimated market size: $410,337 Mn**” and “Equivalent to approximately **$410 B**.” Assessment: The criterion requires that the response state the estimated market size for autonomous ride hailing service in Europe is $410337 Mn; this is clearly stated (comma formatting preserves the same value). Pass.