APEX-Agents · Law
World431_AVK_02
APEX-Agents task World431_AVK_02 in AI Agents for Real Estate Lease Review. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
In addition to the 15,000 sq ft rented to AI Automation Group, LLC (“AIAG”), MGR Real Estate, Inc. ("MGR") rents a total of 157,235 sq ft. of space to the other tenants in the building. Using the FINAL version of the Lease Agreement between AIAG and MGR, calculate the total amount of AIAG's Additional Rent given the following Operating Expenses: - Janitorial services: $70,000 - Trash and recycling: $12,500 - Common Area supplies: $17,500 - Property taxes: $260,000 - Property insurance: $40,000 - Base management fee: amount set forth in the Lease Note the scrivener's error for AIAG's total square footage (corrected to 15,000 sq ft) and proportionate share (corrected to .073) were caught and corrected in the final, executed copy. Provide the final number (rounded to the nearest whole number) as a reply to me here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 1/1 | Pass | Share pagePublic trace |
| fireworks models Kimi K2 | dual | 1/1 | Pass | Share pagePublic trace |
| Gemini 3 Flash | dual | 1/1 | Pass | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 1/1 | Pass | Share pagePublic trace |
| GPT-5.4 | dual | 1/1 | Pass | Share pagePublic trace |
| GPT-5.4 mini | dual | 1/1 | Pass | Share pagePublic trace |
| GPT-5.4 nano | dual | 1/1 | Pass | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States AIAG's Additional Rent amount is $34,042 (+/- $50)
PassEvidence: <TEXT_RESPONSE> states “$34,055.” Assessment: Criterion requires stating AIAG's Additional Rent amount is $34,042 (+/- $50). $34,055 differs by $13, which is within the allowed tolerance; pass.