OfficeQA

UID0220

0/1Fail

OfficeQA task UID0220. Inspect the exact document question, compare published model runs, open the agent response trace, and review grades for Treasury PDF Q&A.

Document Q&ADual harness

Task IDofficeqa-uid0220

BenchmarkOfficeQA

Published runs1 model

HarnessDual (parsed + original)

PromptExact document question asked of the agent

ResponseOpen each trace to inspect retrieval and reasoning

GradeCompare score and pass/fail by model

Task prompt

What the agent was asked to do

What is the absolute percent difference between the total federal expenditures reported in February 1938 and January 1939, rounded to the nearest tenths place in millions of dollars?

Published trajectories

Agent runs on this task

Curated dual-harness runs. Best scored run per model.

Model	Harness	Score	Result	Links
GPT-5.4showcase	dual	0/1	Fail	Share page Public trace