5/9 runs · avg score 67%
Cross-benchmark category
US State Privacy Law
Compare AI agent runs for US State Privacy Law: prompts, scores, grades, and public traces. This page showcases APEX-Agents tasks that test whether AI agents can apply US state privacy laws, including breach notification requirements and state-specific privacy obligations.
US privacy complianceColorado Privacy Act, New York breach notification
13Tasks
1Primary
1Benchmarks
Published model evidence
A quick view of shareable runs in this category. Open task and trace pages for the prompt, response, files, and grading details.
4/13 runs · avg score 73%
3/13 runs · avg score 59%
2/13 runs · avg score 49%
2/13 runs · avg score 41%
2/13 runs · avg score 41%
Primary tasks
1 tasks with this category as their main focus.
- Determine Outcome of Shipyard Fire and DelayAPEX-Agents(task_8ec48c4dfa5e4f06b8bac76409c74d83)3/6 · Fail
Blue Anchor recently sued us (LNG Shipping Inc.) for claims of fraudulent inducement. We filed a motion to compel arbitration after Nakamura experienced a catastrophic fire at its shipyard. The motion…
Related tasks
12 tasks that also exercise this work as part of a broader assignment.
Northstar is evaluating a situation where Bluequill had utilized the EU personal data received by its analytics module from Northstar, and utilized it for the purposes of sending out marketing emails …
Northstar's CEO sent me an email asking for a summary of the company’s liability under US privacy law if the incident occurred to a US customer based in Colorado. Please take the lead on drafting a hi…
Northstar's US customer, Zellwerk, reported a system-wide outage that delayed access to shipment-tracking data containing health-related product identifiers and customer account IDs. During the outage…
During the first 48 minutes of the EU production outage, Northstar's engineering team exported one or two bundled sets of EU production event logs containing personal data to the U.S. analytics vendor…
Our client needs to know if any of that data that was transmitted in the breach is considered personal data under GDPR. Review the four attached incident reports and provide your reply to me with ex…
Evaluate whether the breach notification requirements to EU/EEA customers in Version 1 of the Breach and Incident Response Policy are compliant with the GDPR, by answering the following questions: 1) …
Review the Controller-to-Supervisory Authority Notification Template, along with the timing set out in the V.2 Breach & Incident Response Policy, to ensure compliance with the notification requirement…
Let's assess the applicability of the statement of "[t[hese data elements constitute personal data for GDPR purposes because they relate to identifiable users, even though no directly identifying attr…
It has come to our attention that some of the data transferred by the "Diagnostics Analytics Module" related to residents of Colorado. Does Colorado Law require us to notify Colorado residents of this…
Northstar is reviewing its policies for notifying American data subjects in case there is another unauthorized data transfer. Specifically, a lot of Northstar's data subjects reside in the State of Ne…
Will Northstar be required to compensate affected data subjects under the General Data Protection Regulation ("GDPR") for the Data Analytics Module's (the "Module") unauthorized data transfer if the d…
Determine if Northstar can be fined under Article 83 of the General Data Protection Regulation ("GDPR") for a violation of Article 14(2)(e) of the GDPR for the data transfer from the Data Analytics Mo…