Raycaster / evalsAll benchmarks

Cross-benchmark category

SEC Disclosure Analysis

Compare AI agent runs for SEC Disclosure Analysis: prompts, scores, grades, and public traces. This page showcases APEX-Agents tasks that test whether AI agents can review SEC disclosures, analyze Form 8-K language, assess forward-looking statements, and identify public-company disclosure risks.

Securities compliance AIForm 8-K, forward-looking disclosures, public-company risk disclosure
48Tasks
13Primary
1Benchmarks

Published model evidence

A quick view of shareable runs in this category. Open task and trace pages for the prompt, response, files, and grading details.

Gemini 3 Flash41% pass

13/32 runs · avg score 66%

gpt-5.531% pass

15/48 runs · avg score 55%

gpt-5.4-nano29% pass

14/48 runs · avg score 56%

gpt-5.4-mini29% pass

14/48 runs · avg score 52%

Gemini 3.1 Pro29% pass

14/48 runs · avg score 48%

Kimi K228% pass

11/39 runs · avg score 56%

Primary tasks

13 tasks with this category as their main focus.

  1. Task 5vd1ebb0APEX-Agents(task_b952b8a8034a4affaaca6d3be7a2d8f7)5/5 · Pass

    We've received the attached warranty claims for some of our products. Please review them. Then, edit the existing existing "product purchases" spreadsheet to show the maximum refund amount a customer …

  2. Task awys8050APEX-Agents(task_0cf6902f9ef341328e3261f7055918ee)6/8 · Fail

    CrowdStrike's general counsel sent us a complaint filed in U.S. district court by Larry Stone, alleging violations under Sections 10(b) and 20(a) of the Securities Exchange Act of 1934, as well as Rul…

  3. Task iv36a08aAPEX-Agents(task_7fe79f6934f64f159f8a6c27901e3db8)1/7 · Fail

    Analyze whether Counts 1-7 of Delta's Complaint against CrowdStrike fall within the limitation of liability clause in Section 10.1 of CrowdStrike's standard MSA, indicating "Covered" or "Not Covered" …

  4. Task jhp9ccb4APEX-Agents(task_a7c1daf7049b46ada402eada03ad7865)2/3 · Fail

    A real-time Rapid Response Content (RRC) update is automatically delivered and it causes performance degradation in a customer’s environment. The customer did not stage deployments, had no rollback pl…

  5. Task yhzc9d1aAPEX-Agents(task_107a64a2aeb8439fb41c5e16d25a5326)5/5 · Pass

    CrowdStrike sent the attached list of historic stock transactions (note the document lists transactions for both Class A and B stocks). We need to determine if any of these people would be a part of…

  6. World 415-CD-02APEX-Agents(task_5b434b51e4de4ad398fa8d9f59321b6e)2/2 · Pass

    Review the following: the statement dated July 19, 2024 from George Kurtz, the Form 8-K from Crowdstrike dated July 19, 2024 and Rule 10b-5. Based solely on these documents, identify any statements ma…

  7. World221_jd_1APEX-Agents(task_800767f48d7e42cfaa74ca8057364512)1/1 · Pass

    If BBDC was to merge with TPVG, what would be the pro forma industry exposure for Business Services (investments at fair value as a percentage of total, based on end of September 30, 2025 data)? Use…

  8. World221_jd_2APEX-Agents(task_8a5a79b7a16d42bc90b2eab642298aa9)0/1 · Fail

    If BBDC had effectively merged with TPVG at the end of September 2025, what would be the expected synergies (in dollars) in one and a half years post-closing? You can assume the synergies equal 10% o…

  9. World221_TR_08APEX-Agents(task_f18f9e5701bf47a6a835d7d7bd6c7024)0/6 · Fail

    Use "Comp Analysis – Modify" as a clean version of Comp Analysis. Replace peers WhiteHorse Finance (WHF) and TriplePoint Venture Growth BDC corps. (TPVG) and replace with SLR Investment Corp. (SLRC), …

  10. world227_tg_02APEX-Agents(task_9b9afdd77d4240a5bb3c13e83182b91b)0/1 · Fail

    Using Option B in the MFC model, the refinancing in conjunction with a equity private placement (preferred stock), update to upsize the preferred tranche to $1.5bn and for interest to be payment-in-ki…

  11. World415_DM_01APEX-Agents(task_3fa64829d31f43348113cc74f457b3ec)3/3 · Pass

    MLT is a CrowdStrike customer severely affected by the outage. MLT filed a lawsuit for negligence seeking to recover damages arising from the outage. Additionally, MLT successfully transferred venue t…

  12. World415_im_01APEX-Agents(task_4723cf79c09048f684a8a870bf96d187)1/6 · Fail

    An independent investigation of Crowdstrike's Channel File 291 outage revealed that the devices affected were mostly Microsoft or Google devices, and no Apple devices were affected at all. Is another …

  13. World415_im_02APEX-Agents(task_729336fef1614d1a91692ac2bb442bd5)0/3 · Fail

    Review only the following: CrowdStrike Form 8-K 2024.pdf Form 8-K Standard.pdf DELTA AIR LINES, INC. 8-K.pdf Today, August 9, 2024, we discovered that the Falcon sensor outage may have been caused by…

Related tasks

35 tasks that also exercise this work as part of a broader assignment.

  1. Analyze Effect of Anti-SLAPP Suit Against BlueLNG on Pre-Suit DiscoveryAPEX-Agents(task_4d143fb2608745848a8f1096667996be)2/4 · Fail

    As counsel to BlueLNG and recently subpoenaed a news reporter under Rule 202 to find out whether he's illegally obtained trade secrets from one of our shipyards. The shipyard filed a motion to dismiss…

  2. Law_World_423_DM_04APEX-Agents(task_3e4eba49c9cd4d3fa0de912ab1b1501e)7/10 · Fail

    Northstar's CEO sent me an email asking for a summary of the company’s liability under US privacy law if the incident occurred to a US customer based in Colorado. Please take the lead on drafting a hi…

  3. Law_World_434_sg_01APEX-Agents(task_981f4f72a55c4e7598b6f23f3e576e54)0/10 · Fail

    HarborView requires all customer documents to be sent to their offices in the Cayman Islands headquarters, including information of Hong Kong customers. We’ve also already sent them documents as part …

  4. LawWorld433_ANB_01APEX-Agents(task_de1ec76029b54126ae1105921e4202d4)3/3 · Pass

    Susan Whitaker has filed three successive Complaints against Magnolia Gardens. The first is the original Complaint, the second Is the First Amended Complaint, and the third is the Second Amended Compl…

  5. Task acg14a6cAPEX-Agents(task_5c14b248c88842b1a3442152671cbb18)5/6 · Fail

    Can you review Sections 8.4, 9.1, 9.3,10.1,14.7 in our MSA, against the below outage scenario? A faulty update causes endpoint failures. The customer sends a breach notice by email to a support inbox…

  6. Task ymtecb81APEX-Agents(task_bf18a6d6ff44489daf0b1c80b5d4a3a8)8/9 · Fail

    Can you take a look at the two Master Supply Agreement templates (Master Supply Agreement Template.pdf ("Template1"), Master Supply Agreement 2.pdf ("Template2"))? We’re considering them for Acme (th…

  7. World 421_OO_01APEX-Agents(task_8702e946cbad4a56886fcd7ea18cd5b2)6/10 · Fail

    Our client, SLL, offers discounts to senior clients who opt into receiving texts about new products and services when they apply for loans from SLL. A prospective customer, Angie, agreed to receive …

  8. World_421_ANB_02APEX-Agents(task_ed8356c4f4c146b58d2cd869924fdfe3)1/5 · Fail

    Our client, Senior Living Lending, Inc. ("SLL") is a reverse mortgage and home equity line of credit lender. They want to implement a telemarketing program that relies heavily upon texting potential b…

  9. world219_tg_04APEX-Agents(task_95a11015406f43a597c0b68c0b2e429a)0/1 · Fail

    Assume that CNS has been taken private as of the start of FY25E. The new PE owners have decided to reduce employee compensation by 50% of the value of stock-based compensation in the previous LBO fore…

  10. World221_TR_07APEX-Agents(task_9fad1b1520eb46778e34e950c41be109)1/4 · Fail

    What if BBDC change target and achieve a partial merger with FIDUS Investment Corporation (FDUS) instead of TriplePoint Venture Growth BDC Corp. (TPVG)? Use the FDUS SEC filings as of Q3 2025 and Q4 …

  11. World223_CG_01APEX-Agents(task_498f648416184645bf732a0b4a94c40b)0/3 · Fail

    Compare the average tenure of Solventum's board members to the average of its peers' board members (excluding Solventum). Give their average tenure. Then, state which is larger and by how many years. …

  12. World228_SM_Task08APEX-Agents(task_bfd79e55d1104d3e92486de9b3c4de12)0/1 · Fail

    From Becton Dickinson's FY2025 Annual Report assume the FDA finds that one violation regarding the Alaris SE infusion pumps, and decides the company is in violation, and enforces the consent decree on…

  13. World246_AS_01APEX-Agents(task_5a7117ac62fd4da9bec41fe8d805ee03)5/5 · Pass

    Please audit the financials of the smallest company in our Refined Comps table by market cap using only the IS, CFS, and BS from sec filings and data tools available to you. Report Adjusted EBITDA and…

  14. world415_aeu_01APEX-Agents(task_7952b3923473458ab7c415da7be74810)4/10 · Fail

    We want to get ahead of preparing a settlement agreement for the Delta matter. Can you let me know which of Delta’s original causes of actions are no longer live as we head into the pre-trial conferen…

  15. world416_BB_01APEX-Agents(task_0b9134a634c14f24a6c256d034a6c130)2/3 · Fail

    TAC and its supplier executed the first draft of the Master Supply Agreement document (Template 1) as of April 1, 2025. President Trump announced additional tariffs on July 20, 2025. The supplier's r…

  16. World416_DM_01APEX-Agents(task_68bcf4d7fc5045b58045dc9f2f23ce5c)0/3 · Fail

    Due to a riot occurring in response to an Executive Order that resulted in the closure of its factories, TAC sought relief from performance under the force majeure section of the Master Supply Agreeme…

  17. World416_JS_01APEX-Agents(task_2b5df2b5a0eb423e998099a9fcd8e262)2/2 · Pass

    TRIDENT AUTO CORPORATION (The "Plaintiff") has filed a Complaint against United States President Donald Trump (the "Defendant") in the United States District Court for the District of Columbia challen…

  18. World416_JS_02APEX-Agents(task_0097f20dd1744647a5a6e76db215a467)2/2 · Pass

    TRIDENT AUTO CORPORATION (The "Plaintiff") has filed a claim challenging a 25% tariff that President Trump (the "Defendant") imposed on goods imported from China under the International Emergencies Ec…

  19. World416_JS_03APEX-Agents(task_58d04f83ddee4c01bf89a4a1ca0b933a)2/2 · Pass

    TRIDENT AUTO CORPORATION (The "Plaintiff") has filed a claim in the United States District Court for the District of Columbia against several federal government agencies (The "Defendants"). The Claim…

  20. World416_TK_02APEX-Agents(task_3a57257634404d0584a5bd7ce7846b89)0/1 · Fail

    TAC has just informed us that they expect a 20% drop in gross margin due to import tariffs. TAC has posted the information on their website as they have done in the past. Write me back a brief message…

  21. World416_TK_04APEX-Agents(task_5eec5f9ff1234067859443ab0a6c402d)1/2 · Fail

    Review the two supply agreement templates, Master Supply Agreement Template 1.docx and Master Supply Agreement Template 4.pdf, along with the attached files (UCC §2-209 and Restatement (Second) of Con…

  22. World418_BA_01APEX-Agents(task_9509d6400e0c4e67a2222316744e7ded)2/10 · Fail

    Does any agreement between us and BlueAnchor create any non-disclosure obligations preventing our owner from publicly announcing the deal? Write me a short reply back that I can review and send.

  23. World423_JS_02APEX-Agents(task_7e51ed8994924d8d9f92938fd8cf9fd2)5/9 · Fail

    It has come to our attention that some of the data transferred by the "Diagnostics Analytics Module" related to residents of Colorado. Does Colorado Law require us to notify Colorado residents of this…

  24. World425_amk_01APEX-Agents(task_8d501efe0f924f69aeee070f2e08b576)6/6 · Pass

    Summit filed Form 2553 (Rev B) with the Internal Revenue Service ("IRS") on February 19, 2019. Do you see any potential problems under Treasury Regulation 1.1362-6(b)? Give me your analysis back her…

  25. World425_amk_04APEX-Agents(task_8ab8c8d7662747d696d52706a8b3de55)0/3 · Fail

    Assume that the Internal Revenue Service denies relief for the transfer of shares to Carrie Canuck, an ineligible shareholder. What amount of taxes (federal plus state) would be owed by Summit Filing…

  26. World425_AVK_01APEX-Agents(task_b78c4510be784e6a8b8f0394aafd785d)0/1 · Fail

    Summit Filing Solutions, Inc. bought a building in 2018 for $350k. It spent $250k on the buildout. It sold the building on June 20, 2022 for $1.2M. Review the diligence memo and current cap table. Sta…

  27. World425_jcf_02APEX-Agents(task_0dab65657186412983c2c04e363fe40e)5/10 · Fail

    Review the shareholders agreement and identify any provisions that may cause issues with Summit's S-corp status. Identify corrective procedures that may be available to Summit. Print back what you fin…

  28. World425_jrf_01APEX-Agents(task_11893dcabbe34b0aa991516dfe7edcba)3/3 · Pass

    We need to review Summit's historical distributions. Write me a memo analyzing whether Summit's shareholder distributions are in accordance with US tax code. Cite the exact tax code in each instance (…

  29. World425_tas_01APEX-Agents(task_876ace32decb4f26a3f7a7c3bf50bab7)6/6 · Pass

    Review the due diligence file for Summit Filing Solutions, Inc. and identify any potential deficiencies relative to its claimed status as an S-Corporation. Draft a set of indemnities, for incorporati…

  30. World425_tas_02APEX-Agents(task_ce4a398d9cf64e63aa54cb88b6615c93)5/6 · Fail

    Review the due diligence file relative to the S-Corp election of Summit Filing Solutions. Determine whether the S-Corporation election was timely made, the date on which it became effective, and any …

  31. World425_tas_04APEX-Agents(task_b9b58e483f384c5990900ef2d8c9fe17)3/4 · Fail

    Harbor Bridge has recently expressed concern that certain provisions of Summit's Amended and Restated Shareholder Agreement may be inconsistent with Summit's S-Corp election under 26 U.S.C. § 1361 and…

  32. World425_tas_05APEX-Agents(task_ed6f8d835b0141309442d2c373d1c5da)5/8 · Fail

    As you know, Harbor Bridge Private Equity sent initial inquiries to Summit Filing Solutions ("Summit") on matters related to Summit's S-Corp election. Laura Kensington, Summit's Acting CEO, responded…

  33. World425_tas_07APEX-Agents(task_f8f47a9c94874854a24936d81a89fdfb)6/9 · Fail

    We have been asked to determine whether the S-corporation election of Summit Filing Solutions, Inc. ("Summit"), which Summit claims was effective on 1/1/19, was terminated. Please analyze Summit's Sha…

  34. World431_DM_05APEX-Agents(task_18263dbcc46a4fabaf9b7b6f243aa748)3/3 · Pass

    MGR Real Estate Inc. ("MGR") and "AI Automation Group, LLC" ("AIAG") entered into the final lease agreement on December 12, 2025 for 2020 Main Street, Irvine, CA (the "Building"). The Parties mutually…

  35. World433_SG_01APEX-Agents(task_f40a571a80e944cead66ecf1d3f0de93)2/2 · Pass

    Grove Garden Living ("Grove Garden") is going to be filing a motion for summary judgment for the Wrongful Death claim in the complaint that was filed by Daisy Buchanon (the "Plaintiff") against Grove …