Raycaster / evalsAll benchmarks

Cross-benchmark category

FDA and Pharma Promotional Compliance

Compare AI agent runs for FDA and Pharma Promotional Compliance: prompts, scores, grades, and public traces. This page showcases APEX-Agents tasks that test whether AI agents can evaluate FDA and pharmaceutical promotional compliance, including off-label promotion, misbranding, 21 CFR Part 202, and CBE supplement scenarios.

Life sciences compliance AIOff-label promotion, 21 CFR Part 202, CBE supplements, misbranding
20Tasks
20Primary
1Benchmarks

Published model evidence

A quick view of shareable runs in this category. Open task and trace pages for the prompt, response, files, and grading details.

Gemini 3 Flash71% pass

5/7 runs · avg score 84%

gpt-5.4-mini60% pass

12/20 runs · avg score 70%

Gemini 3.1 Pro55% pass

11/20 runs · avg score 67%

GPT-5.450% pass

7/14 runs · avg score 71%

gpt-5.4-nano45% pass

9/20 runs · avg score 60%

Kimi K236% pass

4/11 runs · avg score 56%

Primary tasks

20 tasks with this category as their main focus.

  1. Marketing Case Studies_Task03_SCAPEX-Agents(task_f525769ab6a748e6855e03c95e4b4bd7)6/8 · Fail

    Using the research found on pharma marketing and articles around competitor shifts in SG&A spend, identify key trends that Impact can apply to SG&A spend that could reduce overall costs. In particular…

  2. Task 2cc51b31APEX-Agents(task_cdaf73e0d7ce466a8338793974c13d22)1/1 · Pass

    A doctor was recently charged by the federal government under the same regulations that were the subject of the case in "US v. Caronia, 703 F. 3d 149 - Court of Appeals, 2nd Circuit 2012.pdf" for pres…

  3. Task p5y453dbAPEX-Agents(task_48d70f58c409446fb1e22ca7572dd1c8)0/1 · Fail

    Livyra has scrapped the "Focus on What Matters" campaign. They intend to replace it with a new campaign advertising to the general population which states normal approved audio messages based on depre…

  4. World 420 LB_05APEX-Agents(task_fa15dfc96f4b4a289fac616a6f3b4a1a)2/2 · Pass

    For purposes of a training presentation for sales representatives giving background on what off-label promotion is and its legal status, please indicate whether it would be accurate to incorporate the…

  5. World 420_dds_03APEX-Agents(task_8b881ab96d114632bfdbe3ad35684f33)5/9 · Fail

    Prepare an analysis regarding Livyra's Bencontra promotional activities. Take a look at the case file, paying close attention to the email communications as well as the relevant case law, statutes and…

  6. World 420_LB_02APEX-Agents(task_1918e229773b46699fe5576f1b11d7a2)2/3 · Fail

    Identify for each item below whether it could be used by the U.S. Food and Drug Administration (FDA) as evidence that Bencontra is intended by Livyra for use in pediatric patients: 1. bencontra_provi…

  7. World 420_LB_03APEX-Agents(task_e9c600e0ce46420eb983f8f1ed4d15d9)5/5 · Pass

    Based on new information showing increased reporting of seizures in Bencontra patients with no prior history of seizures, Livyra is planning to update the prescribing information for Bencontra to incl…

  8. World 420_LB_04APEX-Agents(task_9e919cde8791468cadce433c3c9eef09)1/6 · Fail

    Livyra would like to put out a simple direct-to-consumer (DTC) advertisement for Bencontra. In an effort to avoid anything that could be construed as off-label promotion, the DTC advertisement would n…

  9. World 420_LB_06APEX-Agents(task_3ff7f71e606840d09b4d64bd88398799)0/2 · Fail

    You are an attorney. Please review the document regarding circulation issues associated with Bencontra. Does Livyra's dissemination of this document to a doctor who prescribes Bencontra appear to meet…

  10. World 420_ZT_02APEX-Agents(task_4fe676ac270b404c9104c758bd3964dc)1/1 · Pass

    Review the attached email (stored as a docx file), as well as the cases available in the world. Write a message to me, outlining whether John’s actions constitute unlawful off-label promotion.

  11. World112-1_Task03_NAAPEX-Agents(task_0c527e11cc1c436696561a15eead68b2)10/10 · Pass

    Analyze the attached report and the continuous manufacturing report to state the FDA-encouraged manufacturing style that differs from traditional methods which is mentioned in both reports. Using the …

  12. World112-1_Task04_TBAPEX-Agents(task_d7893ddf035a4abca2990717ad4d7428)4/4 · Pass

    Given the US imposed tariffs on the import of pharmaceutical materials from Germany, India, China at the rates 10%, 15%, 20% respectively, determine the impact of tariffs as a percent increase in pred…

  13. World228_JK_04APEX-Agents(task_86de7a1a9d884d2bb1037ac181701a04)0/4 · Fail

    Calculate the 2030E discounted EV/Revenue multiples for West Pharmaceutical, Stevanato Group, Schott Pharma, and Aptar Group. Reference the valuation model on the "Trading Comps" tab. Note that the fi…

  14. World228_JP_02APEX-Agents(task_6a1f6778265e4fc99811f7ebf71c205c)0/2 · Fail

    Assume that 10% of Aptar's Asian pharma revenue will shift entirely into European pharma revenue. Retroactively apply this to 2024 financials. Refer to the 2024 ATR report. Return a short message with…

  15. World228_JP_05APEX-Agents(task_a7571304d554476498169424570451e3)0/1 · Fail

    ATR is expecting to write down the goodwill related to Pharma to zero following the merger with GXI. Referring to the 2024 ATR 10K calculate the new total ending Goodwill under this write down scenari…

  16. World228_SM_Task02APEX-Agents(task_3e2e533b49374381acf2056fe479e3ba)0/5 · Fail

    Create a new Spreadsheet for me. Please compute a new Adjusted EBITDA value for the following companies: West Pharmaceutical, Stevanato Group, Schlott Pharma, Berry Global, Aptar Group using the board…

  17. World228_SM_Task07APEX-Agents(task_a13be532a65d4938b2397ce17aa071d8)0/1 · Fail

    In The Aptar Group's 2024 annual report, extract global revenue for the Pharma segment in 2023 and 2024. Compute the aggregate dollar change in thousands of USD adjusted for 7.1% 2024 global inflation…

  18. World228_SM_Task08APEX-Agents(task_bfd79e55d1104d3e92486de9b3c4de12)0/1 · Fail

    From Becton Dickinson's FY2025 Annual Report assume the FDA finds that one violation regarding the Alaris SE infusion pumps, and decides the company is in violation, and enforces the consent decree on…

  19. World420_RO_01APEX-Agents(task_bdd8216b4e864b9a81d0b9d7af624497)2/3 · Fail

    Livyra wants to market Bencontra using just its name and price. What is the correct type of advertisement Livyra can make, if any, and what conditions must the advertisement meet? Answer in one senten…

  20. World420_SF_02APEX-Agents(task_d06f10ebd2ad4bb19ba47b00a590dd54)2/2 · Pass

    Livyra has decided to pay its independent contractors a fixed salary, consistent with fair market value, to sell Bencontra that is payable by government healthcare. Each independent contractor is give…