Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
As an Enforcement Analyst focused on Chem & Explosives Harms, you will play a critical role in protecting against the misuse of AI systems for chemical and explosives harms. You will enforce our Usage Policy with a specific focus on detecting and mitigating these risks, investigating potential violations, and help continuously strengthen our safeguards.
What you'd do
- Enforce Usage Policies with a specific focus on detecting and mitigating potential chemical and explosives risks and harmful use of AI systems.
- Take ownership of enforcement monitoring workflows for the chemical and explosives harm area, improving end-to-end detection, investigation, triage, and escalation processes.
- Monitor and analyze platform activity to identify emerging patterns related to chemical and explosives threats (within the broader CBRNE landscape) that may require policy updates or enforcement action.
- Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy across a technically complex content surface.
- Conduct thorough investigations of potential violations, gathering and documenting evidence to support enforcement decisions.
- Proactively surface trends and propose improvements to detection methods and review workflows without waiting to be directed.
- Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for policy violations.
- Partner with Policy and Threat Intelligence teams to understand potential exploits and contribute to risk-assessment frameworks, and partner with engineers iterating on safety systems.
- Provide enforcement-grounded feedback on policy gaps, and handle escalations and time-sensitive situations related to chemical and explosives policy violations.
What they want
- Hold a degree in a chemistry-related field (e.g., chemistry, chemical engineering, materials science) and/or relevant professional experience in a related field.
- Possess experience in Trust & Safety, content moderation, or policy enforcement at platform scale, including working with generative AI tools to refine and optimize content review and enforcement workflows.
- Possess experience in utilizing AI tools to develop data dashboards for metrics collection in support of continuous improvement efforts.
- Can analyze complex, ambiguous situations and make well-reasoned, defensible decisions under time pressure.
- Are proactive and self-directed: you spot trends, dig in, and ship improvements on your own initiative.
- Communicate clearly in writing and can translate technical chemistry concepts for diverse audiences, including both technical and non-technical stakeholders.