Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
As an Enforcement Analyst focused on Bio Harms, you will play a critical role in protecting against the misuse of AI systems for biological and related CBRNE harms. You will enforce our Usage Policy with a specific focus on detecting and mitigating bio risks, investigating potential violations, and help continuously strengthen our safeguards.
What you'd do
- Enforce Usage Policies with a specific focus on detecting and mitigating potential bio risks and harmful use of AI systems.
- Take ownership of enforcement monitoring workflows for the bio-harms area, improving end-to-end detection, investigation, triage, and escalation processes.
- Monitor and analyze platform activity to identify emerging patterns related to biological (and adjacent chemical, radiological, nuclear, and explosive) threats that may require policy updates or enforcement action.
- Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy across a technically complex content surface.
- Conduct thorough investigations of potential violations, gathering and documenting evidence to support enforcement decisions.
- Proactively surface trends and propose improvements to detection methods and review workflows.
- Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for bio-related policy violations.
- Partner with Policy and Threat Intelligence groups to understand potential exploits and contribute to risk-assessment frameworks, and partner with engineers iterating on safety systems.
- Provide enforcement-grounded feedback on policy gaps, and handle escalations and time-sensitive situations related to potential bio-related Usage Policy violations.
What they want
- Hold a degree in a bio-related field (e.g., microbiology, molecular biology, biochemistry, public health) and/or relevant professional experience in a related field.
- Possess experience in Trust & Safety, content moderation, or policy enforcement at platform scale, including working with generative AI tools to refine and optimize content review and enforcement workflows.
- Possess experience in utilizing AI tools to develop data dashboards for metrics collection in support of continuous improvement efforts.
- Can analyze complex, ambiguous situations and make well-reasoned, defensible decisions under time pressure.
- Are proactive and self-directed: you spot trends, dig in, and ship improvements on your own initiative.
- Communicate clearly in writing and can translate technical bio concepts for diverse audiences, including both technical and non-technical stakeholders.