As a Safety Strategic Projects Associate (SPA), you will own the execution of large-scale human data programs that directly power frontier AI model training and evaluation. You will design, build, and execute operational workflows supporting model policy annotation and develop evaluations across a range of policy areas. You will use model policy annotation to help inform model training, evaluation, and enforcement decisions across leading AI systems.
Working hands-on with leading AI labs and technology companies, you will make real-time decisions that affect revenue, margins, delivery quality, and long-term customer relationships. This is a high-ownership, outcomes-driven role for operators who thrive in ambiguity, move fast with incomplete information, and are accountable for results at scale.
What you'll do:
What you'd do
- Support the design and iteration of annotation frameworks and labeling workflows that scale while maintaining precision, accuracy, and inter-rater agreement
- Coordinate trusted annotators and contribute to a culture of consistency, care, and sound judgment when handling sensitive content and complex edge cases
- Partner with policy leads to organize and surface insights on policy gaps, classification ambiguities, and nuanced scenarios identified through annotation work
- Build and maintain detailed annotation playbooks, quality resources, and auditor guidance across diverse datasets and regulatory domains
- Analyze annotation data to identify emerging trends, systemic labeling errors, and opportunities to strengthen internal safety policies
- Work with frontier AI labs and internal stakeholders to support project scoping, issue resolution, and delivery of model policy programs
What they want
- A strong academic record as a recent graduate (or someone graduating soon), ideally with internship or light work experience in trust and safety, policy enforcement, regulatory compliance, risk management, management consulting, government, or a related field
- Strong analytical and first-principles problem-solving skills; comfort or aptitude for drawing insights from large datasets (SQL proficiency a plus)
- Excellent written and verbal communication skills, including the ability to work effectively with senior stakeholders and customers
- High ownership and a reliable, detail-oriented approach to execution
- Curiosity and an ability to quickly learn technical AI concepts and industry trends
What you get
- Shape how every career evolves in the AI economy, at global scale, with impact your friends, family and peers can see and feel
- Partner hand-in-hand with world-class AI labs, Fortune 500 partners and the world’s top educational institutions
- Work together with engineers, scientists, operators, and more from Palantir, Meta, Scale AI, and former YC founders
- Build a massive, fast-growing business with billions in revenue
About Handshake · HAI Delivery Ops
Handshake was founded on a simple belief that everyone deserves a path to a great career, regardless of where they went to school or who they know. Today, we power 25 million job seekers, 1 million+ employers, and 1,600 educational institutions.
In 2025, we started Handshake AI and built the fastest-growing AI data business in history. We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data.