Software Quality Operations Specialist

What you'd do

• Partner with Engineering to design, test, and deploy cutting-edge Machine Learning (ML) and Generative AI (Gen-AI) models and tools to drive step-change improvements in issue discovery & detection, triage efficiency, and quality assurance.
• Leverage AI-powered insights and traditional triage signals to proactively identify emerging on-road issue trends, new risk scenarios, and edge cases.
• Develop and refine data-driven strategies for issue discovery and monitoring, enhanced by ML model outputs
• Serve as the key link between AI/ML development and operational execution. Define and document new policies, guidelines, and Standard Operating Procedures (SOPs) that integrate AI tools and insights into daily vendor workflows.
• Design and implement robust quality control processes for both human and AI-generated outputs. Perform meta-quality checks, validate the integrity of vendor work, and provide feedback to improve both human and model performance.
• Act as the subject matter expert for our Software Quality Operations, working closely with stakeholders, program leads, and vendor teams to ensure seamless adoption and maximum impact of AI/ML advancements in our quality processes.
• Be the trusted source for creating and updating technical policies, guidelines, and standard operating procedures for new scopes, platforms, and driving signals
• Provide technical leadership and consultation to stakeholders to enhance our workflows and quality.
• You'll be at the forefront of identifying and escalating issues with our tools, providing technical requirements to engineering, and driving user testing to support the development and deployment of new tooling features.
• A proven ability to work in a fast-paced, high-stress environment while maintaining good judgment.
• Excellent communication and interpersonal skills to effectively collaborate with a wide range of individuals in a diverse and dynamic work environment.

What they want

• BS/BA degree or 4 years of relevant work experience in AV Software Quality Operations
• Increased competency in supporting all phases of the machine learning development lifecycle, from data preparation and training to validation, deployment, and continuous monitoring.
• Experience with ML testing and validation, including dataset quality assurance, bias detection, edge-case scenario testing, and performance evaluation using statistical metrics.
• Ability to quickly learn and implement new concepts and utilize proprietary tools. Strong understanding of driving rules and regulations.
• Must have the ability to provide occasional on-call availability for evenings, weekends, and holidays, as well as the flexibility to attend meetings outside of standard hours to collaborate with our global team.
• Demonstrated strong execution with ability to drive outcomes.
• Experience working with offshore teams / multiple local operations hubs.
• Basic SQL querying.
• Competency in LLM / transformer models, and / or ML for robotics domain experience.
• A greater focus on using your subject matter expertise for results analysis and direct customer consultation in the development of new and improved. solutions.