NEW JOB OPENING
TRAINING LEAD - KNOWLEDGE EXPERT - VOICE
IN Remote, USA!

Description:

• Training Lead JD for Client GenAI Team We are seeking an experienced Training Lead to oversee and guide a team of skilled Speech Experts

• (SMEs) in enhancing the quality of our AI training datasets, with a strong focus on speech aesthetics. The Training Lead will be responsible for setting the vision, driving excellence, and ensuring consistency across all speech annotation activities. This leadership role requires a deep understanding of speech, audio engineering, and annotation best practices, as well as the ability to mentor and manage a team of subject matter experts.



What You'll Do

Team Leadership & Management:

• Lead, mentor, and develop a team of Speech Experts, fostering a culture of quality, collaboration, and continuous improvement.

• Set clear goals and expectations for annotation quality and team performance.

• Organize regular calibration sessions and feedback loops to ensure alignment and consistency.



Domain Expertise Oversight:

• Work closely with Program Managers and Product Partners to implement the “vision” for novel speech annotation tasks Provide strategic direction on speech aesthetics and annotation standards.

• Collaborate with cross-functional teams and other SMEs to ensure best practices are followed.



Guideline Development & Maintenance:

• Oversee the creation, editing, and maintenance of high-quality annotation guidelines tailored to speech aesthetics.

• Ensure guidelines are up-to-date, clear, and actionable for both internal teams and external vendors.



Quality Assurance Leadership:

• Design and implement robust QA processes for speech annotation, including SFT (Supervised Fine Tuning) and RLHF (Reinforcement Learning from Human Feedback) tasks.

• Review and grade annotation outputs, identify areas for improvement, and provide actionable feedback to both team members and vendors Audit outputs from the team to flag discrepancies and provide ample calibration information Lead calibration sessions to align teammates on audit discrepancies and error trends Data Annotation Oversight:

• Supervise direct annotation efforts for key tasks, ensuring the highest standards of quality and reliability.

• Guide the team in writing SFT responses and judging output quality for RLHF.

• Expert Evaluation:

• Lead the assessment of speech samples for subtle differences in emotion, audio quality, intention, and adherence to task requirements.

• Ensure the team provides reliable, high-fidelity signals for automated evaluation (autoeval) and reward model (RM) training.

• Stakeholder Communication:

• Serve as the primary point of contact for internal teams and external partners regarding speech annotation quality and processes.

• Communicate complex ideas and guidance effectively to diverse audiences.

• What Would Make You a Great Fit

• Leadership Experience: Proven track record of leading and developing high-performing teams in speech, audio engineering, or related fields.

• Discriminative Skills: Professionally "posttrained" ear, able to reliably discriminate between extremely subtle differences in speech.

• Technical & Domain Knowledge: Deep expertise in speech aesthetics, audio fidelity, emotional nuance, and conversational dynamics.

• Equipment: Owns and is familiar with above-average listening equipment Sony MDR 7506 Sennheiser HD600 Beyerdynamic DT 770 Pro Sony MDR-7506 DT 770 Pro



Background:

• Perfect fits for this role include:

• Speech therapists

• Voice actors

• Audio engineerings

• Great fits for this role include:

• Mastering engineers

• Music producers

• Therapists

• Radio announcers, talk show hosts, comedians Anyone extremely “in tune” with conversation and “reading the room”

• Prior Annotation Experience: Previous experience at other AI Labs, especially in a leadership position, is extremely useful / helpful here

• Communication & Analytical Skills: Exceptional written and verbal communication skills; strong analytical abilities to identify trends and drive improvements.

• Collaboration & Adaptability: Demonstrated ability to work collaboratively across teams and adapt to new technologies and processes in a fast-paced environment.

What We Offer:

• Remote work with significant impact on the development of advanced AI speech models.

• Leadership role with opportunities to shape the future of AI speech annotation.

• Preferred availability of ~40 hrs/week, including 2-5 calibration calls per week with the Client team.

• If you are passionate about leading experts and revolutionizing the world of AI, we encourage you to apply for this exciting opportunity.

• **Only those lawfully authorized to work in the designated country associated with the position will be considered.**

• **Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client’s business needs and requirements.**