Date Posted: 12/04/2025
Hiring Organization: Rose International
Position Number: 494225
Industry: IT Company/Software
Job Title: Strategic Project Lead, Data Factory
Job Location: Santa Clara, CA, USA, 95052
Work Model: Onsite
Employment Type: Temporary
FT/PT: Full-Time
Estimated Duration (In months): 13
Min Hourly Rate($): 60.00
Max Hourly Rate($): 100.00
Must Have Skills/Attributes: Infrastructure, Machine Learning, Python
Experience Desired: Experience leading large (100+) technical delivery/ops teams (10 yrs); Experience with LLM datasets, especially SFT/RLHF (5 yrs)
Required Minimum Education: Bachelor’s Degree
**C2C is not available**
Job Description
*** This role is supporting NVIDIA ***
Required Qualifications:
• 10+ years of experience building and leading large scale technical delivery teams. Proven ability to lead large cross functional teams (100+) by building strong operations
• Bachelor’s degree in engineering, Computer Science or equivalent practical experience leading large-scale technical initiatives.
• Demonstrated experience managing large-scale dataset generation or annotation for LLMs, ideally with experience in RLHF or SFT pipelines.
• Strong understanding of quality review mechanisms including prompt win rate, agreement metrics, inter-annotator consistency, and preference modeling.
• Experience with human data generation across at least one of the modalities (Text, Image, Video, Audio)
• Technical fluency in data platforms, machine learning concepts and modern Machine Learning tooling (e.g., HuggingFace, LangChain, Weights & Biases).
• Strong communication skills with experience presenting to executive stakeholders, managing client escalations, and aligning delivery with strategic goals.
Nice-to-have Qualifications:
• Prior experience at AI Data Platform companies
• Past experience with retrieval augmented generation (RAG), fine-tuning, and human evaluation workflows.
• Familiarity with fine-tuning LLMs, prompt engineering at scale, and instruction dataset design.
• Technical fluency in Python and cloud infrastructure
• Familiarity with benchmarks (SWE Bench, MMMLU, or equivalent)
We are seeking a seasoned, techno-functional leader to drive the development and execution of large-scale LLM training programs. This role is deeply technical and customer-facing, with significant emphasis on dataset creation, annotation and workflows, and high-quality data pipelines for foundational model training. The ideal candidate combines deep technical understanding of the LLM training lifecycle, strong operational rigor, and exceptional cross-functional leadership. This candidate should also be comfortable operating with little structure, handling sensitive information responsibly, and navigating complex organizational dynamics with humility and confidence.
Key Responsibilities:
• Lead the generation and delivery of high-quality, scalable LLM training datasets with a focus on SFT, RLHF, rubric-based evaluation, reasoning, and agentic workflows.
• Oversee the end-to-end data lifecycle from customer intake to delivery, including collaboration with the researchers for defining the data requirements, guidelines, designing the data annotation steps/workflow, quality metrics, review workflows, and delivery setup.
• Serve as the primary contact for large engagements; manage stakeholder expectations, requirements gathering, and delivery timelines.
• Collaborate with engineering, product, research, and delivery teams to ensure technical feasibility and alignment across workstreams.
• Develop, document, and refine best practices for prompt evaluation, data schema design, evaluation metrics (e.g., win rate, pairwise preference), and human-in-the-loop QA.
• Manage and mentor leads, program managers, and annotators working across multiple AI training pods.
• Operate as a strategic business partner to our customers; provide insight on tradeoffs, resourcing, and performance metrics.
• Build internal capability by harvesting reusable assets and contribute in continued improvements across data quality, tools and processes. - **Only those lawfully authorized to work in the designated country associated with the position will be considered.**
- **Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client’s business needs and requirements.**
Benefits:
For information and details on employment benefits offered with this position, please visit here. Should you have any questions/concerns, please contact our HR Department via our secure website.
California Pay Equity:
For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here.
Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.
If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department.
Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).
It is a great pleasure being a part of the Rose International Team.
Toni, Consultant
My on-boarding with Rose was outstanding. The packets of information, the process, and great attention to detail each person gave me allowed me to get started quickly.I appreciated each person's friendly and helpful attitude.
Diana, Consultant
I believe the best thing that Rose HR has going for it is the incredible responsiveness. Everyone is very quick to reply to any concerns, and contacts the contracted employees very quickly and efficiently.
Kevin, Consultant
The interactions that I have had with your representatives have always been prompt and very professional. I am very pleased and impressed with your company and services.
Sioe, Consultant
I am very happy with the Rose International, and the professionalism of the employees.
Robin, Consultant
EMPLOYEE COMMENTS