Overview:
We are seeking highly skilled and experienced professionals to join our team as Subject Matter Experts (SMEs), in various domains such as coding, biology, chemistry, physics and math, and in one or more of several languages, including Russian, German, Mandarin, Japanese, Spanish, among others (full list below). As an integral part of our quality control process, you will contribute your expertise to ensure the accuracy and effectiveness of our AI systems. Your expertise will be invaluable in creating guidelines, prompt engineering and directly annotating data to help our AI models excel in their respective domains
Responsibilities:
• Quality Assurance: Evaluate and grade the quality of annotations produced by vendors for SFT (Supervised Fine Tuning) and RLHF (Reinforcement Learning from Human Feedback) annotations. Identify areas of improvement and provide feedback to optimize the quality of annotations.
• Guideline Development: Create, edit, and maintain high-quality annotation guidelines tailored to your area of expertise. Ensure that these guidelines are up-to-date, clear, and concise to enable vendors to deliver accurate annotations.
• Trend Analysis: Stress-test our models and document problematic trends observed across various examples. Collaborate with the team to address these trends and improve the models' performance.
• Domain Expertise: Offer guidance and mentorship within your domain to bridge any gaps in understanding and support the development of more accurate AI models.
• Data Annotation: Directly annotate data for key tasks when necessary, including writing SFT responses and judging output quality for RLHF.
• Prompt engineering: Write and evaluate system prompts to steer our models, generate synthetic data and improve specific product outcomes (e.g. search triggering).
Requirements:
• Education: A Master's or Ph.D. degree in a relevant field related to the domain of expertise (coding, biology, chemistry, physics, mathematics)
• Experience: A minimum of 5 years of professional experience in the respective domain.
• Deep Knowledge: Demonstrated deep understanding and expertise in the designated domain.
• Communication Skills: Strong written and verbal communication skills to effectively convey complex ideas and guidance to internal teams and external vendors.
• Analytical Skills: Exceptional analytical abilities to identify trends, evaluate annotation quality, and provide actionable feedback.
• Collaboration: Proven ability to work collaboratively with cross-functional teams and external partners to achieve shared goals.
• Adaptability: Flexibility and willingness to learn and adapt to new technologies and processes in a rapidly evolving environment.
Language Expertise:
Must be fluent in at least one language other than English, specifically: French, German, Portuguese, Spanish, Vietnamese, Hindi, Italian, Thai, Indonesian, Arabic, Tagalog, Russian, Cantonese, Mandarin, Japanese, Punjabi, Korean and Bengali.
What We Offer:
• Opportunity to work on cutting-edge AI technology and make a significant impact on the development of advanced AI models.
• Competitive salary and benefits package.
• A dynamic and inclusive work environment that values diversity and innovation.
• Growth opportunities to expand your skill set and career progression within the organization.
• If you are passionate about contributing your expertise to revolutionize the world of AI, we encourage you to apply for this exciting opportunity.
Number of prompts on a daily/weekly?
• Can depend on complexity/projects. No high-volume work. Goal is to be setting up new processes, improvision, identifying gaps.
Nice-to-have Skills:
• AI experience
Years of Experience:
• A minimum of 5 years of professional experience in the respective domain.
Degrees/Certifications Required:
• A Master's or Ph.D. degree in a relevant field related to the domain of expertise (coding, biology, chemistry, physics, mathematics)
Interview Process:
• Language assessment - to be conducted in the anticipated language
• Second Round with Management/SME
• Test to be conducted just after or right before the final interview (successful completion of this will determine qualification of round two interview)
• Block style interviews – specific days/times – Chanelle to share the spreadsheet with the supplier
• 45 minute interview each
- **Only those lawfully authorized to work in the designated country associated with the position will be considered.**
- **Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client’s business needs and requirements.**
I had a very positive experience working for Rose. The entire process is very efficient and easy.
Joanne, Consultant
Rose is an assembly of people grounded in honesty, truth and dignity for all of its employees and contractors.
Samba, Consultant
It is a great pleasure being a part of the Rose International Team.
Toni, Consultant
As a contractor, I have to say that Rose International was by far the best agency I have worked for.
Q'testdalir, Consultant
Thanks for the opportunity. If in the future I ever need a job, I would like to work for Rose International.
David, Consultant
EMPLOYEE COMMENTS