Date Posted: 06/08/2026
Hiring Organization: Rose International
Position Number: 502460
Industry: Social Media
Job Title: Risk Analys
Job Location: Austin, TX, USA, 78701
Work Model: Onsite
Shift: Mon - Fri 40 hours
Employment Type: Temporary
FT/PT: Full-Time
Estimated Duration (In months): 13
Min Hourly Rate($): 42.00
Max Hourly Rate($): 47.00
Must Have Skills/Attributes: Chat GPT, Engineering, Risk Analysis
Experience Desired: Experience in Red Teaming, AI and LLM (3+ yrs); Background in creative writing, humanities, mental health counseling, psychology, or special educati (3+ yrs); A natural inclination to think like an attacker and push systems to their limits. (3+ yrs); Comfort switching between modalities (text, image, audio, video) and rapidly adjusting (3+ yrs); Capacity to sustain well-being while engaging in psychologically demanding work (3+ yrs); Exposure to graphic and objectionable content, including violence, exploitation (2 yrs); Prior experience in professional red teaming, trust & safety, data annotation is a plus (3+ yrs)
**C2C is not available**
Job Description
Client Location: Onsite 5 days a weekAustin, TX preferred but open to New York, NY location
POTENTIAL EXPOSURE TO OBJECTIONABLE/SENSITIVE/GRAPHIC CONTENT
Education Required:
- Bachelor's degree preferred but not required
REQUIRED Experience
- At least 3 years - Red teaming specialist
- Creative & narrative construction — ability to build compelling multi-turn scenarios that exploit linguistic nuance
- Creative and Psychological Insight: Background in creative writing, humanities, mental health counseling, psychology, or special education — with a demonstrated ability to construct compelling narratives, exploit linguistic nuance, and identify psychological vulnerabilities.
- Adversarial Mindset: A natural inclination to think like an attacker and push systems to their limits. You should find genuine satisfaction in discovering unexpected failure modes.
-Adaptability: Comfort switching between modalities (text, image, audio, video) and rapidly adjusting to new model behaviors, testing priorities, and task types.
- Communication Skills: Excellent written and verbal communication skills, with the ability to document and explain complex vulnerabilities clearly to both technical and non-technical audiences.
- Resilience and Balance: Capacity to sustain well-being while engaging in psychologically demanding work. This role involves regular exposure to graphic and objectionable content, including violence, exploitation, and self-harm scenarios. Comprehensive wellness support is provided.
Preferred Qualifications
- Prior exerience in professional red teaming, trust & safety, data annotation, or socio-technical risk analysis.
- Familiarity with large language models (LLMs) and generative AI products such as ChatGPT, Claude, or Gemini.
- Basic technical skills in prompt engineering, encoding techniques (e.g., Base64, ROT13), or scripting to complement creative attack vectors.
- Knowledge of AI safety concepts, including RLHF, alignment, and model evaluation frameworks.
Unlike automated testing, which handles baseline coverage and known attack patterns efficiently, this role focuses on the ~40% of vulnerabilities that require human ingenuity, psychological insight, and creative out-of-distribution thinking. You will interact with our models across text, image, audio, and video modalities to uncover weaknesses, evaluate actual output harm, and stress-test our systems against novel adversarial attacks.
This is intense, high-impact work at the frontier of AI safety — and it offers direct influence on how Client AI systems behave in the real world.
Position Summary:
What You'll Do
Creative Adversarial Testing
Design and execute novel, multi-turn adversarial attacks — including emotional manipulation, roleplay, social engineering, and authority exploitation — to bypass model safeguards and surface harmful capabilities.
Vulnerability Assessment
Evaluate model outputs for actual harm and real-world risk, not just policy violations. Apply Client user risk taxonomy to prioritize testing across user types, from casual users to agentic systems.
Agentic and Emerging Threat Testing
Probe for agentic vulnerabilities such as privilege escalation, indirect prompt injection, and scope creep in multi-authority systems — the next frontier of AI risk.
Data Annotation and Reporting
Generate high-quality human evaluation data by annotating model failures, classifying vulnerabilities, and producing reproducible adversarial test cases that engineering and safety teams can act upon.
Cross-Functional Collaboration
Partner with AI researchers, engineers, and domain experts to translate findings into actionable improvements. Contribute to refining our red teaming taxonomy, benchmarks, and tooling infrastructure.
Continuous Learning
Stay current with evolving adversarial techniques, internet subcultures, and AI safety research to continuously sharpen your attack strategies.
What We're Looking For
We actively seek candidates from non-traditional backgrounds. Our most effective red teamers come from creative, humanities, mental health, and special education fields — not exclusively from technical roles.
Important Notice
Job Description:
We are seeking creative, resilient, and highly motivated AI Red Teamers to join our Red Teaming team. In this role, you will be at the forefront of AI safety, identifying and mitigating risks in our advanced language models.
Pursuant to the California Fair Chance Act, Los Angeles County Fair Chance Ordinance for Employers, Los Angeles Fair Chance Initiative for Hiring Ordinance, and San Francisco Fair Chance Ordinance, qualified applicants will be considered for assignment with arrest and conviction records. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness, meet client expectations, standards, and accompanying requirements, and safeguard business operations and company reputation. - **Only those lawfully authorized to work in the designated country associated with the position will be considered.**
- **Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client’s business needs and requirements.**
Benefits:
For information and details on employment benefits offered with this position, please visit here. Should you have any questions/concerns, please contact our HR Department via our secure website.
California Pay Equity:
For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here.
Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.
If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department.
Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).
It was great working for Rose International. Everyone was extremely helpful.
Rosann, Consultant
Your team at Rose International is always very helpful and responsive.
Barbara, Consultant
Working for Rose International was the most pleasant assignment I have ever had. They were always on top of situations when necessary, and very helpful. I was very proud to be an employee of Rose International, and would recommend anyone to try to work with them.
Melvon, Consultant
I believe the best thing that Rose HR has going for it is the incredible responsiveness. Everyone is very quick to reply to any concerns, and contacts the contracted employees very quickly and efficiently.
Kevin, Consultant
The interactions that I have had with your representatives have always been prompt and very professional. I am very pleased and impressed with your company and services.
Sioe, Consultant
EMPLOYEE COMMENTS