NEW JOB OPENING
SENIOR DATA ENGINEER GENERATIVE AI, LLM & AZURE DATABRICKS (COMMERCIAL INSURANCE)
IN REMOTE, USA!

 

Date Posted: 11/12/2026
Hiring Organization: Rose International
Position Number: 510715
Industry: Insurance
Job Title: Senior Data Engineer Generative AI, LLM & Azure Databricks (Commercial Insurance)
Job Location: Remote, USA
Work Model: Remote
Shift: 8am-5pm, Monday- Friday
Employment Type: Temp to Hire
FT/PT: Full-Time
Estimated Duration (In months): 3
Min Hourly Rate($): 80.00
Max Hourly Rate($): 90.00
Must Have Skills/Attributes: AI, Azure, CI/CD tools, Generative AI/GenAI, LLM (Large Language Model), MLOps (Machine Learning Operations)
Experience Desired:
Hands-on experience in data engineering, software engineering, data science, or AI/ML (7+ yrs),
Advanced Python, SQL, Apache Spark/PySpark, Databricks, and Delta Lake experience building production-grade ETL/ELT pipelines (4+ yrs),
Practical experience developing and deploying Generative AI and LLM applications, including RAG, embeddings, vector search (3+ yrs),
Building enterprise AI solutions using Microsoft Azure, Azure Databricks, Azure AI services, Azure Storage/Data Lake (4+ yrs),
Operationalizing machine learning models, including classification, regression, clustering, feature engineering (4+ yrs)
Required Minimum Education: Bachelor’s Degree
Preferred Education: Master’s Degree

**C2C is not available**

 

Job Description
Required Education:
• Bachelor's degree in Computer Science, Data Science, Artificial Intelligence, Engineering, Mathematics, or a related technical discipline.

Preferred Education:
• Master's degree in Computer Science, Data Science, Artificial Intelligence, Engineering, Mathematics, or a related technical discipline.

Required Qualifications/Skills/Experience:
• Strong professional experience in data engineering, analytics, machine learning, artificial intelligence, or software engineering.
• Advanced programming skills in Python and SQL.
• Strong hands-on experience with Databricks, Apache Spark/PySpark, and Delta Lake.
• Experience designing, developing, testing, and supporting production-scale ETL/ELT processes and scalable data pipelines.
• Practical experience performing exploratory and advanced data analysis on large, complex datasets.
• Working knowledge of statistical analysis and machine learning techniques, including supervised and unsupervised learning, classification, regression, clustering, feature engineering, and model evaluation.
• Hands-on experience developing and implementing Large Language Model (LLM) and Generative AI solutions.
• Experience with Retrieval-Augmented Generation (RAG), embeddings, vector search, prompt engineering, document processing, and LLM evaluation techniques.
• Experience designing and implementing scalable data ingestion, transformation, integration, and data-quality processes across structured and unstructured data.
• Experience working with Microsoft Azure cloud services and related technologies.
• Strong understanding of Git, CI/CD, DevOps, automated testing, code reviews, branching strategies, and production deployment practices.
• Experience using AI-assisted development tools such as GitHub Copilot, Claude, or comparable coding assistants for code creation, refactoring, debugging, testing, documentation, and maintenance.
• Ability to validate AI-generated code for functionality, security, performance, maintainability, and compliance with engineering standards.
• Understanding of cloud security, identity management, secrets management, logging, monitoring, scalability, resilience, and production support.
• Ability to independently manage the full engineering lifecycle, from understanding ambiguous business requirements and analyzing data through technical design, development, testing, deployment, and production support.
• Strong analytical, problem-solving, communication, and collaboration skills.
• Ability to translate business requirements into scalable data engineering, machine learning, and Generative AI solutions.

Preferred Qualifications/Skills/Experience:
• Strong commercial insurance experience, particularly in underwriting processes, specialty and commercial lines, and financial lines.
• Deep understanding of insurance data, business workflows, and commercial insurance operations.
• Hands-on experience working with insurance datasets, including Submission processing and submission data, Census data, Statement of Values (SOV) data, Loss run data, Claims data, Insurance exposures, and deductibles.
• Experience supporting underwriting workflows, risk assessment, pricing, submission evaluation, and insurance analytics.
• Prior experience in Property & Casualty (P&C), commercial insurance, specialty insurance, or reinsurance environments.
• Experience working within insurance, financial services, or other highly regulated, data-intensive industries.
• Background in actuarial science, data science, insurance analytics, or related insurance-focused analytical disciplines.
• Familiarity with insurance data and business processes, including policy, customer, broker, submission, quote, bind, premium, exposure, risk, claims, loss, and underwriting.
• Experience supporting underwriting, pricing, claims analytics, customer analytics, broker analytics, submission ingestion, document extraction, or risk assessment workflows.
• Hands-on experience with Azure Databricks, Azure AI services, Azure Storage/Data Lake, Microsoft Entra ID, Key Vault, Azure Functions, and related Azure cloud services.
• Experience operationalizing machine learning models using MLflow, MLOps, or similar model lifecycle management practices.
• Experience with vector databases, vector search technologies, and enterprise RAG architectures.
• Experience building enterprise LLM applications, conversational assistants, document summarization, information extraction, classification, and agentic workflows.
• Experience building APIs and microservices supporting data and AI applications.
• Familiarity with data governance, data cataloging, data lineage, metadata management, model governance, privacy, and Responsible AI practices.
• Experience with Infrastructure as Code (IaC) and automated cloud deployments.
• Experience working with Azure DevOps and GitHub-based development and deployment workflows.
• Experience collaborating with underwriters, actuaries, claims professionals, operations teams, data analysts, cybersecurity, and enterprise architecture teams.

Senior Data & AI / LLM Engineer Overview:
We are seeking an experienced Senior Data & AI / LLM Engineer to design, develop, and operationalize modern data engineering, machine learning, and Generative AI solutions within the insurance domain.
This is a hands-on engineering role requiring expertise across the full solution lifecycle, including business problem analysis, data exploration, scalable data pipeline development, machine learning implementation, LLM application development, and production deployment using Microsoft Azure and modern DevOps practices.
The successful candidate will combine strong technical expertise in data engineering, machine learning, and Generative AI with deep commercial insurance business knowledge, particularly in underwriting, specialty and commercial lines, and financial lines.
The strongest candidates will bring hands-on experience working with insurance data and business workflows, including submission processing, census data, Statement of Values (SOV), loss runs, claims, insurance exposures, and deductibles. Candidates with actuarial, data science, or insurance analytics backgrounds will be particularly well suited for this role.
The ability to understand complex insurance workflows, collaborate with underwriters and other business stakeholders, and translate insurance data challenges into scalable, secure, and production-ready AI solutions will be essential for success.
The role also requires an AI-first engineering mindset, leveraging tools such as GitHub Copilot and Claude to accelerate software development while maintaining high standards for code quality, security, reliability, and maintainability.

Job Duties:

Data Engineering & Analytics
• Design, develop, test, and maintain scalable data pipelines and data products using Databricks, Apache Spark/PySpark, Delta Lake, SQL, and Python.
• Perform exploratory and advanced data analysis to identify patterns, anomalies, trends, relationships, and business opportunities within complex datasets.
• Build and maintain reliable data ingestion, transformation, integration, and data-quality processes across structured and unstructured data sources.
• Work with large-scale datasets across cloud data platforms, APIs, files, databases, and enterprise applications.
• Implement and maintain data quality, lineage, observability, metadata, security, and governance practices.
• Optimize data pipelines and workloads for performance, reliability, scalability, and cost efficiency.

Machine Learning & AI
• Develop, evaluate, deploy, and monitor machine learning models using Python and appropriate ML frameworks.
• Apply statistical analysis and machine learning techniques, including classification, regression, clustering, feature engineering, and model evaluation.
• Translate business problems into appropriate analytical, machine learning, or Generative AI solutions.
• Collaborate with data scientists, business subject matter experts, and engineering teams to productionize analytical and machine learning solutions.

Generative AI & LLM Engineering
• Design and implement enterprise LLM applications, including Retrieval-Augmented Generation (RAG), document processing, summarization, information extraction, classification, conversational assistants, and agentic workflows.
• Develop LLM solutions using prompt engineering, embeddings, vector search, chunking, grounding, tool/function calling, and structured outputs.
• Evaluate and optimize LLM solutions for accuracy, relevance, hallucination risk, latency, cost, security, and responsible AI considerations.
• Integrate structured enterprise data and unstructured content into secure, governed AI applications.
• Build reusable AI components and APIs for integration into broader enterprise applications.

AI-Assisted Software Engineering
• Leverage GitHub Copilot, Claude, and similar AI-assisted development tools to accelerate software engineering activities.
• Use AI development tools to create, refactor, debug, test, document, review, and maintain production-quality code.
• Apply engineering judgment to validate AI-generated code for security, functionality, performance, maintainability, and compliance with coding standards.
• Identify opportunities to automate repetitive development, analysis, testing, and documentation activities using AI-assisted engineering practices.
Azure, DevOps & Production Engineering
• Build and deploy solutions using Microsoft Azure services, including Azure Databricks, Azure Storage/Data Lake, Microsoft Entra ID, Key Vault, Azure Functions, APIs, and Azure AI services.
• Implement CI/CD and DevOps practices using Azure DevOps and/or GitHub.
• Manage Git-based source control, branching, pull requests, automated testing, build/release pipelines, infrastructure configuration, and environment management.
• Design solutions with appropriate security, identity management, secrets management, logging, monitoring, resilience, scalability, and production support capabilities.
• Partner with architecture, cybersecurity, data governance, infrastructure, and application teams to ensure solutions meet enterprise technology standards.

Insurance Domain & Business Collaboration
• Work closely with underwriters, actuaries, claims professionals, operations teams, data analysts, and other business stakeholders to understand insurance business requirements.
• Analyze commercial insurance data, including submissions, census information, Statements of Values (SOV), loss runs, claims, exposures, and deductibles.
• Understand underwriting processes, specialty and commercial lines, and financial lines to develop relevant data and AI solutions.
• Translate complex insurance workflows and business challenges into scalable data engineering, machine learning, and Generative AI applications.
• Support insurance analytics, underwriting automation, risk assessment, submission processing, and other business initiatives through data-driven solutions.


  • **Only those lawfully authorized to work in the designated country associated with the position will be considered.**

  • **Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client’s business needs and requirements.**

 

Benefits:
For information and details on employment benefits offered with this position, please visit here. Should you have any questions/concerns, please contact our HR Department via our secure website.

California Pay Equity:
For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here.

Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.

If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department.

Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).

 

Apply Now

 

About Rose

  • Founded in 1993
  • Office Locations Across the U.S.
  • 150+ Clients: Corporations and Government Agencies
  • Employee Oriented Company
  • Challenging Assignments Across the U.S.
  • Continuous Professional Development

You are customer service oriented. No matter whether it was the Recruiter or someone in Human Resources/Payroll, you were responsive. That to me is key!

Tonya, Consultant

Thanks for the opportunity. If in the future I ever need a job, I would like to work for Rose International.

David, Consultant

My on-boarding with Rose was outstanding. The packets of information, the process, and great attention to detail each person gave me allowed me to get started quickly.I appreciated each person's friendly and helpful attitude.

Diana, Consultant

It is a great pleasure being a part of the Rose International Team.

Toni, Consultant

As a contractor, I have to say that Rose International was by far the best agency I have worked for.

Q'testdalir, Consultant

EMPLOYEE COMMENTS

  • We want you to work with us, but don't take our word for it. Take a look at this sampling of employee comments. They speak for themselves.