Senior Officer - Data QA

About the Company:
At Almosafer Travel & Tourism Co, we’re not just part of the travel industry, we’re helping shape its future.
As Saudi Arabia’s leading travel company, we serve millions across every segment of the travel and tourism ecosystem.
Rooted in our name “Almosafer,” meaning the traveler, we strive to make every journey seamless, personal, and purposeful. Our diverse platforms and services are built to deliver enriching experiences that reflect the spirit of Saudi Arabia and the wider region.

We’re united by a bold vision:
To be the undisputed leader in travel services, fostering lasting connections and setting new benchmarks for excellence in the Kingdom and beyond.
Our team across Saudi Arabia and the wider region blends deep cultural understanding with forward-thinking innovation, shaping a new standard for travel in the region.

About the Role:
We are looking for a Data QA & AI Testing Engineer to join our team and support the quality, reliability, and performance of our data, AI, and machine learning solutions. This role is suitable for someone with a strong interest in data quality, software testing, automation, and emerging AI technologies. The candidate will work closely with Data Scientists, Data Engineers, and ML Engineers to validate data pipelines, test AI/ML solutions, identify issues, and improve overall product quality.

Responsibilities:

• Data Quality & Testing: Execute data quality checks to validate data accuracy, completeness, and consistency. Perform source-to-target validation and reconciliation, investigate data anomalies using SQL and Python, and support regression testing for data pipelines and production solutions.
• Test Automation: Develop, maintain, and execute automated test cases using Python and testing frameworks such as PyTest. Contribute to improving existing automation frameworks and reducing manual testing efforts.
• AI & Machine Learning Testing: Validate AI/ML model outputs against expected business requirements, identify inconsistencies, and support testing activities related to model accuracy, reliability, and data quality.
• Generative AI & LLM Testing: Perform prompt-based and scenario-based testing for GenAI, LLM, and RAG applications. Evaluate responses for accuracy, relevance, and consistency, and identify issues such as hallucinations and unexpected model behavior.
• AI Tools & Workflows: Work with AI-assisted development tools and existing AI agent configurations. Understand and use prompt instructions, skills files, and MCP integrations as part of AI-powered testing workflows.
• Collaboration: Work closely with Data Scientists, Data Engineers, ML Engineers, and Product teams to understand requirements, prepare test scenarios, execute testing, document defects, and support root-cause analysis.

Profile Requirements: 

• Bachelor's degree in Computer Science, Data Science, Engineering, or a related field.
• 2–4 years of experience in Software QA, Data QA, Data Engineering, or a related technical role.
• Good programming skills in Python and SQL.
• Practical experience with automated testing frameworks, preferably PyTest or similar tools.
• Understanding of data quality concepts, data validation, and basic machine learning fundamentals.
• Basic understanding of prompt engineering and experience testing AI/LLM-based applications.
• Familiarity with AI agent workflows, including skills files, configuration, and instruction files.
• Familiarity with MCP (Model Context Protocol) and its role in AI/LLM integrations.
• Exposure to Claude Code or similar AI-assisted development tools.
• Strong analytical, problem-solving, and communication skills.
• Ability to investigate issues, document findings, and work collaboratively within a technical team.
• Practical exposure to Generative AI, LLM applications, or RAG architecture.
• Familiarity with AI evaluation tools such as Ragas, TruLens, or DeepEval.
• Basic understanding of LLM concepts, hallucinations, model accuracy, and data/model drift.
• Exposure to AI platforms such as OpenAI, Anthropic, or Llama.
• Familiarity with cloud platforms such as AWS, Azure, or GCP.
• Basic understanding of CI/CD processes and automated test execution.

Being you @ Almosafer:
At Almosafer, our teams work with purpose, clarity, and a shared commitment to doing things the right way. Whether you're building platforms, supporting travelers, or shaping strategy, your work connects to something bigger. Across functions and locations, we value accountability, trust, and collaboration - and we create the structure and space for you to contribute meaningfully from day one.

Here, you will find:
A purpose-led workplace where your ideas can create real impact
Ongoing learning and development to help you grow with intention
Recognition that celebrates your wins, both big and small
A community built on trust, curiosity, and shared momentum

No matter where your journey started, at Almosafer, you will find space to grow, connect, and contribute meaningfully.