GenAI Test Automation Engineer

PB consulting

Tysons Corner, VA

Posted On: Jul 20, 2026

Posted On: Jul 20, 2026

Job Overview

Experience

5 - 10 Years

Salary

Depends on Experience

Work Arrangement

On-Site

Travel Requirement

0%

Required Skills

  • GenAI
  • Test Automation
  • Agentic testing frameworks
Job Description

We are seeking a Senior GenAI Test Automation Engineer with strong experience in AI development, agentic workflows, and intelligent test automation. The ideal candidate will design AI-powered testing solutions, build reusable automation frameworks, and integrate Generative AI capabilities into software quality processes.

Required Qualifications
  • 5+ years of experience in AI development, software engineering, or test automation.
  • Hands-on experience building LLM-powered agents and agentic workflows.
  • Experience using Generative AI tools such as GitHub Copilot and Claude.
  • Strong knowledge of AI-driven test automation, workflow automation, and quality engineering practices.
  • Experience with GitHub platform, CI/CD workflows, and automation pipelines.
Key Responsibilities
  • Design and implement reusable agentic testing frameworks for automated test generation, maintenance, failure analysis, and defect reporting.
  • Develop AI-powered solutions for requirements validation, test case generation, and quality insights.
  • Build automated reporting solutions by aggregating test results, service data, logs, and defect information.
  • Create AI-based quality gates to validate requirements, acceptance criteria, test coverage, and dependencies.
  • Establish test automation standards, templates, and best practices across teams.
Required Technical Skills

GenAI / LLM / Agent Development

  • Experience building LLM-based agents with tool usage, structured outputs, guardrails, and prompt engineering.
  • Experience designing AI workflows for test generation, analysis, and reporting.

Automation & Testing

  • Strong experience with test automation frameworks such as:
    • Karate (API testing, contract testing, data-driven testing)
    • Playwright (UI automation, selectors, parallel execution)
  • Knowledge of test strategy, coverage, regression testing, and defect analysis.

GitHub & DevOps

  • Strong experience with:
    • GitHub Copilot
    • GitHub Actions
    • CI/CD automation
    • Pull request checks and workflow integrations
    • GitHub APIs/webhooks
Preferred Skills
  • Experience with microservices architectures.
  • Experience building AI-assisted engineering tools.
  • Knowledge of cloud platforms, DevOps practices, and Agile methodologies.
Deliverables
  • AI-powered agentic testing automation framework.
  • GenAI-driven reporting and quality insights.
  • Automated quality gates integrated into development workflows.
  • Standardized testing guidelines and reusable templates.

Job ID: PC521813


Posted By

Naincy

Technical Recruiter