Product-Aligned Agentic Quality Engineering Lead (Automation & Agentic AI)

We are hiring a senior Quality Engineering leader who owns end-to-end quality, release sign-off, and automation strategy across our platform — including AI agents, web applications, APIs, and databases.This role blends:Quality OwnershipAutomation & Agentic Testing LeadershipRelease & Go-Live AuthorityProduct-aligned execution (PO-style ownership)You will start by establishing strong manual and exploratory testing foundations, then systematically drive automation-first quality, including AI agent validation, critic agents, eval frameworks, and safety guardrails.This is not a passive QA role.You are accountable for production quality.Key ResponsibilitiesEnd-to-End Quality Ownership & Release Sign-OffOwn quality outcomes across the full delivery lifecycleAct as release authority, driving go/no-go decisionsDefine and enforce quality gates across features, agents, and releasesPartner with Product and Engineering to balance speed and qualityReduce production defects through proactive automation and validation Automation-First Quality StrategyDefine and own the automation roadmap (UI, API, DB, agentic systems)Build and maintain hybrid automation frameworks using PythonDrive CI/CD-integrated automated testing pipelinesEnsure automation coverage continuously replaces repetitive manual testingGuide aligned Quality Engineers in automation implementation Agentic AI & LLM Quality EngineeringOwn quality for AI agents, tool calls, and multi-step workflowsValidate:Agent behavior & reasoning pathsTool invocation correctnessHallucinations & unsafe outputsRAG accuracy and groundingDefine and execute agent evaluation (evals) frameworksCollaborate with Critic Engineers to design:Critic agentsAutomated agent validationBenchmark datasets & scoring rubricsLead innovation in agent testing methodologies Manual, Exploratory & Scenario-Based TestingDrive high-quality manual and exploratory testing where automation is not yet viableDesign test scenarios covering edge cases, failure modes, and real-world flowsEnsure strong test data strategies and defect lifecycle managementUse manual testing strategically — not as a long-term crutch Product-Aligned OwnershipWork as a quality-focused Product Owner partnerAlign closely with Product Managers on acceptance criteria and readinessParticipate in sprint planning, refinement, and release discussionsEnsure quality is embedded into feature design, not added later Cross-Team CollaborationWork closely with:ProductEngineeringAgenticOpsRAG & AI teamsAct as the single quality voice across delivery discussionsMentor and guide aligned Quality Engineers and contributors Required Skills & ExperienceQuality & Manual Testing5+ years of strong hands-on experience in manual and exploratory testingDeep understanding of SDLC/STLC, test planning, traceability, and defect managementStrong API testing experience (Postman, REST clients) Automation (UI, API, Database)Strong experience in:UI automation (Playwright / Selenium / Cypress)API automation (pytest, requests, REST Assured)Database validation using SQLExperience designing end-to-end automation frameworksCI/CD integration (GitHub Actions, GitLab, Jenkins) Agentic AI & LLM TestingHands-on experience testing LLMs and AI agentsUnderstanding of:Agent workflowsTool callingRAG pipelinesGuardrails & safety validationExperience designing or executing eval frameworks Python, MCP & CloudStrong Python skills for automation, utilities, and validationUnderstanding of MCP servers, agent tools, and orchestrationCloud exposure (GCP / AWS / Azure) in QA or automation contexts What Success Looks LikeReleases go out predictably and confidentlyAutomation coverage grows sprint after sprintAgent failures are caught before productionQuality becomes a shared responsibility, led by youManual testing effort reduces as automation and agent critics mature Why This Role Is SpecialOwns release sign-offDrives automation-first qualityShapes how agentic AI is testedWorks closely with Product & CTOLeads innovation in AI testingNot a test executor roleNot a checkbox QA position

Apply Now