Job Title:
AI Red Teaming Specialist
Company: beBeeAdversarial
Location: Amravati, Maharashtra
Created: 2025-10-14
Job Type: Full Time
Job Description:
Job Title: AI Red Teaming Specialist We are seeking highly analytical and detail-oriented professionals to rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards. Conducting adversarial testing exercises to identify harmful or unsafe outputs from large language models (LLMs) Evaluating and stress-testing AI prompts across multiple domains Developing and applying test cases to assess accuracy, bias, toxicity, hallucinations, and misuse potential in AI-generated responses Collaborating with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations Performing manual quality assurance and content validation across model versions Creating evaluation frameworks and scoring rubrics for prompt performance and safety compliance Requirements: Proven experience in AI red teaming, LLM safety testing, or adversarial prompt design Familiarity with prompt engineering, NLP tasks, and ethical considerations in generative AI Strong background in Quality Assurance, content review, or test case development for AI/ML systems Understanding of LLM behavior, failure modes, and model evaluation metrics Excellent critical thinking, pattern recognition, and analytical writing skills Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines