
Mid/Senior Software Test Engineer - AI Modules
- Pune, Maharashtra
- Permanent
- Full-time
- Design, develop, and execute test plans and test cases for AI modules.
- Collaborate with the development team to understand AI algorithms and their implementation.
- Perform functional, regression, and performance testing on AI models and systems.
- Identify, document, and track defects and inconsistencies in AI modules.
- Develop automated test scripts to improve testing efficiency.
- Analyze test results and provide detailed reports to stakeholders.
- Ensure compliance with industry standards and best practices in AI testing.
- Continuously improve testing processes and methodologies.
- Bachelor's degree in computer science, Engineering, or equivalent.
- Proven experience in software testing, with a focus on AI modules.
- Strong understanding of AI and machine learning concepts.
- Proficiency in programming languages such as Python, Java.
- Experience with testing frameworks and tools (e.g., Selenium, BDD Cucumber).
- Familiarity with AI/ML libraries and frameworks (e.g., TensorFlow, PyTorch).
- Excellent analytical and problem-solving skills.
- Strong communication and teamwork abilities.
- Attention to detail and a commitment to quality.
- Knowledge about testing of Retrieval Augmented Generation pipelines, Agentic AI workflows and concepts like Agent to Agent and Model Context Protocol.
- Knowledge of evaluation metrics like BLEU, ROUGE, METEOR, BERTScore, COMET.
- Experience with cloud platforms (e.g., AWS, Azure, Google Cloud).
- Knowledge of data science and statistical analysis.
- Certification in software testing or AI/ML.