Sr. SW Test Engineer (3-5 years of experience in Big Data Testing, Pyspark, ETL Testing, SQL)
Visa View all jobs
- Bangalore, Karnataka
- Permanent
- Full-time
- Design, develop, and maintain automated data quality checks for complex, petabyte-scale data pipelines.
- Build scalable data validation frameworks using PySpark, PyTest, Python, SQL, and Hive, ensuring comprehensive test coverage.
- Partner with Data Engineering and DevOps teams to integrate automated testing into CI/CD pipelines.
- Analyse test results to identify data anomalies, root causes, and remediation strategies.
- Develop and maintain production monitoring and alerting solutions for data quality.
- Document testing standards, frameworks, and best practices, and mentor junior engineers in data quality automation.
- Continuously enhance test frameworks to improve performance, scalability, and reliability.