
HIH - Software Engineering Associate Advisor
- Hyderabad, Telangana Andhra Pradesh
- Permanent
- Full-time
- Design, develop, and maintain ETL processes to integrate data from Teradata into Databricks on AWS cloud
- Optimize and fine-tune Teradata queries, database structures, and data loading strategies to ensure high performance and scalability.
- Create and maintain data mappings, workflows, and sessions in Informatica for data extraction, transformation, and loading.
- Collaborate with data architects, analysts and stewards to define the data requirements and ensure the availability and accuracy of the data for business users
- Monitor and troubleshoot data pipelines, resolving issues related to data integrity, performance, and job failures
- Develop and implement data validations and quality checks to ensure the accuracy and reliability of the data warehouse
- Document technical specifications, processes, and workflows related to Teradata and Informatica development
- Assist in capacity planning, performance tuning and security management
- Partner with other teams and stake holders for any clarifications needed for the timely deliverables.
- Ability to provide alternative solutions.
- Experienced with agile methodology.
- Bachelor’s degree in the related field.
- 8+ years of experience in developer role.
- 6+ years of hands-on experience with Teradata database development, including query optimization.
- Strong knowledge of SQL and proficiency in writing complex queries, stored procedures, and macros in Teradata
- 4+ years of experience with Databricks with focus on distributed data processing frameworks like Apache Spark
- Experience with AWS services such as S3, Glue, Lambda, Airflow and EC2 for building and managing data infrastructures
- Familiarity with Python for data engineering tasks in Databricks
- Experience with data warehousing concepts
- Ability to handle large datasets and optimize ETL performance for data loading and transformation
- Experience with data pipeline scheduling
- Experience with continuous integration and continuous delivery (CI/CD) tools like GitHub, Jenkins etc.
- Excellent problem-solving skills and attention to details
- Strong communication and collaboration skills