Senior Python ETL Developer/Lead
- Bangalore, Karnataka
- Permanent
- Full-time
- Design, develop, and maintain ETL processes to support data integration and data warehousing.
- Lead a team of ETL developers, providing technical guidance and mentoring.
- Collaborate with data architects, business analysts, and other stakeholders to gather requirements and design solutions.
- Utilize open-source tools and libraries, including PySpark, to enhance ETL processes.
- Optimize and troubleshoot ETL processes to ensure timely and accurate data load.
- Develop and implement best practices for ETL development and data management.
- Perform data quality checks and validations to ensure data integrity.
- Create and maintain comprehensive ETL documentation.
- Stay updated with the latest trends and advancements in ETL and data integration technologies.
- Contribute to continuous process improvement initiatives.
- Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
- 5+ years of experience in ETL development using Python.
- Experience with open-source ETL tools and libraries such as Apache Airflow, PySpark, and Pandas.
- Experience in development of database processes using Oracle SQL, PL/SQL
- UNIX and/or Windows environments
- Scripting such as Shell, Perl
- Object Oriented Analysis and Design (OOAD)
- Service Oriented Architecture (SOA)
- Strong understanding of data warehousing concepts, data modeling, and data integration.
- Excellent problem-solving skills and attention to detail.
- Ability to lead and mentor a team of developers.
- Strong communication and collaboration skills.
- Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).
- Familiarity with version control systems (e.g., Git).
- Experience in Agile/Scrum development methodologies.
Expertia AI Technologies