Senior Data Engineer
Brose Fahrzeugteile
- Pune, Maharashtra
- Permanent
- Full-time
- Design and implement ETL pipelines for productive applications in the automotive industry.
- Create batch and streaming data pipelines for an AWS Datalake. Review and improve existing ETL pipelines with regards with data quality monitoring and data consistency checks.
- Model business problems in relational database models.
- The opportunity to improve the existing Brose Datalake architecture and to plan and set up a future data warehouse solution in AWS.
- Collaborate with our Data Scientists in order to provide scalable solutions for our clients.
- BSc/MSc in computer science, engineering, mathematics, physics or a related field or equivalent professional experience.
- Multiple years of practical experience with analytics projects on AWS within an industry context. Extensive Python programming experience and software-architecture skills.
- Experience with ETL tools like.
- Experience with AWS-specific data processing tools (Kinesis Firehose, Kinesis Streams, Glue Jobs, Glue Crawlers)
- Good knowledge of SQL and experience with data modelling in relational databases (e.g. Postgres). Understanding of NoSQL databases (DynamoDB, MongoDB, Redis) is a plus.
- Experience with GitLab CICD pipelines, Docker, and Terraform is a plus.
- You know and care about software engineering practices like version control, clean code, code review, testing, and automation.
- Pragmatic and structured approach to solving problems. Independent and result-oriented work style as a team player.
- Excellent oral and written communication skills in English - proficiency in German is a plus
- Exp- 3-5 Yrs