Senior Data Engineer

Bangalore, Karnataka
Permanent
Full-time

8 days ago
Apply easily

About Delta Air LinesAbout the CompanyDelta Air Lines (NYSE: DAL) is the U.S. global airline leader in safety, innovation, reliability and customer experience. Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-winning customer service. With our mission of connecting the people and cultures of the globe, Delta strives to foster understanding across a diverse world and serve as a force for social good.In 2024, Delta was recognized by Fortune with a No. 11 placement on Fortune’s Top 50 Most Admired Companies list. The company’s strong management and commitment to providing elevated experiences and premium products also secured a No. 1 ranking out of the eight airlines on the list. Delta landed on TIME’s inaugural list of the “World’s Best Companies,” coming in at No. 12 – the only U.S. airline in the top 155. TIME’s award is based on three criteria: employee satisfaction, revenue growth and sustainability.Delta’s people-first culture continues to be recognized, earning the airline a spot on Fortune’s 100 Best Companies to Work For® list for the fifth year. Delta is the only airline included on the 2024 list.Additionally, Delta earned a coveted spot, on Fast Company’s list of the Most Innovative Companies, climbing from its No. 8 spot in 2023 to No. 2 in the travel category. The airline was recognized for its Wi-Fi revolution that is working to ensure the future of travel is connected.About the Delta Technology Hub (DTH), BangaloreDelta has fast emerged as a customer-focused, innovation-led, technology-enabled business. The Delta Technology Hub will contribute directly to these objectives.Job DescriptionAbout Delta Tech Hub:Delta Air Lines (NYSE: DAL) is the U.S. global airline leader in safety, innovation, reliability and customer experience. Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-winning customer service. With our mission of connecting the people and cultures of the globe, Delta strives to foster understanding across a diverse world and serve as a force for social good. Delta has fast emerged as a customer-oriented, innovation-led, technology-driven business. The Delta Technology Hub will contribute directly to these objectives. It will sustain our long-term aspirations of delivering niche, IP-intensive, high-value, and innovative solutions. It supports various teams and functions across Delta and is an integral part of our transformation agenda, working seamlessly with a global team to create memorable experiences for customers.Responsibilities:Data Pipeline Development and Maintenance:

Build and optimize scalable ETL/ELT pipelines to ingest data from diverse sources such as APIs, cloud platforms, and databases.
Ensure pipelines are robust, efficient, and capable of handling large volumes of data.

Data Integration and Harmonization:

Implement data transformation and enrichment processes to support analytics and reporting needs.

Data Quality and Monitoring:

Troubleshoot and resolve issues related to data quality, latency, or performance.

Collaboration with Stakeholders:

Provide technical support and guidance on data-related issues or projects.

Tooling and Automation:

Leverage cloud-based solutions and frameworks (e.g., AWS) to streamline processes and enhance automation.
Maintain and optimize existing workflows while continuously identifying opportunities for improvement.

Documentation and Best Practices:

Document pipeline architecture, data workflows, and processes for both technical and non-technical audiences.
Follow industry best practices for version control, security, and data governance.

Continuous Learning and Innovation:

Stay current with industry trends, tools, and technologies in data engineering and marketing analytics.
Recommend and implement innovative solutions to improve the scalability and efficiency of data systems.

What you need to succeed (minimum qualifications):

Bachelor of Science degree in Computer Science or equivalent
At least 3+ years of experience as a data engineer developing and maintaining data pipelines
Strong experience with databases and data platforms (AWS preferred)
Proficiency in Python, SQL, PySpark
Experience in Data Quality, Data Modeling, Data Analytics/BI, Data Enrichment.
Understanding of concepts such as normalization, SCD (Slowly changing dimensions) and CDC (Change data capture)
Experience in working on streaming event platforms such as Kafka/Kinesis
Knowledge of non-relational databases
Preferable experience in DBT for data transformation and modeling.
Good understanding of data warehouses, ETL/ELT, AWS architecture (using Glue, SQS, SNS, S3, step functions etc.,)
Understanding of orchestration tools such as Airflow
Ability to create clean, well-designed code and systems
Strong attention to detail and a commitment to data accuracy.
Proven ability to learn new data models quickly and apply them effectively in a fast-paced environment.
Ability to work collaboratively in a team environment.

ID: DELRM04

Delta Air Lines