Senior Data Engineer - Data Cloud
Qatar Airways View all jobs
- Ahmedabad, Gujarat
- Permanent
- Full-time
- Design and develop scalable data pipelines and architectures using Google Cloud Platform (GCP) services.
- Create and maintain optimum data pipeline architecture for ingestion, storage, processing & transformation of data for building data products for analytics
- Implement data integration solutions to consolidate data from various sources.
- Build the optimal data extraction & transformation mechanisms for various kinds of data.
- Optimize data storage and retrieval processes for performance and cost-efficiency.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Ensure data quality, integrity, and security across all data processes.
- Conduct pro-active performance and fine tuning for early detection and rectification of slow response, application errors, tuning, and implement corrective and preventive actions.
- Monitor and troubleshoot data pipeline issues to ensure continuous data flow.
- Build data pipelines which are scalable, resilient and sustainable to address business requirements.
- Excellent problem-solving skills and attention to detail.
- Stay updated with the latest trends and best practices in data engineering and Google Cloud technologies.
- Proven experience as a Senior Data Engineer, with a focus on Google Cloud Platform (GCP).
- Strong proficiency in GCP services such as BigQuery, Dataproc, Dataflow, Pub/Sub, Cloud Composer, and Cloud Storage.
- Expertise in SQL and database management.
- Experience with ETL processes and tools.
- Proficiency in Python programming language.
- Knowledge of data modeling, data warehousing, and data lakes.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
- Experience with machine learning and AI frameworks.
- Knowledge of containerization and orchestration tools.
- Experience with data visualization tools (Tableau, PowerBI, Looker).
- Understanding of data governance and compliance standards.
- Knowledge of airline domain
- Knowledge of agile/lean development methodologies