GCP Data Engineer
- Bangalore, Karnataka
- Permanent
- Full-time
Role name: Developer
Role Description: Pyspark , Data engineer Developer
Competencies: Digital : Google Data Engineering, Digital : PySpark
Experience (Years): 6-8
Essential Skills: Pyspark , Data engineer Developer
Roles and ResponsibilitiesDesign, develop, and deploy scalable and reliable data pipelines using GCP services such as:BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Composer, Cloud FunctionsImplement ETL/ELT processes to ingest, transform, and store structured and unstructured data.Collaborate with Data Scientists, Analysts, and Business Stakeholders to define data requirements and deliver data products.Optimize data processing workflows for performance, cost, and reliability.Ensure data quality, security, and compliance with governance policies.Monitor and troubleshoot production data pipelines and workflows.Develop CI/CD pipelines for data workflows using tools like Cloud Build, GitLab CI/CD, etc.