
Deputy Manager _ GCP Data Engineer - BI
- Pune, Maharashtra
- Permanent
- Full-time
- Automate Machine Learning Models and ML pipelines on Google Cloud
- Optimize Cloud processes with respect to cost, runtime and stability
- Develop real-time streaming applications using Kafka, Pub/Sub and similar technologies
- Professional Google Cloud Data Engineer
- Analytical technical skills to be able to predict the consequences of configuration changes (impact analysis), to identify root causes that are not obvious and to understand the business requirements.
- Excellent communication with different stakeholders (business, technical, project)
- Good understading of the overall Big Data and Data Science ecosystem
- Relevant work experience (5-9) years
- Experience with buiding and deploying containers as services using Swarm/Kubernetes
- Good understanding of container concepts like buiding lean and secure images
- Understanding modern DevOps pipelines
- Experience with stream data pipelines using Kafka or Pub/Sub (mandatory for Kafka resources)
- Strong programming experience in OOP language like Python, Java or Scala
- Experience working in agile projects
- Design, build & manage Big data ingestion and processing applications on Google Cloud using Big Query, Dataflow, Composer, Cloud Storage, Dataproc
- Performance tuning and analysis of Spark, Apache Beam (Dataflow) or similar distributed computing tools and applications on Google Cloud
- Good understanding of google cloud concepts, environments and utilities to design cloud optimal solutions for Machine Learning Applications
- Build systems to perform real-time data processing using Kafka, Pub-sub, Spark Streaming or similar technologies
- Manage the development life-cycle for agile software development projects
- Convert a proof of concept into an industrialization for Machine Learning Models (MLOps).
- Provide solutions to complex problems.
- Deliver customer-oriented solutions in a timely, collaborative manner
- Proactive thinking, planning and understanding of dependencies
- Develop & implement robust solutions in test & production environments.