Data Engineer- GCP
NucleusTeq
- Bangalore, Karnataka Indore, Madhya Pradesh
- Permanent
- Full-time
- Programming Languages: Proficient in Python, Scala, SQL, and Shell Scripting for data processing, transformation, and automation.
- Cloud Platform Expertise: Hands-on experience with Google Cloud Platform (GCP) services, including but not limited to BigQuery, BigTable, Cloud Composer, Dataflow, Google Cloud Storage, and Identity and Access Management (IAM).
- Version Control and CI/CD: Implement and maintain version control using Git and establish continuous integration/continuous deployment (CI/CD) pipelines for data processing workflows.
- Jenkins Integration: Experience with Jenkins for automating the building, testing, and deployment of data pipelines.
- Data Modeling: Work on data modeling and database design to ensure optimal storage and retrieval of data.
- Performance Optimization: Identify and implement performance optimization techniques for large-scale data processing.
- Collaboration: Collaborate with cross-functional teams, including data scientists, analysts, and other engineers, to understand data requirements and deliver solutions.
- Security and Networking: Possess basic knowledge of GCP Networking and GCP IAM to ensure secure and compliant data processing.
- Documentation: Create and maintain comprehensive documentation for data engineering processes, workflows, and infrastructure.
- Strong programming skills in Python, Scala, SQL, and Shell Scripting.
- Hands-on experience with GCP services, including BigQuery, BigTable, Cloud Composer, Dataflow, Google Cloud Storage, and Identity and Access Management (IAM)
- Familiarity with version control using Git and experience in implementing CI/CD pipelines.
- Experience with Jenkins for automating data pipeline processes.
- Basic understanding of GCP Networking.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.