Data Science, Java, GCP/ Senior Consultant Specialist
HSBC View all jobs
- Bangalore, Karnataka
- Permanent
- Full-time
- Develop stable and scalable microservices for data processing
- Design, develop, and maintain scalable batch and stream data pipelines on Google Cloud Platform (GCP)
- Deliver dashboards and data visualizations and expand UI capabilities to meet business needs.
- Build and optimize data models in BigQuery for analytics and reporting
- Integrate data from various sources using GCP services using Pub-sub model & Data transfer jobs
- Build connectivity to external data sources to ingest data via the GCP hosted ETL pipelines
- Ensure data quality, integrity, and security across all data processes and manage access controls
- Collaborate with analytics, product, and engineering teams to deliver data solutions
- Monitor and troubleshoot data workflows and performance issues Participate in data governance and compliance initiatives
- Data Engineers often work closely with cross-functional teams to enable data-driven decision-making
- Should have 8 -12 years of development experience with technical skills: Java, Microservices, GCP-Bigquery, SQL, Terraform, Data flow - Apache Beam, Apache Flink, Shell scripts e.g. Powershell/Bash
- Familiarity with cloud data architecture and best practices
- Strong problem-solving and communication skills
- Experience in using BI tools like Google Looker Studio
- Understanding and experience on Unix/Linux system, file systems, shell scripting, SSL, SFTP
- Experience in delivering solutions through Agile methodology - and DevOps tooling such as JIRA, Maven, Ansible etc
- Bachelor’s degree in computer science engineering