Sr Technology Engineer - Hadoop

GSSTech Group

Bangalore, Karnataka
Permanent
Full-time

2 months ago
Apply easily

About the Role:We are hiring a Senior Technology Engineer with strong expertise in Hadoop-based Big Data ecosystems, automation, and DevOps tools. The role is pivotal in designing and implementing scalable, secure, and high-availability infrastructure, driving banking client’s data strategy by transforming data management and analytics platforms.Key Responsibilities:

Hadoop Ecosystem Implementation:

Architect and manage big data solutions using Hadoop, Spark, Kafka, Hive, and related components. * Infrastructure as Code & Automation:Build and maintain IaC using Terraform or Ansible. Ensure 100% automated deployment pipelines. * DevOps and CI/CD:Design CI/CD pipelines using Jenkins, GitOps, and integrate with containerized environments (Docker/Kubernetes/OpenShift). * Security & Governance:Implement enterprise-grade security mechanisms (e.g., Kerberos, LDAP, TLS) and align with Data Governance best practices. * Monitoring and Optimization:Set up observability tools (Prometheus, Grafana, ELK) and performance optimization processes. * Collaboration:Work closely with cross-functional teams including architects, developers, and business analysts to translate requirements into reliable solutions.Required Qualifications:

Education:

Bachelor’s or Master’s degree in Computer Science, Engineering, or related field. * Experience:8+ years in IT, with at least 3+ years in Big Data platforms and architecture.
Proven experience in the banking or financial services domain.Technical Skills:

Deep expertise in the Cloudera Hadoop (CDP) stack, including versions 7.1.7 to 7.1.9.
Experience with Kerberos, LDAP/AD integration, and TLS security.
Hands-on with CI/CD, Jenkins, Git, Linux CLI, Bash/Python scripting.
Strong understanding of Distributed Data Architecture, Data Quality, Metadata Management, and Data Governance.
Experience with BI tools like Power BI and Tableau is a plus.

Soft Skills:

Excellent problem-solving, communication, and stakeholder management.
Ability to work in fast-paced, matrixed environments.
Self-driven, organized, and adaptable with mentoring capabilities.

Preferred Certifications (Nice to Have):

Hadoop/Big Data Certifications
Kubernetes/OpenShift/Cloud certifications
DevOps tools certifications

GSSTech Group