
Hadoop Admin/Consultant Specialist
- Pune, Maharashtra Bangalore, Karnataka
- Permanent
- Full-time
- Design, deploy, and manage kubernetes-based platforms for running data services and applications
- Maintain and scale on-premise or cloud-hosted hadoop clusters ensuring high availability and performance.
- Build CI/CD pipelines using Jenkins, Groovy scripts, and other devops tools for infrastructure and application deployment.
- Automate infrastructure provisioning and management using Terraform and PPython-based scripts.
- Monitor and troubleshoot platform issues across Kubernetes and Hadoop environments
- Collaborate with data engineering, platform and security teams to ensure smooth integration and compliance.
- Drive automation and standardization across environments to improve reliability and reduce manual effort.
- Participate in capacity planning, cost optimization, and platform upgrades/migrations.
- 6-8 years of experience in DevOps, platform engineering, or infrastructure roles.
- Deep hands-on experience with Kubernetes (including custom Helm charts, operators, ingress setup).
- Strong expertise in managing Hadoop ecosystems (HDFS, YARN, Hive, Spark, Impala, etc.)
- Proficiency in Groovy scripting, especially in Jenkins pipelines
- Strong programming/scripting experience with Python & Unix.
- Advances knowledge of Terraform for Infrastructure as Code (iaC).
- Experience with monitoring tools and logging practices.
- Understanding of Cloud-native architecture and hybrid environments.
- Knowledge of Open Data Platform and VAST technology