Digital Kafka
Q1 Technologies View all jobs
- Bangalore, Karnataka
- Permanent
- Full-time
Job Title: Confluent Kafka Administrator / Platform Engineer Experience: 3+ Years Location: (Add location / Remote / Hybrid) Employment Type: Full-time Job Description We are looking for a Confluent Kafka Administrator with 3+ years of hands-on experience managing, operating, and troubleshooting Kafka clusters in production environments. The ideal candidate will have strong debugging skills, deep understanding of Kafka internals, and solid experience with Linux systems. Experience with AWS, Terraform, and Ansible is a strong plus. Key Responsibilities Administer, operate, and support Confluent Kafka clusters (ZooKeeper and/or KRaft) Perform Kafka cluster provisioning, upgrades, scaling, and patching Monitor cluster health, performance, and capacity using JMX, metrics, and observability tools Troubleshoot and debug Kafka issues including: Broker failures ISR shrink/expand issues Leader elections Replication lag Consumer lag and performance problems Manage Kafka components: Kafka Brokers Kafka Connect Schema Registry REST Proxy / ksqlDB (if applicable) Analyze logs and metrics to perform root cause analysis (RCA) for production incidents Work with application teams to support topic design, partitioning, retention, and performance tuning Ensure high availability, reliability, and data durability of Kafka clusters Implement and maintain security controls (ACLs, TLS, authentication, authorization) Automate Kafka operations using scripts and configuration management tools Participate in on-call support and incident response rotations Required Skills & Qualifications 3+ years of hands-on experience as a Kafka / Confluent Platform Administrator Strong understanding of Kafka architecture and internals: Brokers, partitions, replicas, ISR Leader election and replicationZooKeeper and/or KRaft mode Excellent debugging and troubleshooting skills Strong Linux/Unix experience (processes, networking, file systems, performance tuning) Experience with Kafka monitoring and metrics (JMX, Prometheus, Datadog, Grafana, etc.) Ability to read and analyze Kafka broker logs and JVM metrics Experience working in production environments with high data volume and throughput Good scripting skills (Bash, Shell; Python is a plus) Nice-to-Have / Add-On Skills Experience with AWS services (EC2, EBS, S3, IAM, VPC, MSK or self-managed Kafka on AWS) Infrastructure as Code experience using Terraform Configuration management using Ansible Experience with CI/CD pipelines Knowledge of Kafka security best practices Experience with disaster recovery and multi-cluster Kafka setupsLocation: ~BANGALORE~PUNE~HYDERABAD~
Skills: Digital : Kafka
Experience Required: 4-6