
Big Data Developer- Pan India
- Chennai, Tamil Nadu
- Permanent
- Full-time
- Design and implement big data solutions using the Hadoop ecosystem (HDFS, MapReduce, Hive, Pig, HBase, etc.)
- Develop data ingestion pipelines using tools such as Sqoop, Flume, Kafka, and NiFi.
- Build and maintain ETL jobs using Apache Spark or Hive.
- Optimize data processing performance and manage large-scale data infrastructure.
- Ensure data quality, integrity, and security in all big data operations.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Monitor and troubleshoot production systems and data pipelines.
- Maintain and improve the scalability and performance of big data environments.
- Automate operational workflows using scripts (Python, Shell, etc.)