
Senior DevOps Engineer IRC261537
- Noida, Uttar Pradesh
- Permanent
- Full-time
- Strong experience with MS SQL Server and Snowflake
- Solid knowledge of AWS cloud services (e.g., S3, EC2, Glue, Lambda)
- Proficient in Python and C# for scripting, API integration, and data processing
- Experience working with Apache NiFi for data ingestion and orchestration
- Hands-on with Apache Airflow for scheduling and managing workflows
- Proficient in Apache Spark for big data processing and transformation
- Experience working with Qubole or similar data lake platforms
- Strong problem-solving skills and attention to detail
- Excellent communication and collaboration abilities
- Design and develop scalable ETL/ELT pipelines using Apache NiFi, Airflow, and Spark
- Implement and manage data workflows across AWS cloud services, including data ingestion, transformation, and storage
- Develop and optimize queries in MS SQL and Snowflake for efficient data retrieval and reporting
- Collaborate with data scientists, analysts, and application developers to ensure reliable and timely data delivery
- Build and maintain data lake solutions on Qubole, ensuring data quality, governance, and security
- Write clean, efficient code in Python and C# for automation, integration, and backend data processing tasks
- Ensure pipeline and job reliability through monitoring, alerting, and error handling
- Participate in performance tuning and optimization of data jobs and warehouse structures
- Drive best practices for data modeling, metadata management, and documentation