
Staff Software Engineer (Data Analytics Platform)
- Hyderabad, Telangana
- Permanent
- Full-time
- Design and develop a sophisticated data infrastructure for streaming, processing, and storage, aligned with a modern Lakehouse architecture.
- Build and maintain tools for effective data monitoring and management using best practices in data engineering.
- Lead key architectural decisions and implement significant data pipeline initiatives using the latest technologies.
- Collaborate with various stakeholders to deliver scalable and performant data solutions, supporting all aspects of data handling from extraction to loading.
- Promote knowledge sharing within the team, encouraging best practices for a data-driven culture.
- Ensure robust data governance and compliance with developed data retention, backup strategies, and secure storage solutions.
- Leading a team of 4-5 data engineers
- Bachelor's or Master's degree in Computer Science or related field from a top university.
- Over 8 years of experience in data infrastructure, with a proven track record in building scalable and high-performance data systems.
- Deep expertise in SQL and extensive experience with relational and NoSQL databases.
- Advanced proficiency in Apache Kafka, Hadoop ecosystem, and stream-processing systems like Spark Streaming.
- Familiarity with big data tools (Pig, Hive, Spark), data serialization frameworks (Protobuf, Thrift, Avro), and workflow management using Apache Airflow.
- Knowledge of data catalog tools such as Open Metadata and Unity Catalog is highly desirable.
- Experience with infrastructure as code (e.g., Terraform, Ansible) and CDC technologies (e.g., Maxwell, Debezium) is advantageous.