
Software Engineer 3 - Data Platform
- Hyderabad, Telangana
- Permanent
- Full-time
Optimizing existing data platforms and infrastructure while exploring other technologies
Provide technical leadership to the data engineering team on how data should be stored and processed more efficiently and quickly at scale
Build and scale stream & batch processing platforms using the latest open-source technologies
Work with data engineering teams and help with reference implementation for different use cases
Improve existing tools to deliver value to the users of the platform
Work with data engineers to create services that can ingest and supply data to and from external sources and ensure data quality and timelinessWhat Are We Looking For?Bachelor's degree in Computer Science or a related field, or equivalent combination of education and experience.
4+ years of software development experience with at least 2+ years of experience on open-source big data technologies
Knowledge of common design patterns used in Complex Event Processing
Knowledge in Streaming technologies: Apache Kafka, Kafka Streams, KSQL, Spark, Spark Streaming
Proficiency in Java, Scala
Strong hands on experience in SQL, Hive, Spark SQL, Data Modeling, Schema design.
Experience and deep understanding of traditional, NoSQL and columnar databases
Experience of building scalable infrastructure to support stream, batch and micro-batch data processing