Senior Data Engineer
- Hyderabad, Telangana
- Permanent
- Full-time
- Develop Real Time Streaming & Batch Data Pipelines.
- Deliver high-quality data engineering components and services that are robust and
scalable.
- Collaborate and communicate effectively with cross-functional teams to ensure
delivery of strong results.
- Employ methodical approaches to Data Modeling, Data Quality, and Data Governance.
- Provide guidance on architecture, design, and quality engineering practices to the
team.
- Leverage foundational Data Infrastructure to support analytics, BI, and visualization
layers.
- Work closely with data scientists on feature engineering, model training frameworks,
and model deployments at scale.
What are we looking for?
- BS/MS in Computer Science or related field, or an equivalent combination of education
and experience.
- A minimum of 6 years of experience in software engineering, with hands-on
experience in building data pipelines and big data technologies.
- Proficiency with Big Data technologies such as Apache Spark, Apache Iceberg, Amazon
Redshift, Athena, EMR, and other AWS services (S3, Lambda, EMR).
- Expertise in at least one programming language: Python, Java, or Scala.
- Extensive experience in designing and building data models, integrating data from
various sources, building ETL/ELT and data-flow pipelines, and supporting all parts of the
data platform.
- Expert-level SQL programming knowledge and experience.
- Experience with any enterprise reporting and/or data visualization tools like Strategy,
Cognos, Tableau, Looker, PowerBI, Superset, QlikView etc.
- Strong data analysis skills, capable of making data-driven arguments and effective
visualizations.
- Energetic, enthusiastic, and detail-oriented.Bonus Points
- Experience in e-commerce/retail domain.
- Knowledge on StarRocks.
- Knowledge in Web Services, API integration, and data exchanges with third parties.
- Familiarity with basic statistical analysis and machine learning concepts.
- A passion for producing high-quality analytics deliverables.