
Data Engineer
- Gurgaon, Haryana
- Permanent
- Full-time
- Design, build, and maintain scalable data infrastructure and pipelines
- Oversee data collection, transformation, and storage strategies to ensure data integrity and efficiency
- Collaborate with cross-functional teams including data science, analytics, product management, and IT
- Ensure optimal data pipeline architecture and troubleshoot issues as they arise
- Establish processes for data quality, validation, monitoring, and reporting
- Stay updated with the latest technologies and implement best practices in data engineering
- Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
- Bachelor's or Master's degree in Computer Science, Engineering, or related field
- 3+ years of experience in data engineering
- 3+ years of experience in SQL, Python, PySpark, and/or Scala programming languages
- 3+ years of hands-on experience with Databricks or similar big data processing platforms
- Experience in implementing data governance frameworks and security best practices
- Solid understanding of data warehousing, ETL (Extract, Transform, Load) processes, and data modeling
- Familiarity with big data technologies (e.g. Spark, Kafka)
- Proven excellent problem-solving skills and attention to detail