Data Engineer (RTS)
GSSTech Group
- Chennai, Tamil Nadu
- Permanent
- Full-time
- Design, build, and maintain scalable data pipelines and ETL/ELT processes.
- Work with structured and unstructured datasets to ensure data quality, accuracy, and availability.
- Collaborate with data scientists, analysts, and business stakeholders to deliver reliable datasets for analytics and reporting.
- Optimize query performance and ensure real-time/near-real-time data processing for RTS.
- Implement data security, governance, and compliance standards.
- Troubleshoot data-related issues and ensure system reliability and scalability.
- Stay updated with emerging tools and best practices in big data and cloud-based data engineering.
- 5–8 years of proven experience as a Data Engineer or in a similar role.
- Strong proficiency in SQL, Python, or Scala.
- Hands-on experience with big data technologies (Hadoop, Spark, Kafka, Hive, etc.).
- Experience with cloud platforms (AWS, Azure, or GCP) and their data services (e.g., Redshift, Snowflake, BigQuery, Data Lake).
- Strong understanding of ETL/ELT frameworks, data warehousing, and data modeling.
- Experience with real-time data streaming and processing frameworks.
- Good knowledge of CI/CD, version control (Git), and DevOps practices.
- Excellent problem-solving and communication skills.
- Experience in containerization and orchestration (Docker, Kubernetes, Airflow, etc.).
- Knowledge of data governance and security best practices.
- Familiarity with machine learning pipelines.
- Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.