Data Engineer – AWS Glue, Redshift,, PySpark
Cyepro Solutions
- Hyderabad, Telangana
- Rs. 6,00,000 per year
- Permanent
- Full-time
- AWS Glue (Mandatory skill) - Extensive experience in using AWS Glue for data integration and ETL processes.
- PySpark (Mandatory skill) - Proficient in developing data processing frameworks and workflows using PySpark.
- Redshift (Mandatory skill) - In-depth knowledge and experience in optimizing and managing Amazon Redshift clusters.
- Python - Strong programming skills in Python for data manipulation and analysis.
- ETL - Experience with Extract, Transform, Load (ETL) processes in large-scale data environments.
- Strong analytical and troubleshooting skills for resolving data processing issues effectively.
- Ability to work collaboratively in a team and communicate effectively with technical and non-technical stakeholders.
- Familiarity with data modeling and database design concepts, ensuring the reliability and efficiency of data systems.
- Design, develop, and maintain scalable ETL processes using AWS Glue and PySpark.
- Optimize Redshift clusters for performance, ensuring data accuracy and efficiency in processing.
- Collaborate with cross-functional teams to understand data needs and deliver appropriate data solutions.
- Develop and automate data pipelines to support data analytics and business intelligence efforts.
- Monitor and troubleshoot data workflow issues to ensure data reliability and availability.
- Participate in code reviews and provide constructive feedback to maintain code quality standards.
- Document data processes and pipelines to facilitate knowledge sharing and stakeholder understanding.
- Stay updated with the latest industry trends and best practices in data engineering and AWS services.
Expertia AI Technologies