Azure Data Engineer
- Hyderabad, Telangana
- Permanent
- Full-time
- Work with Azure Data Lake and Azure Data Factory to design, implement, and manage data pipelines.
- Connect various data sources (applications, databases, etc.) to the Azure Data Lake for storage and processing.
- Write PiSpark SQL codes and SSIS packages for data retrieval and transformation from different data sources.
- Design and develop efficient Data Architecture and Data Modeling solutions to support business requirements.
- Create data visualizations to communicate insights to stakeholders and decision-makers.
- Optimize data workflows and pipelines for better performance and scalability.
- Collaborate with cross-functional teams to ensure seamless data integration and delivery.
- Ensure data integrity, security, and compliance with best practices.
- 2+ years of experience working with Azure Data Lake, Azure Data Factory, and related Azure services.
- Proficiency in writing PiSpark SQL codes for data extraction and transformation.
- Experience in developing SSIS packages for data integration and automation.
- Strong understanding of Data Architecture and Data Modeling concepts.
- Experience in creating effective and insightful data visualizations using tools like Power BI or similar.
- Familiarity with cloud-based storage and computing concepts and best practices.
- Strong problem-solving skills with an ability to troubleshoot and optimize data workflows.
- Ability to collaborate effectively in a team environment and communicate with stakeholders.
- Certifications in Azure (e.g., Azure Data Engineer or similar) would be a plus.
- Experience with other Azure tools like Azure Synapse, Databricks, etc.