Azure Data Engineer
- Bangalore, Karnataka
- Permanent
- Full-time
Position Overview
We are seeking a talented Azure Data Engineer to join our dynamic team. This role involves designing, building, and managing data solutions using the Azure ecosystem. The ideal candidate will work on data integration, transformation, and visualization while ensuring high-quality, secure, and scalable data pipelines.
Responsibilities
- Design, develop, and maintain data pipelines using Azure Data Factory.
- Manage and optimize data storage using Azure Data Lake Gen 2.
- Build and process large-scale data solutions with Azure Databricks and Apache Spark.
- Create interactive reports and dashboards in Power BI for business insights.
- Collaborate with cross-functional IT and business teams to translate requirements into data solutions.
- Ensure data quality, security, and compliance in line with organizational standards.
- Azure Data Factory: Experience in building and managing data pipelines.
- Azure Data Lake Gen 2: Proficient in data storage and management within Azure's data lake environment.
- Azure Databricks / Apache Spark: Hands-on skill with distributed data processing, transformations, and analytics.
- Power BI: Expertise in data visualization and reporting.
- Basic SQL Performance Tuning: Ability to write and optimize SQL queries.
- Data Governance & Unity Catalog: Understanding of data governance principles and experience with Unity Catalog for data management.
- Certification: Microsoft DP-203 (Azure Data Engineer Associate) certification.
- CI/CD Pipelines: Experience implementing CI/CD pipelines for Azure Data Factory or Databricks projects.
- Bachelor's degree in Computer Science, Information Technology, or related field (or equivalent experience).
- 2+ years of professional experience with Azure data services.
- Strong analytical and problem-solving skills.
- Effective communication and team collaboration abilities.
- Continuous learner, staying updated with Azure and data engineering advancements.
- Experience working in Agile environments.
- Passion for optimizing data workflows and enabling data-driven decisions.