
Microsoft Azure Fabric - Senior Data Engineer IN
- Pune, Maharashtra
- Permanent
- Full-time
- Should be able to work independently and come up with solution design
- Build optimized data processing solutions using the given toolset
- Provide hands on technical leadership and work on multiple projects if required
- Design pipelines to ingest & integrate structured/semi structured and unstructured data from heterogeneous sources
- Collaborate with delivery leadership to deliver projects on time adhering to the quality standards
- Contribute to talent recruitment, competency building and providing mentor-ship to junior resources for these skills
- Strong DWH and ETL conceptual knowledge
- Experience using various components of Microsoft Fabric for storage, Data ingestion and processing, Data governance & reporting
- Design data solutions and data models using Onelake to support DWH, Data Lake and Lakehouse architecture
- Data ingestion for batch & streaming data using Data Factory/ Fabric & Databricks
- Orchestration of data ingestion pipelines using Data Factory or other Azure services
- Hands on experience using Azure purview for governing data assets including Metadata, Data Catalog & Data lineage
- Hands on experience using Azure SQL Database, Azure Analysis Services and Synapse Analytics
- Specific exposure to Microsoft accelerators such as
- Microsoft Fabric Toolbox
- Metadata-Driven Ingestion & Processing
- Experience working with multiple source databases
- Data migration experience from legacy databases or other cloud ecosystems to Microsoft Fabric
- Experience is Spark / Pyspark with some hands on with Databricks is highly desired