AWIGN EXPERT- Azure Data Engineer
Nexthire
- India
- Permanent
- Full-time
- 3 to 6 Years of IT & Azure Data engineering technologies experience
- Prior experience in ETL, data pipelines, and data flow techniques using Azure Data Services
- Working experience in Python, Py Spark, Azure Data Factory, Azure Data Lake Gen2, Databricks, Azure Synapse, and file formats like JSON & Parquet.
- Experience in creating ADF Pipelines to source and process data sets.
- Experience in creating Databricks notebooks to cleanse, transform, and enrich data sets.
- Development experience in the orchestration of pipelines
- Good understanding of SQL, Databases, and data warehouse systems, preferably Teradata
- Experience in deployment and monitoring techniques
- Working experience with Azure DevOps CI/CD pipelines to deploy Azure resources.
- Experience in handling operations/Integration with source repository
- Must have good knowledge of Data Warehouse concepts and Data Warehouse modelling.
- Working knowledge of SNO, M, S, including resolving incidents, handling Change requests /Service requests, and reporting on metrics to provide insights.
- Collaborate with the project team to understand tasks to model tables using data warehouse best practices and develop data pipelines to ensure the efficient delivery of data.
- Work with project leaders to model tables using data warehouse best practices and develop data pipelines to ensure the efficient delivery of data.
- Think and work agile, from estimation to development, including testing, continuous integration, and deployment.
- Manage numerous project tasks concurrently and strategically, prioritizing when necessary.
- Proven ability to work as part of a virtual team of technical consultants working from different locations (including onsite) around project delivery goals.
- Azure data factory
- Azure Data bricks
- Azure Synapse
- PySpark/SQL
- ADLS, BLOB
- Azure DevOps with CI/CD implementation.