
Senior Data Engineering Analyst - ADF, Python, ETL, SQL
- Bangalore, Karnataka
- Permanent
- Full-time
- Design, develop, and maintain robust and scalable data pipelines using Azure Data Factory, Databricks, and Synapse Analytics
- Build and optimize ETL/ELT workflows for structured and unstructured data sources
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality datasets
- Implement data quality checks, monitoring, and alerting mechanisms
- Develop and maintain data models, data marts, and analytical datasets for reporting and machine learning use cases
- Ensure data security, compliance, and governance across all data engineering processes
- Participate in sprint planning, code reviews, and architectural discussions
- Mentor junior data engineers and contribute to best practices in data engineering
- Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
- Data & AI Skills:
- Experience working with large-scale data platforms and big data technologies
- Exposure to ML model deployment pipelines
- Understanding of data governance, lineage, and cataloging tools (e.g., Purview)
- Primary Skills:
- Knowledge of Azure Data Factory (ADF)
- Knowledge of Azure Databricks
- Knowledge of Python
- Knowledge of SQL
- Knowledge of Spark
- Knowledge of Data Modeling and ETL/ELT Design
- Knowledge of GitHub / Git for version control
- Secondary Skills:
- Knowledge of Azure Functions, Blob Storage
- Knowledge of .NET Core, C#
- Knowledge of React JS
- Knowledge of CI/CD pipelines (Azure DevOps preferred)
- Knowledge of Power BI or other visualization tools
- Knowledge of REST API integration
- Bachelor's degree in computer science, Engineering, or related field
- Experience in Agile/Scrum environments
- Proven solid analytical and problem-solving skills
- Proven excellent communication and collaboration abilities