Software Engineer - Azure Data Factory (ADF) Job
YASH Technologies
- India
- Permanent
- Full-time
Must have skills: Azure data factory, Azure data bricks, Python and Pyspark
2- 4 years of professional experience with database technologies and ETL tools.
2+ years of hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks, Python, Pyspark etc.
Good knowledge of AZURE Cloud platform services stack - Azure Data Factory, Azure SQL Database, AZURE Data Warehouse, Azure databricks, Azure Blob Storage, Azure Data Lake Storage, HD Insight, Cosmos DB, etc.
Hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks, Python, Pyspark etc.Required Technical CompetenciesDomain/ Industry Knowledge - Working knowledge of customer's business processes and relevant technology platform or product.Able to analyse current-state and define to-be processes in collaboration with SME and present recommendations with tangible benefits.Requirement Gathering and Analysis - Working knowledge of requirement management processes and requirement analysis processes, tools & methodologies.Able to analyse the impact of change requested/ enhancement/ defect fix and identify dependencies or interrelationships among requirements & transition requirements for engagement.Technology/Product Knowledge - Working knowledge of technology product/platform standards and specifications.Able to implement code or configure/customize products, analyse various frameworks/tools, review the code & provide inputs in design and architecture adhering to industry standards/ practices in implementation.Architecture tools and frameworks - Working knowledge of architecture Industry tools & frameworks.Able to identify pros/ cons of available tools & frameworks in market and use those as per Customer requirement and explore new tools/ framework for implementation.Architecture concepts and principles - Working knowledge of architectural elements, SDLC, methodologies.Able to provides architectural design/ documentation at an application or function capability level and implement architectural patterns in solution & engagements and communicates architecture direction to the business.Analytics Solution Design - Knowledge of statistical & machine learning techniques like classification, linear regression modelling, clustering & decision trees.Able to identify the cause of errors and their potential solutions.Tools & Platform Knowledge - Familiar with wide range of mainstream commercial & open-source data science/analytics software tools, their constraints, advantages, disadvantages, and areas of application.Required Behavioral CompetenciesAccountability - Takes responsibility for and ensures accuracy of own work, as well as the work and deadlines of the team.Collaboration - Shares information within team, participates in team activities, asks questions to understand other points of view.Agility - Demonstrates readiness for change, asking questions and determining how changes could impact own work.Customer Focus - Identifies trends and patterns emerging from customer preferences and works towards customizing/ refining existing services to exceed customer needs and expectations.Communication - Targets communications for the appropriate audience, clearly articulating and presenting his/her position or decision.Drives Results - Sets realistic stretch goals for self & others to achieve and exceed defined goals/targets.Resolves Conflict - Displays sensitivity in interactions and strives to understand others' views and concerns.At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.Our Hyperlearning workplace is grounded upon four principles
- Flexible work arrangements, Free spirit, and emotional positivity
- Agile self-determination, trust, transparency, and open collaboration
- All Support needed for the realization of business goals,
- Stable employment with a great atmosphere and ethical corporate culture