Data Engineering Consultant

Noida, Uttar Pradesh
Permanent
Full-time

2 months ago

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.Primary Responsibilities:

Ingest data from multiple on-prem and cloud data sources using various tools & capabilities in Azure
Design and develop Azure Databricks processes using PySpark/Spark-SQL
Design and develop orchestration jobs using ADF, Databricks Workflow
Analyzing data engineering processes being developed and act as an SME to troubleshoot performance issues and suggest solutions to improve
Building test framework for the Databricks notebook jobs for automated testing before code deployment
Design and build POCs to validate new ideas, tools, and architectures in Azure
Continuously explore new Azure services and capabilities; assess their applicability to business needs
Prepare case studies and technical write-ups to showcase successful implementations and lessons learned
Work closely with clients, business stakeholders, and internal teams to gather requirements and translate them into technical solutions using best practices and appropriate architecture
Contribute to full lifecycle project implementations, from design and development to deployment and monitoring
Ensure solutions adhere to security, compliance, and governance standards
Monitor and optimize data pipelines and cloud resources for cost and performance efficiency
Identifies solutions to non-standard requests and problems
Mentor and support existing on-prem developers for cloud environment
Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications:

Undergraduate degree or equivalent experience
7+ years of overall experience in Data & Analytics engineering
5+ years of experience working with Azure, Databricks, and ADF, Data Lake
5+ years of experience working with data platform or product using PySpark and Spark-SQL
Solid experience with CICD tools such as Jenkins, GitHub, Github Actions, Maven etc.
In-depth understanding of Azure architecture & ability to come up with efficient design & solutions
Highly proficient in Python and SQL
Proven excellent communication skills
Key Skill: Azure Data Engineer - Azure Databricks, Azure Data factory, Python/Pyspark, Terraform

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.

UnitedHealth Group

Apply Now