
Data Engineering Lead
- Gurgaon, Haryana
- Permanent
- Full-time
- Data engineering lifecycle including research, proof of concepts, architecture, design, development, test, deployment, and maintenance
- Design, develop, implement, and run cross-domain, modular, flexible, scalable, secure, reliable, and quality data solutions that transform data for meaningful analyses and analytics while ensuring operability
- Layer in instrumentation in the development process so that data pipelines that can be monitored to detect internal problems before they result in user-visible outages or data quality issues
- Build processes and diagnostic tools to troubleshoot, maintain, and optimize solutions and respond to customer and production issues
- Embrace continuous learning of engineering practices to ensure industry best practices and technology adoption, including DevOps, Cloud, and Agile thinking
- Tech debt reduction/Tech transformation including open source adoption, cloud adoption, HCP assessment, and adoption
- Maintain high-quality documentation of data definitions, transformations, and processes to ensure data governance and security
- Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
- Experience with data analytics tools like Tableau, Power BI, or similar
- Experience in optimizing data processing workflows for performance and cost-efficiency
- Understanding of healthcare data, including Electronic Health Records (EHR), claims data, and regulatory compliance such as HIPAA
- Familiarity with healthcare regulations and data exchange standards (e.g. HL7, FHIR)
- Familiarity with automation tools and scripting languages (e.g., Bash, PowerShell) to automate repetitive tasks
- Proficient in design and documentation of data exchanges across various channels including APIs, streams, batch feeds
- Proficient in source to target mapping, gap analysis and applies data transformation rules based on understanding of business rules, data structures
- Proven ability to develop and implement scripts to maintain and monitor performance tuning
- Proven ability to design scalable job scheduler solutions and advises on appropriate tools/technologies to use
- Proven ability to work across multiple domains to define and build data models
- Proven ability to understand all the connected technology services and their impacts
- Proven ability to assess design and proposes options to ensure the solution meets business needs in terms of security, scalability, reliability, and feasibility