Senior Data Engineering Manager - T&T

Gurgaon, Haryana
Permanent
Full-time

8 days ago

At McCormick, we bring our passion for flavor to work each day. We encourage growth, respect everyone's contributions and do what's right for our business, our people, our communities and our planet. Join us on our quest to make every meal and moment better.Founded in Baltimore, MD in 1889 in a room and a cellar by 25-year-old Willoughby McCormick with three employees, McCormick is a global leader in flavour. With over 14,000 employees around the world and more than $6 Billion in annual sales, the Company manufactures, markets, and distributes spices, seasoning mixes, condiments and other flavourful products to the entire food industry, retail outlets, food manufactures, food service businesses and consumers.While our global headquarters are in the Baltimore, Maryland, USA area, McCormick operates and serves customers from nearly 60 locations in 25 countries and 170 markets in Asia-Pacific, China, Europe, Middle East and Africa, and the Americas, including North, South and Central AmericaPosition OverviewAs a Data Engineer at McCormick, you will play a pivotal role in delivering the design, implementation and maintenance of data and analytics solutions from simple to complex and supporting McCormick AI engineers with their data needs. Your responsibilities will include implementing and maintaining data solutions delivering data required by McCormick AI solutions. You will work with Data Scientists and AI Engineers to convert business expectations into data solutions and data models used to deliver AI-driven recommendations to stakeholders and executives.Key Responsibilities:

Design and implement scalable ELT pipelines on an Azure analytics platform to ingest, harmonize and transform data into data models optimized for AI consumption.
Write efficient and scalable code to transform and clean large volumes of data.
Ensure performance, security and data integrity across end-to-end data processing.
Cooperate with cross-functional teams to design and deliver new data solutions and improve and enrich existing ones.

The role will report to the Azure Analytics Product Owner and requires close collaboration with the entire Enterprise Data Services team and McCormick AI team to conceptualize, visualize, and build an enterprise data management frameworkRequirements:

Proven experience with Azure Databricks.
Proven experience with ML/AI tools.
Proven experience with Azure Analytics toolset (Data Factory, Synapse, Storage Accounts, Key Vault)
Proficiency with T-SQL, Python, PySpark
Performance tuning experience within the Azure analytics environment: parquet/delta files, SQL databases, data warehouses, ingestion tuning, cache optimization, etc.
Good communication skills including ability to interact closely with Data Science and AI Engineers.
Experience with Agile methodologies (Azure DevOps).
Experience with CI/CD tools (Azure DevOps, Git)

Desired Experience:

Experience with Microsoft Fabric
Familiar with SAP, SAP BW or any other ERP system
Familiar with Data Governance / MS Purview
Experience with Power BI

Decription

Plan and Design

Collaborate with business stakeholders to gather requirements.
Design end-to-end solutions including data security, data quality and performance requirements.
Prepare documentation and with Product Owner define implementation plan

2.Data Extraction, Load and Transformation

Implement data pipelines to efficiently prepare data for ML/AI needs and deliver datasets that meet Data Science and AI Engineers requirements.
Ensure efficient and reliable data mapping to support business needs.
Deliver complete documentation and knowledge transfer sessions for the Team and partners
Maintain existing solutions, implement optimizations and enhancements, monitor data quality

3.Process Improvement, Performance and Cost optimization tuning

Collaborate with Data Science, Machine Learning and Business Analytics teams to optimize performance and cost effectiveness of their analytics solutions.
Identify and design internal process improvements, including automating manual processes, optimizing data delivery, and redesigning solutions for enhanced scalability. Work with Azure Analytics Product Owner to prioritize and schedule implementation.
Design and implement existing solution adjustments to improve performance and cost-effectiveness.
Suggest and introduce best practices for Data and AI engineering
Issue Resolution and Support

Assist stakeholders with data-related technical issues and support their data needs. Work with the Analytics Operational Support team to investigate, troubleshoot, and resolve data errors / discrepancies.
Provide expert-level support and guidance to data teams across the Enterprise

Secondary Responsibilities

Maintain continuous personal learning and development to retain technological relevancy in current and emerging technologies.
Adhere to company standards for data security
Perform other responsibilities as assigned by the Supervisor

Required QualificationsLevel of Education and Discipline: Bachelor's degree in computer science or other relevant disciplineCertification and/or Licenses: Microsoft Certified: Azure Databricks Data Engineer AssociateExperience - functional/industry/commercial knowledge, business acumen: 8-10+ years of experience in data engineeringInterpersonal Skills - leadership, interactions, communication, influence:

Effective communication skills and ability to communicate effectively on technical and business issues both internally and externally.

Ability to work independently, navigate problems, resolve conflicts, and bring solutions to the table. * Build strong interpersonal relationships and be able to persuade, negotiate and influence for meeting business objectives.

Innovative thinker - able to turn customer requirements into workable solutions
Excellent time management and prioritization skills

Other Skills and HPO Competencies:

Knowledge of data analysis, visualization techniques, and frameworks.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

Preferred Qualifications:Level of Education and Discipline: Bachelor's Degree in Relevant DisciplineCertification and/or Licenses:

Microsoft Certified: Azure Data Engineer Associate
Microsoft Certified: Fabric Data Engineer Associate
Microsoft Certified: Fabric Analytics Engineer Associate.

Experience - functional/industry/commercial knowledge, business acumen:

Experience of working with SAP or SAP BW or any ERP System
Experience working in a food and beverage CPG environment.

Interpersonal Skills - leadership, interactions, communication, influence:Strong English skills with an ability to communicate with users across the spectrum of beginner to advanced technology skills. Proactive follow-up with stakeholders on all communicationsOther Skills and HPO Competencies: Experience with agile project delivery and use of ADO to manage sprint tasking and ServiceNow for tracking user support tasking are desirableAt McCormick, we have over a 100-year legacy based on our “Power of People” principle. This principle fosters an unusually dedicated workforce requiring a culture of respect, recognition, inclusion and collaboration based on the highest ethical valueWHY WORK AT MCCORMICK?As a McCormick employee you’ll be empowered to focus on more than your individual responsibilities. You’ll have the opportunity to be part of something bigger than yourself—to have a say in where the company is going and how it’s growing.Between our passion for flavor, our 130-year history of leadership and integrity, the competitive and comprehensive benefits we offer, and our culture, which is built on respect and opportunities for growth, there are many reasons to join us at McCormick.

McCormick

Apply Now