Senior Data Engineer

Stolt-Nielsen Digital Innovation Centre

Hyderabad, Telangana
Permanent
Full-time

1 day ago
Apply easily

About Stolt-Nielsen Digital Innovation CentreWere a family-founded company with a global reputation for excellence in bulk-liquid and chemical logistics, transportation, and storage and a passion for innovation that drives the world forward. From enabling smarter, safer, and more sustainable supply chains to advancing high-technology aquaculture, were constantly reimagining whats possible. Our spirit of entrepreneurship and continuous adaptation keeps us at the forefront of every industry we serve.Across our businesses, we deliver world-class reliability, flexibility, and expertise ensuring that complex operations run seamlessly.We recognise the rich potential of Indias talent pool, which is why we have set up the Stolt-Nielsen Digital Innovation Centre in Hyderabad, purpose-built to be the global hub for product development and operations (DevOps) for all our businesses and corporate functions.At the Stolt-Nielsen Digital Innovation Centre, were leading the digital evolution of our global businesses creating smart, high-quality digital solutions that empower our customers and colleagues alike.Job DescriptionAbout Stolt-Nielsen:Stolt-Nielsen is a family-founded global leader in bulk-liquid and chemical logistics, transportation, and storage, known for its commitment to safety, service excellence, and innovation. At the Stolt-Nielsen Digital Innovation Centre, we bring this legacy into the future building smarter systems, driving digital transformation, and shaping what's next for the world of logistics. Here, youre encouraged to think boldly, challenge convention, and help move todays products toward tomorrows possibilities.Job Description:We are excited to announce an opening for a Senior Data Engineer at Stolt-Nielsen Digital Innovation Centre. Please find below the details of the role and its responsibilities.Skills Required:Databricks, Python, SQL, Lakehouse Medallion architecture, Unity Catalog, REST APIs, event-driven architectures, cloud PaaS services (e.g., Azure data/storage, compute), GIT and basic understanding of CI/CD and Infrastructure-as-Code, Cursor or other AI-enabled IDEs / workflows.Experience Range:5+ yearsAbout the Role:Were looking for a Data Engineer with strong Databricks, Python, and SQL skills to build and optimize the data infrastructure that powers our analytics and AI initiatives.In this role, youll design and maintain reliable data pipelines, ensure data quality and performance, and enable data-driven decision-making across the organization. We believe that Data Engineers become only more relevant in the age of Generative AI, as we are transitioning to using solutions like Databricks Genie that rely on well-modelled and described data.
Youll work closely with analysts, data scientists, and business stakeholders to turn raw data into trusted, accessible, and actionable insights.At Stolt-Nielsen, we take Digital seriously. We invest in our teams through training and mentoring and enable them with the required tools to work in a modern way (Engineering laptops, Cursor licenses). As we are further building up our engineering practice, there is ample room for you to contribute, take initiative and shape the future of our ways of working and technology landscape.What Youll Do:

Design, develop, and maintain scalable data pipelines in Databricks using PySpark and Delta Lake.
Build robust ETL/ELT processes to ingest data from multiple sources (APIs, databases, files, cloud systems).
Optimize data models and storage for analytics, machine learning, and BI reporting.
Write and maintain SQL queries, views, and stored procedures for data transformation and analysis.
Collaborate with cross-functional teams to understand business needs and translate them into technical solutions.
Implement and enforce data quality, governance, and security standards across pipelines and platforms.
Monitor and troubleshoot data workflows for performance, reliability, and cost efficiency.
Stay current with best practices in data engineering, Databricks, and cloud-native data architectures.

What Youll Bring:

Bachelors or masters degree in computer science or a related field.
5+ years of hands-on experience as a Data Engineer, ETL Developer, or similar.
Strong proficiency in Python (especially PySpark and pandas).
Excellent command of SQL for data manipulation, performance tuning, and debugging.
Hands-on experience with Databricks (workspace, notebooks, jobs, clusters, and Unity Catalog).
Solid understanding of data warehousing concepts, data modeling, and distributed data processing, like dimensional modelling (Kimball) and medallion architectures.
Experience with Azure PaaS ecosystem (data/storage).
Strong analytical mindset and attention to detail.
Effective communication skills and ability to work cross-functionally.
Experience in CI/CD pipelines, automated testing, and Agile delivery.

Must Have Skills:

Databricks (PySpark, Delta Lake, Jobs, Workflows)
Python/ Pyspark (data processing and automation)
SQL (advanced querying and performance tuning)
Data pipeline orchestration (e.g., Databricks Workflows), similar tools
Version control (Git) and CI/CD familiarity
Data modeling and transformation design
Unity Catalog

Nice to have Skills:

Familiarity with dbt or modern data stack tools.
Knowledge of data governance, cataloging, and access control (e.g., Unity Catalog, Purview).
Exposure to machine learning workflows and ML model data preparation.
Strong background in performance tuning and cost optimization

Stolt-Nielsen Digital Innovation Centre