Senior Analyst - Data Platform

Hyderabad, Telangana
Permanent
Full-time

3 days ago
Apply easily

Job DescriptionAbout H.E. Services:At H.E. Services vibrant tech Center in Hyderabad, you will have the opportunity to contribute to technology innovation for Holman Automotive, a leading American fleet management and automotive services company. Our goal is to continue investing in people, processes, and facilities to ensure expansion in a way that allows us to support our customers and develop new tech solutions.Holman has come a long way during its first 100 years in business. The automotive markets Holman serves include fleet management and leasing; vehicle fabrication and up fitting; component manufacturing and productivity solutions; powertrain distribution and logistics services; commercial and personal insurance and risk management; and retail automotive sales as one of the largest privately owned dealership groups in the United States.Join us and be part of a team that's transforming the way Holman operates, creating a more efficient, data-driven, and customer-centric future.Roles & Responsibilities:

Design, develop, and maintain data pipelines using Databricks, Spark, and other Azure cloud technologies.
Optimize data pipelines for performance, scalability, and reliability, ensuring high speed and availability of data warehouse performance.
Develop and maintain ETL processes using Databricks and Azure Data Factory for real-time or trigger-based data replication.
Ensure data quality and integrity throughout the data lifecycle, implementing new data validation methods and analysis tools.
Collaborate with data scientists, analysts, and stakeholders to understand and meet their data needs.
Troubleshoot and resolve data-related issues, providing root cause analysis and recommendations.
Manage a centralized data warehouse in Azure SQL to create a single source of truth for organizational data, ensuring compliance with data governance and security policies.
Document data pipeline specifications, requirements, and enhancements, effectively communicating with the team and management.
Leverage AI/ML capabilities to create innovative data science products.
Champion and maintain testing suites, code reviews, and CI/CD processes.

Must Have:

Strong knowledge of Databricks architecture and tools.
Proficient in SQL, Python, and PySpark for querying databases and data processing.
Experience with Azure Data Lake Storage (ADLS), Blob Storage, and Azure SQL.
Deep understanding of distributed computing and Spark for data processing.
Experience with data integration and ETL tools, including Azure Data Factory.

Advanced-level knowledge and practice of:

Data warehouse and data lake concepts and architectures.
Optimizing performance of databases and servers.
Managing infrastructure for storage and compute resources.
Writing unit tests and scripts.
Git, GitHub, and CI/CD practices.

Good to Have:

Experience with big data technologies, such as Kafka, Hadoop, and Hive.
Familiarity with Azure Databricks Medallion Architecture with DLT and Iceberg.
Experience with semantic layers and reporting tools like Power BI.

Relevant Work Experience:

5+ years of experience as a Data Engineer, ETL Developer, or similar role, with a focus on Databricks and Spark.
Experience working on internal, business-facing teams.
Familiarity with agile development environments.

Education and Training:

Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent work experience.

Holman