Databricks Engineer

Hyderabad, Telangana
Permanent
Full-time

2 months ago

Overview:At Prolifics, we are currently implementing multiple solutions in Software Development, and we are looking to hire talented Databricks Engineer for our development centre in India. This position would be based out of Hyderabad and is a permanent position.If you are looking for a high growth company with rock-solid stability, if you thrive in the energetic atmosphere of high-profile projects, we want to talk to you today! Let’s connect and explore possibilities of having you onboard the Prolifics team!

Job Title: Databricks Engineer
Primary skills: experience in Databricks, Apache Spark, and Python
Secondary skills: Expertise in ETL frameworks, data pipelines, and cloud platforms (AWS, Azure, GCP)
Location: Hyderabad (Mindspace#12B)
Educational Qualification: B.Tech/BE/M.Tech/MCA/M.Sc
Experience: 6-8 yrs

Job Description:Key Responsibilities:Design, develop, and optimize data pipelines using Databricks and Apache Spark for batch and real-time data processing.Implement robust ETL workflows and work with data lakes, Delta Lake, and structured/semi-structured data.Manage end-to-end solutions from ingestion to transformation and storage, ensuring high performance and scalability.Collaborate with data scientists, analysts, and other engineers to implement solutions on the Databricks platform.Work with cloud environments (AWS, Azure, GCP) to deploy Databricks clusters and optimize costs and performance.Develop and maintain data models, data transformations, and Spark SQL scripts.Provide technical leadership and mentoring to junior engineers while managing client expectations and project delivery.Ensure clean, efficient code and adherence to best practices.Required Skills:6-9 years of experience in Databricks, Apache Spark, and Python.Expertise in ETL frameworks, data pipelines, and cloud platforms (AWS, Azure, GCP).Experience with Delta Lake and data lakes.Proficient in Spark SQL, data modeling, and working with large datasets (Parquet, JSON).Strong experience with Databricks notebooks and workflows.Familiarity with CI/CD pipelines, version control (Git), and containerization (Docker).Strong communication skills and experience in managing stakeholder relationships.Ability to independently manage work, resources, and deliverables.About us:Prolifics Corporation Limited is a Global Technology Solutions Provider with presence across North America (USA and Canada), Europe (UK and Germany), Middle East & Asia. In India, we have offshore development centres: 2 in Hyderabad & 1 in Pune.For more than 40 years, Prolifics has transformed enterprises of all sizes including over 100 Fortune 1000 companies by solving their complex IT challenges. Our clients include Fortune 50 and Fortune 100 companies across a broad range of industries including Financial Services, Insurance, Government, Healthcare, Telecommunications, Manufacturing and Retail. We rank consistently in Dream Companies to Work for and Dream Employer of the Year ranking from World HRD Congress, ranked 7 in 2019.We encourage you to visit us on or follow us on Twitter, LinkedIn, Facebook, YouTube and other social media to know more about us.

Prolifics

Apply Now