Data Bricks Developer

Pune, Maharashtra
Permanent
Full-time

10 days ago
Apply easily

This is a remote position.Unlock New Career Horizons with SA Technologies Inc.We're Hiring: Databricks Developer (6+ Years)At SA Technologies Inc., we believe in turning career aspirations into reality. As a Great Place to Work Certified company, recognized as one of the Best Places for Women, and a CMMI Level 5 Company, we are committed to creating a workplace that is inclusive, excellent, and supportive.Job Title: SQL to Databricks Migration SpecialistExperience: 4–8 YearsLocation: RemoteEmployment Type: Full-TimeKey Responsibilities1. Analyze Existing Reporting Systems

Review existing Crystal Reports utilizing SQL queries

Identify underlying data sources, dependencies, and data flows

Assess report complexity and compatibility with Databricks

2. Design Data Models on Databricks

Collaborate with stakeholders (business analysts, developers) to understand reporting needs

Convert SQL queries into optimized SparkSQL or PySpark code

Design scalable and efficient data models using Delta Lake or similar storage formats

3. Migration & Implementation

Develop and execute migration strategies for reports

Rewrite or modify reports using Apache Spark APIs within Databricks

Ensure data integrity and accuracy during migration

4. Performance Optimization

Profile and optimize migrated workloads for better performance on Databricks clusters

Implement best practices such as:

Query optimization

Caching strategies

Partitioning techniques

5. Documentation & Knowledge Transfer

Document migration processes, challenges, and solutions

Provide training or documentation for end-users on new systems and workflows

Required Skills & ExperienceTechnical Skills

Strong proficiency in SQL

In-depth knowledge of Apache Spark ecosystem:

SparkSQL

PySpark

Python

Hands-on experience with Databricks

Data Engineering & Modeling

Experience in data migration and transformation projects

Strong understanding of data modeling and data architecture

Familiarity with Delta Lake or similar technologies

Preferred Qualifications

Experience with Azure Databricks or other cloud-based platforms

Familiarity with Crystal Reports or other reporting tools

Experience working with large-scale data processing systems

Soft Skills

Strong problem-solving and analytical skills

Excellent communication and stakeholder collaboration abilities

Attention to detail and ability to work on complex systems

Educational QualificationBachelor’s degree in Computer Science or related field (or equivalent practical experience)Why SA Technologies Inc.?Empowering Work Environment: A Great Place to Work, especially celebrated as one of the Best Places for Women.Excellence and Quality: A CMMI Level 5 Company, ensuring operational and service excellence.Globally Acclaimed: A Microsoft Gold Partner and Google Partner, with over 20 years of global IT consulting and Development solutions delivery.Have queries? We’re here to assist you! with our recruiter or connect with the job owner directly:Email:Embark on a rewarding journey together with us! At SA Technologies Inc., your journey begins with a friendly technical assessment, providing a stage to highlight your unique skills.

SA Technologies