Lead Consultant - Databricks Developer - AWS

Genpact

Jaipur, Rajasthan
Permanent
Full-time

2 months ago

With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create meaningful transformation that moves us forward in our pursuit of a world that works better for people. Now, we’re calling upon the thinkers and doers, those with a natural curiosity and a hunger to keep learning, keep growing., People who thrive on fearlessly experimenting, seizing opportunities, and pushing boundaries to turn our vision into reality. And as you help us create a better world, we will help you build your own intellectual firepower.Welcome to the relentless pursuit of better.Inviting applications for the role of Lead Consultant-Databricks Developer - AWS!In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements.Responsibilities

Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
Work with architect and lead engineers for solutions to meet functional and non-functional requirements.
Demonstrated knowledge of relevant industry trends and standards.
Demonstrate strong analytical and technical problem-solving skills.
Must have excellent coding skills either Python or Scala, preferably Python.

Qualifications we seek in you!Minimum qualifications

Bachelor’s Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience.
Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
Work with architect and lead engineers for solutions to meet functional and non-functional requirements.
Demonstrated knowledge of relevant industry trends and standards.
Demonstrate strong analytical and technical problem-solving skills.
Must have excellent coding skills either Python or Scala, preferably Python.
Must have experience in Data Engineering domain
Must have implemented at least 2 project end-to-end in Databricks.
Must have experience on databricks which consists of various components as below

Delta lake
dbConnect
db API 2.0
Databricks workflows orchestration
Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.
Must have good understanding to create complex data pipeline
Must have good knowledge of Data structure & algorithms.
Must be strong in SQL and sprak-sql.
Must have strong performance optimization skills to improve efficiency and reduce cost.
Must have worked on both Batch and streaming data pipeline.
Must have extensive knowledge of Spark and Hive data processing framework.
Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.
Must be strong in writing unit test case and integration test
Must have strong communication skills and have worked on the team of size 5 plus
Must have great attitude towards learning new skills and upskilling the existing skills.

Good to have Unity catalog and basic governance knowledge.
Good to have Databricks SQL Endpoint understanding.
Good To have CI/CD experience to build the pipeline for Databricks jobs.
Good to have if worked on migration project to build Unified data platform.
Good to have knowledge of DBT.
Good to have knowledge of docker and Kubernetes.

Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values diversity and inclusion, respect and integrity, customer focus, and innovation. For more information, visit . Follow us on , , , and .Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.

Genpact

Apply Now