Lead II - Data Engineering (Snowflake, Cloud, SCALA, Python, Spark, Big Data and SQL)

Bangalore, Karnataka
Permanent
Full-time

2 months ago

Job Description:Skill Examples: * Proficiency in SQL Python or other programming languages used for data manipulation.

Experience with ETL tools such as Apache Airflow Talend Informatica AWS Glue Dataproc and Azure ADF.
Hands-on experience with cloud platforms like AWS Azure or Google Cloud particularly with data-related services (e.g. AWS Glue BigQuery).
Conduct tests on data pipelines and evaluate results against data quality and performance specifications.
Experience in performance tuning.
Experience in data warehouse design and cost improvements.
Apply and optimize data models for efficient storage retrieval and processing of large datasets.
Communicate and explain design/development aspects to customers.
Estimate time and resource requirements for developing/debugging features/components.
Participate in RFP responses and solutioning.
Mentor team members and guide them in relevant upskilling and certification.

Knowledge Examples * Knowledge of various ETL services used by cloud providers including Apache PySpark AWS Glue GCP DataProc/Dataflow Azure ADF and ADLF.

Proficient in SQL for analytics and windowing functions.
Understanding of data schemas and models.
Familiarity with domain-related data.
Knowledge of data warehouse optimization techniques.
Understanding of data security concepts.
Awareness of patterns frameworks and automation practices.

Additional Comments:JOB RESPONSIBILITY: • strong development experience in Snowflake, Cloud (AWS, GCP), SCALA, Python, Spark, Big Data and SQL.

Work closely with stakeholders, including product managers and designers, to align technical solutions with business goals.

Maintain code quality through reviews and make architectural decisions that impact scalability and performance.

Performs Root cause Analysis for any critical defects and address technical challenges, optimize workflows, and resolve issues efficiently.

Expert in Agile, Waterfall Program/Project Implementation.

Manages strategic and tactical relationships with program stakeholders.

Successfully executing projects within strict deadlines while managing intense pressure.

Good understanding of SDLC (Software Development Life Cycle) • Identify potential technical risks and implement mitigation strategies

Excellent verbal, written, and interpersonal communication abilities, coupled with strong problem-solving, facilitation, and analytical skills.

Cloud Management Activities – To have a good understanding of the cloud architecture /containerization and application management on AWS and Kubernetes, to have in depth understanding of the CI CD Pipelines and review tools like Jenkins, Bamboo/DevOps.

Skilled at adapting to evolving work conditions and fast-paced challenges.

Primary Skill: Snowflake, Cloud (AWS, GCP), SCALA, Python, Spark, Big Data and SQL.QUALIFICATION: Bachelor’s or master’s degreeSkills:Snowflake,Gcp,Scala,PythonAbout Company:UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.

UST

Apply Now