Senior Data Engineer - Assistant Vice President

Citigroup

  • Pune, Maharashtra
  • Permanent
  • Full-time
  • 2 days ago
Data Engineer – Big Data PlatformsJob Summary:We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in Big Data platforms and a strong background in designing, developing, and maintaining data pipelines. You will be responsible for ensuring data quality, optimizing data workflows, and working with distributed data systems. This role requires a deep understanding of modern data engineering workflows, ETL processes, and large-scale data processing.Key Responsibilities:Data Engineering:
  • Design, develop, and maintain scalable and efficient data pipelines to support business needs.
  • Implement ETL/ELT processes to extract, transform, and load data from various sources into Big Data platforms.
  • Optimize data workflows for performance, scalability, and reliability.
Big Data Platforms:
  • Work with Big Data technologies such as Hadoop, Spark, Hive, or HDFS to process and analyze large datasets.
  • Develop distributed data processing pipelines using Spark (PySpark/Scala) and MapReduce.
  • Optimize Big Data workflows for performance and scalability.
Data Integration:
  • Integrate data from multiple sources, including APIs, flat files, and third-party systems.
  • Collaborate with data analysts, data scientists, and business teams to understand data requirements.
Data Quality and Governance:
  • Ensure data accuracy, consistency, and integrity across systems.
  • Implement data validation and error-handling mechanisms.
Collaboration and Documentation:
  • Work closely with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Document data pipelines, data designs, and processes for future reference.
Required Skills and Qualifications:
  • Technical Expertise:
  • Expertise in Big Data platforms:
  • Experience with Hadoop, Spark (PySpark/Scala), Hive, or HDFS for distributed data processing.
  • Proficiency in SQL and database design principles.
  • Experience with ETL/ELT tools (e.g., Informatica, Talend, or Python-based ETL frameworks).
  • Programming Skills:
  • Proficiency in scripting languages such as Python, Scala, or Shell scripting for data processing and automation.
  • Data Governance:
  • Knowledge of data quality, data governance, and data security best practices.
  • Soft Skills:
  • Strong problem-solving and analytical skills.
  • Excellent communication and collaboration skills.
Ability to work in a fast-paced, dynamic environment.Qualifications:
  • 7-9 years of relevant experience
  • Experience in systems analysis and programming of software applications
  • Experience in managing and implementing successful projects
  • Working knowledge of consulting/project management techniques/methods
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Education:
  • Bachelor’s degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.Job Family Group: TechnologyJob Family: Applications DevelopmentTime Type: Full timeMost Relevant Skills Please see the requirements listed above.Other Relevant Skills For complementary skills, please see above and/or contact the recruiter.Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review .View Citi’s and the poster.

Citigroup