Job Description (Posting). Data engineers are mainly tasked with transforming data into a format that can be easily analyzed. They do this by developing, maintaining, and testing infrastructures for data generation. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.Responsibilities for Data Engineer Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements. Design, develop, automate, and support complex applications to extract, transform, and load data Build data pipelines to carry out the ETL process Conduct testing of the tools and designed data pipelines Perform transformations on raw data and make it suitable for storage on the destination DataMart/Database Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and big data technologies. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs. Work with data and analytics experts to strive for greater functionality in our data systems. Superior communication skills, strong decision making and organizational skills along with outstanding analytical and problem-solving skills to undertake challenging jobsQualifications for Data Engineer Advanced knowledge in SQL querying language, experiences in relational databases (SQL Server,Snowflake etc) Hands on experience with Tableau Experience with stream-processing systems: Spark-Streaming, etc is a plus Experience with object-oriented/object function scripting languages: Python, PySpark Experience with data pipeline and workflow management tools: Control-M,datastage,db2 etc. Knowledge of cloud and Snaplogic is an asset (1.) To provide support for on call escalations and doing root cause analysis of given issue (2.) To independently resolve tickets within agreed SLA of ticket volume and time (3.) To adhere to quality standards, regulatory requirements and company policies (4.) Work on value adding activities such Knowledge base update and management, Training freshers, coaching analysts (5.) To ensure positive customer experience and CSAT through First Call Resolution and minimum rejected resolutions or Reopen Cases Qualification B-Tech Skill (Primary) Data Science-Advanced Analytics-Python
