Consultant - Business Consulting (Data Science/Engineering)
- Bangalore, Karnataka
- Permanent
- Full-time
- Take the lead on data pipeline design with strong analytical skills and a keen eye for detail to really understand and tackle the challenges businesses are facing
- You will be confronted with a large variety of Data Engineer tools and other new technologies as well with a wide variety of IT, compliance, security related issues.
- Design and develop world-class technology solutions to solve business problems across multiple client engagements.
- Collaborate with other teams to understand business requirements, client infrastructure, platforms and overall strategy to ensure seamless transitions.
- Work closely with AI and A team to build world-class solutions and to define AI strategy.
- You will possess strong logical structuring and problem-solving skills with expert level understanding of database and have an inherent desire to turn data into actions.
- Strong verbal, written and presentation skills
- Comfortable working in Agile projects
- Clear and precise communication skills
- Ability to quickly learn and develop expertise in existing highly complex applications and architectures.
- 3 - 10 years of strong python or Java data engineering experience
- Experience in Developing Data Pipelines that process large volumes of data using Python, PySpark, Pandas etc, on AWS.
- Experience in developing ETL, OLAP based and Analytical Applications.
- Experience in ingesting batch and streaming data from various data sources.
- Strong Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.)
- Exposure to AWS platform's data services (AWS Lambda, Glue, Athena, Redshift, Kinesis etc.)
- Experience in Airflow DAGS, AWS EMR, S3, IAM and other services
- Experience working on Test cases using pytest/ unit test or any other framework.
- Snowflake or Redshift data warehouses
- Experience of DevOps and CD/CD tools.
- Familiarity with Rest APIs
- Experience with CI/CD pipelines, branching strategies, & GIT for code management
- Bachelor's degree in computer science, information technology, or a similar field