Job Description:We are seeking a highly skilled and motivated Data Engineer to join our data team. As a Data Engineer, you will be primarily responsible for designing & developing data transformations and data models to ensure reliable and efficient data processing and analysis. You will work closely with cross-functional teams to support data-driven decision-making processes and contribute to the overall success of our insight's teams.Key Proficiency & Responsibilities:Expertise in DBT (Data Build Tool) for data transformation and modelling.Proficiency in Snowflake, including experience with Snowflake SQL and data warehousing concepts.Strong understanding of data architecture, data modelling, and data warehousing best practices.Design, develop, and maintain robust data pipelines using DBT and Snowflake.Implement and optimize data ingestion processes to ensure efficient and accurate data flow from various sources.Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure data integrity and quality.Perform data analysis and profiling to identify and address data quality issues.Maintain comprehensive documentation of data workflows, models, and ETL processes.Stay up to date with the latest trends and technologies in data engineering, DBT, and Snowflake.Proven experience as a Data Engineer or similar role, with a focus on data ingestion and ETL processes.Experience with other ETL tools and technologies is a plus (e.g., Apache Airflow, Talend, Informatica).Proficient in SQL and experience with programming languages such as Python or Java.Familiarity with cloud platforms and services (e.g., AWS) and experience on AWS Lambda is a must.Adhere to and promote development best practices, including version control using Git and branching models.Code review to ensure consistent coding standards and practices.Participate in scrum methodology, including daily stand-ups, sprint planning, and retrospectives.Communicate effectively with team members and stakeholders to understand requirements and provide updates.Take ownership of assigned tasks and work independently to complete them.
