Key Responsibilities:Lead and mentor a team of data engineers working on Snowflake and Databricks platforms.Design and implement scalable data pipelines and lakehouse solutions aligned with business requirements and industry best practices.Collaborate with clients and business stakeholders for requirement gathering, technical design, and solution delivery.Provide technical guidance and support to resolve complex issues within the team and ensure high code quality.Ensure adherence to data governance, security policies, and performance tuning best practices.Optimize Spark jobs, Snowflake queries, and data flows for performance and cost-efficiency.Build robust ETL/ELT frameworks for both batch and streaming data ingestion.Implement and manage CI/CD pipelines, data orchestration tools like Apache Airflow, and cloud-native services.Coordinate with cross-functional teams across data science, product, BI, and business functions.Promote innovation and continuous improvement within the data engineering practice.
