Technical Architect - Data Engineering
Circana View all jobs
- Bangalore, Karnataka
- Permanent
- Full-time
- Lead and manage a high-performing team of data engineers across multiple projects and geographies.
- Define and drive the architecture of scalable, secure, and cost-effective cloud-based data warehouse solutions.
- Oversee the development of robust ETL/ELT pipelines using PySpark, Python, and SQL.
- Champion the adoption, integration, and enhancement of in-house data tools, ensuring alignment with business and technical goals.
- Collaborate with business, analytics, and product teams to translate data requirements into actionable solutions.
- Write efficient, reusable and well documented code
- Maintain and tune existing Spark applications to the fullest.
- Find opportunities for optimizing existing spark applications.
- Work closely with QA, Operations and various teams to deliver error free software on time.
- Actively lead / participate daily agile / scrum meetings.
- Establish and enforce engineering best practices, including code quality, testing, documentation, and CI/CD.
- Drive data governance, quality, lineage, and compliance across platforms.
- Manage vendor relationships, and strategic partnerships related to data infrastructure.
- Mentor senior engineers and technical leads, fostering a culture of innovation and continuous improvement.
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
- 10-16 years of experience in data engineering, with a strong focus on cloud-native data solutions.
- Deep expertise in Python, PySpark, and SQL for data processing and analytics.
- Proven experience with Cloud platforms (AWS, Azure, or GCP) and their data services.
- Strong understanding of data warehousing concepts, data modeling, and distributed systems.
- Experience working with and enhancing internal/in-house tools for data processing and analytics.
- Excellent leadership, communication, and stakeholder management skills.
- Experience with orchestration tools like Apache Airflow
- Knowledge of BI tools (e.g., Power BI, Tableau) and data visualization best practices.
- Experience in Agile environments and DevOps practices.
- Stay Curious: Being hungry to learn and grow, always asking the big questions
- Seek Clarity: Embracing complexity to create clarity and inspire action
- Own the Outcome: Being accountable for decisions and taking ownership of our choices
- Center on the Client: Relentlessly adding value for our customers
- Be a Challenger: Never complacent, always striving for continuous improvement
- Champion Inclusivity: Fostering trust in relationships engaging with empathy, respect and integrity
- Commit to each other: Contributing to making Circana a great place to work for everyone