
Director - Data Engineering (15+ years' experience, Skills: - Python, Hadoop, Spark, Kafka, GenAI)
- Bangalore, Karnataka
- Permanent
- Full-time
- Responsible for building enterprise scale applications leveraging Data Engineering, AI/ML and GenAI technologies.
- Oversee the end-to-end product lifecycle, from ideation, research, design, development, testing, launch to post-launch evaluation.
- Foster an environment of innovation, encouraging the team to bring forward new ideas and solutions
- Act as a key liaison between the product team, executive leadership, and other stakeholders, ensuring transparency and alignment.
- Responsible for the overall development life cycle of the solution and manage complex products with significant bottom-line impact
- Work with geographically distributed global teams
- Work with product managers in developing a strategy and road map to provide compelling capabilities that helps them succeed in their business goals
- Work closely with senior engineers to develop the best technical design and approach for new product development
- Instill best practices for software development and documentation, assure designs meet requirements, and deliver high quality work on tight schedules
- Project management: prioritization, planning of projects and features, stakeholder management and tracking of external commitments
- Identify opportunities for further enhancements and refinements to standards and processes
- Hire, retain and grow world class engineering talent
- Mentor junior team members, develop departmental procedures and best practices standards
- Strong Negotiation Skills: You will be a distinguished ambassador for product development: collaborating, negotiating, managing tradeoffs, and evaluating opportunistic new ideas with business partners
- 15 or more years of work experience with a Bachelor's Degree or with an Advanced Degree
- Requires 15 or more years of experience, at least 3+ years in leading engineering teams
- Experience leading design and development of data pipelines and analytics platforms
- Experience leading product development & delivery of AI/ML solutions, applied to real-world problems
- Experience leading design and development of mission-critical, secure, reliable systems
- Experience leading or knowledge of GenAI product development with deep expertise in LLM integration and prompt engineering
- Experience leading delivery across multiple technologies: Python, Java/J2EE, Apache Kafka, Apache Flink, Hive, MySQL, Hadoop, Spark, Scala, design patterns, test automation frameworks
- Excellent understanding of algorithms and data structures
- Excellent problem solving and analytics skills. Capable of forming and advocating an independent viewpoint
- Strong experience with agile methodologies
- Excel in partnering with Product leaders and technical product managers, helping define joint product/technology roadmaps & driving prioritization
- Experience driving continuous improvements to processes / tools for better developer efficiency and productivity
- Demonstrated ability to drive measurable improvements across engineering, delivery and performance metrics
- Demonstrated success in leading high performing, multi-disciplinary and geographically distributed engineering teams. Demonstrated ability to hire, develop and retain high-caliber talent
- Must demonstrate longer-term strategic thinking and staying abreast with latest technologies to assess what's possible technically
- Strong collaboration and effective communication, with focus on win-win outcomes