
Senior Engineering Manager
- Mumbai, Maharashtra
- Permanent
- Full-time
- 5+ years of experience in building and deploying enterprise-grade machine learning infra, SaaS software, data analytics solutions, or online platforms
- 2+ years of experience in building LLM infra or high-volume AI inference components.
- Academic degree in Computer Science, Engineering, or a related field
- Strong background in Python programming, Distributed computing, Engineering, big data processing, and cloud computing (AWS, Azure, GCP, on-premises)
- Experience in optimizing, scaling, and reliability of large-scale systems for various data modalities and AI models.
- Strong fundamentals and discipline in CI/CD pipelines, containerization (Docker, Kubernetes), and multi-cloud environments.
- Proven track record in product management in designing and delivering complex, high-performance solutions for large-scale enterprise customers without faults and the ability to auto-scale the systems through delivering the essential SLAs in production during inference
- Programming skills - expert in Python and solid coding practices
- Data Engineering - expert in MongoDB and strong fundamentals in data lakes, data storage, ETL pipelines, and building real-time data pipelines.
- Strong material skills, excellent communication, collaboration, and leadership skills with the ability to lead teams, mentor juniors, and work with other teams.
- Strong system architecture background that supports scaling in regulated industries.
- Experience in scaling AI/ML production systems using classic ML models, LLMs, and Deep Learning models on traditional hardware and high-performance computing.
- You'll be responsible for designing, modifying, and scaling architecture, as well as designing and implementing scalable infrastructure for AI/ML solutions and data engineering.
- You'll be the SPOC with the R&D team, collecting the productized components and adding and scaling these components on the platform.
- Architect and scale AI inference platform and related components for all data modalities like Tabular, text, image, video, etc.
- You'll be responsible for designing the AI Ops and AI Inferencing Ops - model building, data preprocessing, model inferencing, explainability, monitoring, alignment, risk management components.
- You'll work on running multiple optimizations on inference speed and latencies to serve multiple AI models - LLMs, DL models, classic ML models, etc.
- You'll manage product development activities, including scrum reviews and productivity optimization across engineering, as well as collaborate with R&D/data science and front-end teams.
- You'll mentor and guide juniors and middle managers.
- You'll continuously improve the standards of the product, as well as the architecture, culture, and experience.
- Highly competitive and meaningful compensation package
- One of the best health care plans that covers not only you but also your family, and offers the best Life insurance plans.
- A great team
- Micro-entrepreneurial tasks and responsibilities.
- Career development and leadership opportunities