Generative AI Lead Engineer - Vice President

Citigroup

  • Pune, Maharashtra
  • Permanent
  • Full-time
  • 14 days ago
Responsibilities:
  • Design, prototype, and implement Generative AI applications, ensuring robust, scalable, and secure solutions.
  • LangChain & Orchestration: Drive the practical implementation and advanced utilization of LangChain (or similar orchestration frameworks) for building complex LLM applications, managing conversational flows, agentic behaviors, and tool integration.
  • Vector Databases: Architect, select, and manage vector databases (e.g., Pinecone, Weaviate, Chroma, Milvus) for efficient similarity search, RAG (Retrieval Augmented Generation), and knowledge management, ensuring optimal performance and data freshness.
  • LLM Validation & Evaluation: Establish and implement rigorous methodologies for the validation, testing, and continuous evaluation of LLMs (e.g., perplexity, factual consistency, safety, bias, performance metrics, A/B testing of prompt variations). Develop automated pipelines for tracking and reporting LLM performance.
  • Practical LLM Platform Knowledge: Demonstrate and apply deep practical knowledge of various LLM platforms and versions (e.g., Gemini, OpenAI GPT-3.5/4, open-source models like Llama 2, Mistral). This includes understanding their respective strengths, limitations, APIs, fine-tuning capabilities, and cost implications.
  • Expertise in AI and Machine learning algorithms and related business usecases/applications
  • Architecture Implementation: Lead the practical implementation of end-to-end architectures for Generative AI use cases, encompassing data ingestion, pre-processing, model serving, prompt engineering, RAG pipelines, output post-processing, and integration with existing enterprise systems.
  • Provide expert-level guidance on Generative AI best practices, model selection, and prompt engineering techniques.
  • Work with cross-functional teams in the practical application of LangChain, vector databases, and LLM evaluation.
Qualifications:
  • 12 - 14 years of relevant experience in the Financial Service industry
  • Experience as Applications Development Lead/manager
  • Competent in Gen AI skills
  • Expertise in prompt engineering / Open AI / Vertex models
  • Stakeholder and people management experience
  • Demonstrated leadership skills
  • Proven project management skills
  • Basic knowledge of industry practices and standards
  • Consistently demonstrates clear and concise written and verbal communication
Education:
  • Bachelor’s degree/University degree or equivalent experience
  • Master’s degree preferred
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.Job Family Group: TechnologyJob Family: Applications DevelopmentTime Type: Full timeMost Relevant Skills Please see the requirements listed above.Other Relevant Skills For complementary skills, please see above and/or contact the recruiter.Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review .View Citi’s and the poster.

Citigroup