
Lead SW Engineer - Java/Python, Kafka, Spark, Cloud, GenAI
- Bangalore, Karnataka
- Permanent
- Full-time
- Design code and systems that touch 40% of the world population while influencing Visa's internal standards for scalability, security, and reusability
- Collaborate multi-functionally to create design artifacts and develop best-in-class software solutions for multiple Visa technical offerings
- Actively contribute to product quality improvements, valuable service technology, and new business flows in diverse agile squads
- Opportunities to make a difference on a global or local scale through mentorship and continued learning opportunities
- Design, build and manage data ingestion pipelines including OpenSearch, Kafka, and Druid using open-source packages.
- Design and Build Application in Dockers and Kubernetes
- Develop and Build Python based application for automation and task management.
- Ensure data integrity, quality, and security throughout the data lifecycle end-to-end in open-source platform.
- Build multiple data pipelines to ingest unstructured data in real time for advance data analytics.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Energy and Experience: A growth mindset that is curious and passionate about technologies and enjoys challenging projects on a global scale
- Challenge the Status Quo: Comfort in pushing the boundaries, 'hacking' beyond traditional solutions
- 14+ years of relevant work experience with a Bachelor's Degree or at least 7 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 5 years of work experience with PhD
- Bachelor's degree in Computer Science, Engineering or any related field with minimum 14 years of experience
- 10+ years of experience in Python OR Java programming.
- 10+ years of experience working in a Linux or Unix environment.
- 5+ years of exp in Bigdata Technologies such as Hadoop, Kafka and Spark
- 5+ years of experience in Cloud Applications.
- Knowledge in Generative AI or Generative AI tools is preferred.
- 10+ years of experience in data analytics, including proficiency in SQL.
- 3+ years of experience in OpenSearch/Elastic engineering and development.
- 2+ year of experience in Rust programming (highly preferred).
- 3+ years of experience with visualization dashboard tools (Splunk, Elastic, Superset).
- Experience building and deploying modern services and web applications with quality and scalability
- Constant drive to learn new technologies such as Angular, React, Kubernetes, Docker, etc.
- Experience collaborating with Product, Test, Dev-ops, and Agile/Scrum teams
- Excellent Communication and Collaboration skills.
- Experience with Cloud-based Data Engineering solutions is preferred.
- Strong problem-solving skills with attention to detail.