
Integration Engineer
- India
- Permanent
- Full-time
- Programming Languages: Python (strong preference for LLM integration and scripting)
- Messaging Queues: Kafka
- Version Control: Git.
- CI/CD: Familiarity with CI/CD principles and tools for automated deployment.
- Containerization: Good to have Docker, Kubernetes (beneficial).
- Cloud Platforms: Google Cloud Platform (GCP) (Good to have)
- Data Technologies: SQL, ETL tools.
- Maintaining production data pipelines from ingestion to consumption within a hybrid big data architecture, using Python.
- Monitoring & Maintenance:
- Implement logging, monitoring, and alerting mechanisms to track the health and performance of integration pipelines.
- Perform routine maintenance and updates to integration components.
- Collaborate closely with development team, LLM engineers, and software developers to define integration requirements and deliver effective solutions.
- Troubleshoot and resolve integration issues in a timely manner.
- Contribute to code reviews and ensure adherence to best practices in integration development.
- Provide on-call support during incidents
- Bachelor's degree preferred or equivalent work experience
- 3 - 5 years of engineering experience in , Data Analytics and Data Integration related fields.
- 2 -3 years of experience writing Python, SQL queries, stored procedures, etc
- Familiarity with Data Ingestion technologies like GCP DataFlow, and AirFlow
- Agile development skills and experience.
- Experience with CI/CD pipelines such as Concourse, Jenkins
- Google Cloud Platform certification is a plus