Data Engineer ID56374
AgileEngine View all jobs
- New Delhi
- Permanent
- Full-time
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!ABOUT THE ROLEWHAT YOU WILL DO
- Build and maintain scalable, distributed, fault-tolerant data pipelines using Microsoft Fabric;
- Develop and manage lakehouse layers and Delta Lake workflows for data processing;
- Collaborate with stakeholders across data engineering, compliance, and business teams;
- Design and implement pipelines to acquire, normalize, transform, and release large volumes of financial data;
- Design and implement bitemporal data models for regulatory-grade time-series datasets;
- Build and maintain testing frameworks for data pipelines and transformation logic;
- Own end-to-end solutions including ingestion pipelines, QA workflows, correction management, and audit trails;
- Contribute to shared platform services in a collaborative environment;
- Support implementation of AI solutions including data ingestion, anomaly detection, and semantic search.MUST HAVES
- 6–8 years of experience in data engineering;
- Proficiency in Python for data pipelines, transformation logic, and automation;
- Proficiency in SQL including window functions, partitioning, and time-series queries;
- Hands-on experience with Microsoft Fabric (OneLake, Data Factory, Lakehouse, Warehouse);
- Working knowledge of Delta Lake including incremental merges and Change Data Feed;
- Experience with AI-assisted development tools such as GitHub Copilot or similar;
- Experience with Git version control and collaboration workflows;
- Familiarity with REST APIs for integrations;
- Familiarity with Azure technologies (Azure Data Factory, Azure SQL, Azure Key Vault, RBAC);
- Understanding of financial data concepts related to equities and & other asset classes;
- Upper-intermediate English level.NICE TO HAVES
- Knowledge of data libraries such as pandas or PySpark;
- Experience with columnar storage and time-series analytics tools such as ClickHouse;
- Familiarity with Microsoft Purview for data governance;
- Understanding of bitemporal data modeling concepts;
- Knowledge of financial reference data such as equities, fixed income, or corporate actions;
- Experience with CI/CD pipelines and automated deployments;
- Exposure to LLMs and Agentic AI for data-related use cases.PERKS AND BENEFITS
- Remote work & Local connection: Work where you feel most productive and connect with your team in periodic meet-ups to strengthen your network and connect with other top experts.
- Legal presence in India: We ensure full local compliance with a structured, secure work environment tailored to Indian regulations.
- Competitive Compensation in INR: Fair compensation in INR with dedicated budgets for your personal growth, education, and wellness.
- Innovative Projects: Leverage the latest tech and create cutting-edge solutions for world-recognized clients and the hottest startups.