
Data Engineer
- Bangalore, Karnataka
- Rs. 6,00,000-20,00,000 per year
- Permanent
- Full-time
- Data Pipeline Development: Design, build, and maintain robust ETL/ELT processes to ingest, transform, and integrate data from multiple sources into the enterprise data platform.
- Data Architecture: Implement solutions based on Medallion Architecture, ensuring scalability, security, and performance across data layers (bronze, silver, gold).
- Cloud Enablement: Utilize the AWS stack (e.g., S3, Glue, Lambda, Redshift, EMR) to manage data workflows, optimize performance, and deliver cost-efficient solutions.
- Data Modeling: Develop logical and physical data models that support analytics, reporting, and operational use cases.
- Programming & Frameworks: Leverage Python and PySpark for data processing, transformation, and automation.
- Database Management: Work with both SQL (MySQL) and NoSQL databases, ensuring efficient querying, indexing, and storage design.
- Analytics & Reporting Support: Partner with business analysts and data visualization specialists to deliver insights using Power BI and other BI tools.
- Quality & Governance: Implement data validation, monitoring, and governance practices to ensure data reliability, compliance, and accuracy.
- Collaboration: Engage with business stakeholders, consultants, and cross-functional teams to translate business requirements into technical data solutions.
- Experience: 3–5 years of proven expertise in data engineering, preferably within manufacturing, logistics, or transportation processes.
- Strong proficiency in the AWS ecosystem (S3, Glue, Redshift, EMR, Lambda, IAM).
- Hands-on experience with Python and PySpark for data engineering tasks.
- Solid understanding of SQL (MySQL) and NoSQL databases for diverse data workloads.
- Demonstrated ability in data modeling (conceptual, logical, and physical) to support both transactional and analytical use cases.
- Experience implementing Medallion Architecture or similar layered data frameworks.
- Proficiency with Power BI for data visualization and analytics enablement.
- Strong understanding of data quality, data governance, and security practices.
- Prior consulting experience or client-facing roles is a strong plus.
- Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or related field (Master’s preferred).
- Strong analytical and problem-solving skills, with the ability to think strategically and deliver practical solutions.
- Excellent communication skills, capable of interacting with technical and non-technical stakeholders alike.
- A proactive mindset with the ability to thrive in fast-paced environments and manage multiple priorities.
- Industry exposure in manufacturing, supply chain optimization, transportation planning, or logistics analytics projects.