Data Engineer - AWS/PySpark/Hadoop - 5+ Years - Bengaluru

Bangalore, Karnataka
Permanent
Full-time

12 days ago

Join a high-growth Center of Excellence as a Data Engineer (AWS) to design, build, and scale data pipelines that power analytics and AI/ML use cases. You'll partner with product, engineering, and analytics teams to improve data accessibility, quality, and governance while supporting enterprise reporting and compliance needs across global clients.Location - BengaluruYour Future Employer - A global leader in strategic data and insight solutions (founded in 2000; 1000+ professionals; delivery centers in Mumbai, Kolkata, and Gurgaon) serving Fortune 500 enterprises and high-growth start-ups across technology, eCommerce, healthcare, financial services, media & information, and consulting.Responsibilities - * Design, build, and maintain scalable data pipelines and data models on AWS (S3, EMR) using Spark/PySpark, Hive/Hadoop, and SQL.

Collaborate with product, analytics, and engineering teams to improve models feeding BI tools and enable data-driven decision-making.
Implement data quality monitoring, reliability SLAs, and documentation (engineering wiki); write unit/integration tests.
Troubleshoot complex data issues via deep analysis; define & optimize Spark SQL/Hive SQL jobs to populate models.
Design robust data integrations and a data quality framework aligned to compliance and reporting needs.

Requirements - * BS/MS in Computer Science or related field.

5+ years with Hive, Hadoop, Spark and data warehouse design; strong Python, SQL, PySpark.
Hands-on with AWS (S3, EMR) or Azure; familiarity with CI/CD, Docker, and automation.
Experience supporting enterprise reporting and data compliance use cases; strong documentation habits.
Excellent problem-solving, communication, and collaboration skills; thrive in agile, fast-paced environments.

What is in it for you -

Build at scale for global clients across US, Europe, APAC & India.
Work in an automation-first culture with modern data stacks.
Cross-functional exposure (product, engineering, analytics).

Reach us - If you think this role is aligned with your career, kindly email your updated CV to for a confidential discussion on the role.Disclaimer - Crescendo Global specializes in senior to leadership hiring and is committed to a fair, inclusive hiring experience for all applicants regardless of background or identity.Note - We receive many applications daily. If you do not hear from us within 1 week, please consider that your profile has not been shortlisted at this time.Profile Keywords - Crescendo Global, Data Engineer Jobs Bengaluru, AWS Data Engineer, PySpark Jobs, Spark Jobs, Hadoop Jobs, EMR Jobs, S3 Jobs, Big Data Engineer, Data Pipeline Jobs, Data Warehouse Jobs, SQL Python Jobs, CI/CD Data Engineering, Docker Data Engineer,

Crescendo Global

Apply Now