Data Engineer, Staff

Hyderabad, Telangana
Permanent
Full-time

9 days ago
Apply easily

Job DescriptionAbout Costco Wholesale:Costco Wholesale is a multi-billion-dollar global retailer with warehouse club operations in eleven countries. They provide a wide selection of quality merchandise, plus the convenience of specialty departments and exclusive member services, all designed to make shopping a pleasurable experience for their members.About Costco Wholesale India:At Costco Wholesale India, we foster a collaborative space, working to support Costco Wholesale in developing innovative solutions that improve members experiences and make employees jobs easier. Our employees play a key role in driving and delivering innovation to establish IT as a core competitive advantage for Costco Wholesale.Job Description:

We are excited to announce an opening for Data Engineer, Staff at Costco.

Please find below the details of the role and its responsibilities.Skills Required:

Python, GCP, Airflow, Cloud Composer, Data Orchestration, Data Streaming, Pub/Sub,
Kafka, Dataflow, Dataproc, Data Architecture, DWH, Data Warehouse, Warehouse, Data
Lake, Data lake

Experience Range:

8+ years

Job Description:Position Title: Data Engineer, StaffJob Description:Roles & Responsibilities:

Lead the design and implementation of enterprise data platforms: Architect and oversee the deployment of scalable, reliable, and secure data infrastructure for large organizations.
Drive innovation and adoption of new technologies: Research and integrate cutting-edge tools and frameworks for data ingestion, processing, and governance.
Mentor and guide junior and mid-level data engineers: Provide technical leadership, code reviews, and career development support.
Collaborate with stakeholders across teams: Align data engineering initiatives with business objectives and ensure cross-functional alignment.
Establish and enforce data engineering best practices: Define standards for pipeline architecture, data quality, security, and compliance across the organization.
Present findings and recommendations to senior leadership: Communicate technical concepts and business impacts to executives and decision-makers.

Technical Skills:

5+ years of experience
Expert-level proficiency in programming, automation, and orchestration: Mastery of Python, and workflow orchestration tools.
Deep understanding of data storage, processing, and governance: Advanced knowledge of data warehousing, Lakehouse architectures, and real-time streaming.
Proven ability to build and deploy scalable data systems: Design and implement robust, production-grade data platforms on GCP.
Experience with big data technologies: Use Dataflow, Dataproc, Pub/sub, or similar for large-scale data processing.
Strong security and compliance expertise: Implement and enforce security controls, encryption, audit logging for data systems, and compliance standards or data systems.
Excellent communication and presentation skills: Articulate technical concepts and business value to diverse audiences.

Must Have Skills:

Python, orchestration tools (e.g. Airflow, Cloud Composer)
Data architecture: data lakes, warehouses, streaming (e.g. Pub/Sub, Dataflow, Dataproc)
Experience with GCP and production-grade data platform deployment
Data security, compliance, and governance standards
Data modeling skills - Experience with different data modeling techniques (dimensional modeling, relational modeling, should be able to design scalable data models)
SQL Skills level - Expert
Deep understanding of big query, have experience on partitioning, clustering and performance optimizations
Experience on Cloud function, Composer and Cloud run, dataflow flex templates - should be able to write.

Costco