Staff GCP Data Engineer

Bangalore, Karnataka
Permanent
Full-time

28 days ago

Who are we?Equinix is the world’s digital infrastructure company®, operating over 260 data centers across the globe. Digital leaders harness Equinix's trusted platform to bring together and interconnect foundational infrastructure at software speed. Equinix enables organizations to access all the right places, partners and possibilities to scale with agility, speed the launch of digital services, deliver world-class experiences and multiply their value, while supporting their sustainability goals.Our culture is based on collaboration and the growth and development of our teams. We hire hardworking people who thrive on solving challenging problems and give them opportunities to hone new skills and try new approaches, as we grow our product portfolio with new software and network architecture solutions. We embrace diversity in thought and contribution and are committed to providing an equitable work environment that is foundational to our core values as a company and is vital to our success.Job SummaryAs a key member of the Data Team at Equinix, we are seeking an experienced GCP Data Engineer who will lead end-to-end development of complex Data Engineering use cases and drive the evolution of Equinix's Data Lake platform. You will design and build enterprise-scale data infrastructure and analytics solutions on Google Cloud Platform while providing technical mentorship to the data engineering team. The ideal candidate combines deep technical expertise in cloud-native data technologies with proven leadership skills and a passion for building robust, scalable data platforms that drive strategic business insights.ResponsibilitiesParticipate in design and implementation of enterprise-scale data pipelines and platform architecture for End-to-End data productsDevelop fault-tolerant, petabyte-scale data processing systems using advanced GCP servicesEvaluate and recommend new technologies, tools, and architectural approachesBuild complex ETL/ELT workflows using Cloud Dataflow, Composer, Dataform/dbt, BigQuery and custom solutionsImplement sophisticated real-time streaming architectures with Cloud Pub/Sub, Kafka and Apache BeamDesign and optimize data processing workflows for performance, cost, and reliabilityDevelop advanced data transformation logic and custom processing functionsImplement data architectures and microservices-based data platformsDesign multi-environment deployment strategies and automated scaling solutionsEstablish monitoring, alerting, and observability frameworks across the data platformLead code reviews and establish quality assurance processesProvide technical guidance on complex problem-solving and optimization techniquesFacilitate knowledge sharing sessions and technical training programsCollaborate with hiring managers on technical interviews and team expansionImplement comprehensive data governance frameworks and compliance controlsDesign fine-grained access controls and data classification systemsEstablish automated data quality monitoring and lineage trackingEnsure GDPR, SOX, and other regulatory compliance across data workflowsImplement privacy-preserving techniques and data anonymization strategiesTranslate complex business requirements into scalable technical solutionsCoordinate cross-functional initiatives involving multiple engineering teamsQualifications
Technical ExpertiseGCP Services: 5+ years hands-on experience with BigQuery (advanced SQL, scripting, ML integration), Cloud Dataflow, Cloud Composer, Cloud Storage, Pub/Sub, and Vertex AIProgramming: Expert-level Python/Java programming, proficiency in Python/Scala for Spark developmentAdvanced Technologies: Deep experience with Apache Beam, Airflow, Kubernetes, Docker, and distributed computingInfrastructure: Extensive experience with Terraform, CI/CD pipelines, and cloud infrastructure managementDatabase Systems: Advanced knowledge of both relational and NoSQL databases, data modeling, and performance optimizationProfessional ExperienceBachelor’s or master’s degree in computer science, Engineering, or related field5+ years of data engineering experience with 4+ years specifically on Google Cloud PlatformProven track record of delivering complex, enterprise-scale data solutionsExperience with data governance, compliance, and security frameworksExcellent written and verbal communication skills with ability to present to executivesExperience working with cross-functional projects and managing stakeholder relationshipsProven ability to translate business requirements into technical solutionsPreferred QualificationsGoogle Cloud Professional Data Engineer certificationExperience with MLOps, feature stores, and machine learning pipeline developmentKnowledge of data science workflows and statistical analysisExperience with BI tools (Looker, Tableau) and advanced analytics platformsEquinix is committed to ensuring that our employment process is open to all individuals, including those with a disability. If you are a qualified candidate and need assistance or an accommodation, please let us know by completing .Equinix is an Equal Employment Opportunity and, in the U.S., an Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to unlawful consideration of race, color, religion, creed, national or ethnic origin, ancestry, place of birth, citizenship, sex, pregnancy / childbirth or related medical conditions, sexual orientation, gender identity or expression, marital or domestic partnership status, age, veteran or military status, physical or mental disability, medical condition, genetic information, political / organizational affiliation, status as a victim or family member of a victim of crime or abuse, or any other status protected by applicable law.

Equinix

Apply Now