Principal Engineer (Data Platform)

Weekday AI

  • Bangalore, Karnataka
  • Permanent
  • Full-time
  • 3 days ago
Job Description:This role is for one of Weekday's clients
Min Experience: 12 years
Location: Bengaluru
JobType: full-timeRequirements:We are looking for a seasoned Principal Engineer to lead the design and development of next-generation data pipelines that enable near real-time ingestion and processing of massive datasets using cloud-native and open-source technologies.Why Join
  • Work on cutting-edge challenges at the intersection of big data, security, and cloud computing.
  • Shape the direction of high-impact, global-scale data products.
  • Collaborate with top industry experts while strengthening your technical and architectural depth.
Key Responsibilities
  • Architect and build scalable, fault-tolerant, low-latency data pipelines for real-time/near real-time processing.
  • Partner with cross-functional teams to design innovative solutions for complex data and security problems.
  • Evaluate, adopt, and contribute to open-source technologies that enhance the data platform ecosystem.
  • Influence product and engineering teams by providing guidance on architecture and platform best practices.
  • Act as a thought leader, driving technical direction and innovation within the data engineering domain.
Required Skills & Experience
  • Experience range more than 12+ years.
  • Extensive experience architecting and scaling real-time/near real-time data systems.
  • Strong analytical and problem-solving skills, with ability to simplify complex technical challenges.
  • Deep expertise in distributed systems, concurrency, and performance optimization.
  • Proficiency in Golang, Java, or similar languages.
  • Solid understanding of gRPC streaming, serialization formats (Protobuf, Avro), and distributed security models (TLS, authentication, authorization).
  • Hands-on experience with distributed object storage (S3, GCS) and data formats (Parquet, Iceberg), including optimization for scale and performance.
  • Strong background in cloud-native data infrastructure (AWS, GCP, etc.).
  • Excellent communication skills and proven ability to influence and align teams globally.

Weekday AI

Similar Jobs

  • Data Tagging QA Specialist

    YipitData

    • Bangalore, Karnataka
    Job Description About Us: YipitData is the market-leading data and analytics firm. We analyze billions of data points every day to provide accurate, detailed insights across in…
    • 1 day ago
    • Apply easily
  • Senior Data Analyst

    Delta Air Lines

    • Bangalore, Karnataka
    About Delta Air Lines About the Company Delta Air Lines (NYSE: DAL) is the U.S. global airline leader in safety, innovation, reliability and customer experience. Powered by our…
    • 1 day ago
    • Apply easily
  • Lead Engineer - React.js

    Neighborly

    • Bangalore, Karnataka
    About Neighborly Neighborly is a local network of home service brands that will connect you to very specific vetted local experts. Our family of service professionals work with r…
    • 5 hours ago
    • Apply easily