Databricks Developer

Milestone Technologies

  • Hyderabad, Telangana
  • Permanent
  • Full-time
  • 2 days ago
Role Overview:We're seeking a Senior Databricks Developer to build scalable and performant data workflows using modern data stack tools. This role will focus on engineering robust pipelines to transform raw data into reliable datasets for analytics and business use.Responsibilities:
  • Build and maintain production-grade Python, PySpark, Databricks, API Design.
  • Develop scalable, fault-tolerant data ingestion and transformation logic in the cloud.
  • Optimize queries and transformation logic for performance and cost-efficiency.
  • Ensure pipeline observability, error handling, and alerts for smooth operations.
  • Collaborate closely with analytics, product, and data science teams to support data needs.
Must-Have Skills:
  • 4+ years of hands-on experience with Python, Databricks, DBT, Spark (PySpark), and AWS S3/Glue/Redshift.
  • Hands on experience in multi-tenant environments that would include AWS, Azure and GCP
  • Experience with Airflow or other workflow orchestration frameworks.
  • Proficient in SQL, Python, and working with large-scale datasets.
  • Familiar with data warehouse design, schema evolution, and data versioning.

Milestone Technologies