
Manager, Data Operations and Management
- Hyderabad, Telangana
- Permanent
- Full-time
- Implement and support automated data quality checks for accuracy, completeness, timeliness, and consistency across datasets.
- Develop validation frameworks for ingestion pipelines, curated layers, and reporting models in platforms like BigQuery and Redshift.
- Integrate data quality controls into CI/CD pipelines and orchestration tools (e.g., Airflow, Cloud Composer).
- Respond to and resolve data quality incidents and discrepancies across data domains and systems.
- Collaborate with engineering and product teams to implement root cause analysis and build long-term remediation strategies.
- Establish SLAs and alerting thresholds for data quality KPIs.
- Cloud Platform Integration
- Deploy scalable data quality monitoring solutions across GCP (BigQuery, Cloud Storage) and AWS (Redshift, S3, Glue).
- Leverage platform-native services and third-party tools for automated profiling, rule enforcement, and anomaly detection.
- Partner with data governance teams to align quality rules with business glossary terms, reference data, and stewardship models.
- Integrate quality metadata into governance tools such as Collibra, enabling lineage and audit tracking.
- Documentation, Enablement & Collaboration
- Maintain playbooks, documentation, and automated reporting for quality audits and exception handling.
- Collaborate with data owners, analysts, and data product teams to promote a culture of data trust and shared ownership.
- Provide training and knowledge-sharing to enable self-service quality monitoring and issue triaging.
- 5+ years of experience in data quality engineering, data operations, or data pipeline support, ideally in a cloud-first environment.
- Building and managing data quality checks (e.g., null checks, duplicates, data drift, schema mismatches)
- SQL and Python for quality validation and automation
- Working with cloud-native data stacks: BigQuery, Redshift, GCS, S3
- Data quality monitoring tools or frameworks (e.g., Dataplex, Lightup, Collibra)
- Strong troubleshooting skills across distributed data systems and pipelines.
- Bachelors degree in Computer Science, Information Systems, or related field.
- Experience in Retail or Quick Service Restaurant (QSR) environments with high-volume data ingestion and reporting requirements.
- Familiarity with data governance platforms (e.g., Collibra) and integration of quality rules into metadata models.
- Exposure to AI/ML data pipelines and the impact of data quality on model performance.
- Current GCP Associates (or Professional) Certification.