Data Engineer III/IV -G (R-21564)
- Gurgaon, Haryana Bangalore, Karnataka
- Permanent
- Full-time
- Leads Level 4 operational coverage: Resolving pipeline issues / Proactive monitoring for sensitive batches / RCA and retrospection of issues and documenting defects.
- Design, build, test and deploy fixes to non-production environment for Customer testing. Work with Customer to deploy fixes on production upon receiving Customer acceptance of fix.
- Cost / Performance optimization and Audit / Security including any associated infrastructure changes
- Troubleshooting incident/problem, includes collecting logs, cross-checking against known issues, investigate common root causes (for example failed batches, infra related items such as connectivity to source, network issues etc.)
- Knowledge Management: Create/update runbooks as needed .
- Governance: Watch all the configuration changes to batches and infrastructure (cloud platform) along with mapping it with proper documentation and aligning resources.
- Communication: Lead and act as a POC for customer from off-site, handling communication, escalation, isolating issues and coordinating with off-site resources while level setting expectation across stakeholders
- Change Management: Align resources for on-demand changes and coordinate with stakeholders as required
- Request Management: Handle user requests - if the request is not runbook-based create a new KB or update runbook accordingly
- Incident Management and Problem Management, Root cause Analysis, coming up with preventive measures and recommendations such as enhancing monitoring or systematic changes as needed.
- Good hands-on Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau
- Ability to read and write sql and stored procedures.
- Good hands-on experience in configuring, managing and troubleshooting along with general analytical and problem-solving skills.
- Excellent written and verbal communication skills.
- Ability to communicate technical info and ideas so others will understand. Ability to successfully work and promote inclusiveness in small groups.
- Requires a Bachelor's degree in computer science or other related field plus 10+ years of hands-on experience in configuring and managing AWS/tableau and databricks solutions.
- Experience with Databricks and tableau environment is desired.
- This role requires extensive problem-solving skills and the ability to research an issue, determine the root cause, and implement the resolution;
- research of various sources such as databricks/AWS/tableau documentation that may be required to identify and resolve issues.
- Must have the ability to prioritize issues and multi-task.