Collibra Integration Engg (AWS)

ITI Data

  • Hyderabad, Telangana Secunderabad, Telangana
  • Permanent
  • Full-time
  • 24 days ago
Location Country India Location Region Location City Hyderabad Job Details Locations: India Type: Full-time Experience: 8-10 years Functions: Consulting, Finance, Information Technology, Data Governance Industries: Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Business Travel Healthcare Job Duties Work with business and requirement teams to formulate Collibra integration design with external metadata repositories (such as Informatica Metadata Manager, Apache Atlas, AWS Glue etc.), authoritative data sources (Oracle, Teradata, AWS, Snowflake etc. and other ETL tools (Ab Initio, Informatica) and programming languages (Python, Java, SQL) As per requirements (functional/non-functional/operational) design & build scalable, generic integration solution using Python with Collibra as centralized Data Governance platform for use cases such as technical metadata, lineage, Data Quality, reference data etc. Design metamodel of assets and their characteristics on DGC as per workflow requirements Configure JSON in order to customize Asset relationship/lineage diagrams on DGC Design Collibra community and domains and modularize the asset residence hierarchy as per business requirements Build integration solutions using Collibra Core, Import & Catalog APIs in Python or core Java Design and build generic utilities to export/Import metadata to/from Collibra DGC using Python or core Java Extensive Knowledge of Python internals, deployment and execution methodologies Build low-latency compute-intensive integrations leveraging several Python modules (requests, flask, pandas, subprocess, logging, os etc) Build generic utilities to perform full CDC on incoming data and while importing assets into DGC Perform Collibra DGC and Console integrations with Identity & Access Management systems (SSO/LDAP) Onboard technical & business stewards on DGC as per the predefined roles and responsibilities Build Collibra asset monitoring & lifecycle dashboards on DGC Perform capacity planning and avoid scaling and performance issues of the designed solution Develop source code, unit test, participate in code reviews, deploy code to multiple environments Lead onsite and offshore teams and enable developers with clear and precise designs and planning to implement the design Perform capacity planning and avoid scaling and performance issues of the designed solutions Liaise with all SDLC support teams to ensure seamless deployment to controlled environments and thus ensuring application robustness Voice the opinions to multiple teams and thus driving the entire initiative with strong leadership Diligently teaming with the infrastructure, network, database, application and business teams to guarantee high data quality and availability Key Responsibilities Bachelor's Degree or equivalent in computer science/related and minimum 8+ years experience Certified as Level 3 expert from Collibra Require Collibra DGC meta model design/customization experience with creation/configuration of DGC meta model assets and their relationships within and across domains/communities Require experience in building API based integration middleware for Collibra DGC, compatible with Collibra integration standards supporting Collibra assets onboarding, maturity lifecycle Require hands-on experience in operating on Collibra Core, Import & Catalog APIs Require hands-on experience in operating on Output Module of Collibra Core APIs Require hands-on expertise in payload manipulation, aggregation, data type conversion using Python or Java Require hands-on expertise in building scanners for parsing SQL constructs Require integration experience with other metadata tools such as Informatica, Ab Initio, Apache Atlas, Cloudera Navigator etc. Require expertise in load management using real-time or batch-based integration approach Require hands-on experience using RAML, REST API, SOAP, JSON, XML etc. Require hand-on experience on Collibra Marketplace connectors in integration architecture Preferred Mule 4.* runtime exposure. Preferred Collibra BPMN workflow development & Help Desk, Data Catalog exposure Ability to use Collibra products, predict application issues and design proactive resolutions Require to be part of Production Rollouts of successful implementation of Collibra integrations Require expertise on Performance Analysis and perform code reviews and designs in order to improve performance Require expertise on capacity planning based on data volumes, processing complexity and SLAs Require Technical Coordination skills to drive requirements, design with multiple teams Financial services and Healthcare industry experience preferred Requires aptitude to help build skillset within organization Education Level Bachelor's Degree Experience Level 7 - 9 years

foundit

Similar Jobs

  • Info Security Engg Consultant - Sailpoint/Imprivata

    UnitedHealth Group

    • Hyderabad, Telangana
    Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health o…
    • 20 days ago
  • Principal Software Engineer - Engg

    GEP

    • Hyderabad, Telangana
    Company Overview GEP is a diverse, creative team of people passionate about procurement. We invest ourselves entirely in our client’s success, creating strong collaborative relat…
    • 26 days ago
  • Principal Software Engineer - Engg

    GEP Worldwide

    • Hyderabad, Telangana
    • Secunderabad, Telangana
    What you will do Responsible for managing timely and quality deliverables through Agile or Iterative development process. Responsible for collaborating with the existing technology…
    • 24 days ago