Senior Digital Solutions Consultant

Worley

  • Mumbai, Maharashtra
  • Permanent
  • Full-time
  • 1 month ago
  • We deliver the world’s most complex projects
  • Work as part of a collaborative and inclusive team
  • Enjoy a varied & challenging role
Building on our past. Ready for the futureWorley is a global professional services company of energy, chemicals and resources experts headquartered in Australia.Right now, we’re bridging two worlds as we accelerate to more sustainable energy sources, while helping our customers provide the energy, chemicals and resources that society needs now.We partner with our customers to deliver projects and create value over the life of their portfolio of assets. We solve complex problems by finding integrated data-centric solutions from the first stages of consulting and engineering to installation and commissioning, to the last stages of decommissioning and remediation. Join us and help drive innovation and sustainability in our projects.The Role
  • Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform.
  • Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale.
  • Optimize and troubleshoot AWS Glue jobs for performance and reliability.
  • Utilize Python and PySpark to efficiently handle large volumes of data during the ingestion process.
  • Collaborate with data architects to design and implement data models that support business requirements.
  • Create and maintain ETL processes using Airflow, Python and PySpark to move and transform data between different systems.
  • Implement monitoring solutions to track data pipeline performance and proactively identify and address issues.
  • Manage and optimize databases, both SQL and NoSQL, to support data storage and retrieval needs.
  • Familiarity with Infrastructure as Code (IaC) tools like Terraform, AWS CDK and others.
  • Proficiency in event-driven integrations, batch-based and API-led data integrations.
  • Proficiency in CICD pipelines such as Azure DevOps, AWS pipelines or Github Actions.
QualificationsAbout YouTo be considered for this role it is envisaged you will possess the following attributes:
  • Technical and Industry Experience:
  • Independent Integration Developer with over 5+ years of experience in developing and delivering integration projects in an agile or waterfall-based project environment.
  • Proficiency in Python, PySpark and SQL programming language for data manipulation and pipeline development
  • Hands-on experience with AWS Glue, Airflow, Dynamo DB, Redshift, S3 buckets, Event-Grid, and other AWS services
  • Experience implementing CI/CD pipelines, including data testing practices.
  • Proficient in Swagger, JSON, XML, SOAP and REST based web service development
  • Behaviors Required:
  • Driven by our values and purpose in everything we do.
  • Visible, active, hands on approach to help teams be successful.
  • Strong proactive planning ability.
  • Optimistic, energetic, problem solver, ability to see long term business outcomes.
  • Collaborative, ability to listen, compromise to make progress.
  • Stronger together mindset, with a focus on innovation & creation of tangible / realized value.
  • Challenge status quo.
  • Education – Qualifications, Accreditation, Training:
  • Degree in Computer Science and/or related fields
  • AWS Data Engineering certifications desirable
Moving forward togetherWe’re committed to building a diverse, inclusive and respectful workplace where everyone feels they belong, can bring themselves, and are heard. We provide equal employment opportunities to all qualified applicants and employees without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by law.We want our people to be energized and empowered to drive sustainable impact. So, our focus is on a values-inspired culture that unlocks brilliance through belonging, connection and innovation.And we're not just talking about it; we're doing it. We're reskilling our people, leveraging transferable skills, and supporting the transition of our workforce to become experts in today's low carbon energy infrastructure and technology.Whatever your ambition, there’s a path for you here. And there’s no barrier to your potential career success. Join us to broaden your horizons, explore diverse opportunities, and be part of delivering sustainable change.

Worley