Data Engineer
Hubwork
- Chennai, Tamil Nadu
- Permanent
- Full-time
- Creating predictive and prescriptive models that could have a positive impact on the business.
- Driving all data analytics activities ranging from conceptualisation, visualisation to operationalisation.
- Performing statistical analysis on historical data to validate models.
- Working across stakeholders to identify and capitalise on opportunities to leverage data to drive business solutions.
- Developing scripts to process structured and unstructured data.
- Recommending, developing and implementing ways to improve data reliability, efficiency and quality.
- Supporting translation of data business needs into technical system requirements.
- Working with stakeholders to understand needs in order with respect to data structure, availability, scalability and accessibility.
- Implementing real-time analytics use-cases on the Hadoop ecosystem.
- Providing expertise on the various components & features of the Hadoop ecosystem (such as Spark, Map/Reduce, YARN, Hive, Pig, Impala/Drill etc.).
- Designing and setting up Hadoop cluster in line with current and future needs.
- Development and troubleshooting on Hadoop technologies.
- Monitoring Hadoop cluster for performance and capacity planning.
- You possess an advanced degree, ideally a PHD, in Mathematics, Statistics, Computer Science or related field.
- You have at least 2 years experience, ideally within a Data Engineer or Data Scientist role.
- Demonstrated experience working with large and complex data sets as well as experience analyzing volumes of data.
- Ability to write and execute complex queries in SQL.
- You possess strong analytical skills and are comfortable dealing with numerical data
- You are highly goal driven and work well in fast paced environments
- You are a strong team player who can manage multiple stakeholders
- Leadership Role
- Flexible working options
- Opportunity to make a positive impact