Bigdata Cloud Developer - Spark - Assistant Manager
State Street
- Hyderabad, Telangana
- Permanent
- Full-time
- Expected to spend 100% of the time on hands-on development, design and architecture
- Experience in Finance and FCC is a plus
- Work shift timings : 11 AM IST to 8 PM IST / 12 PM IST to 9 PM IST
- Extensive working knowledge and expertise in Spark on Scala, AWS and Databricks
- Should have worked on DataSync, DMS, DBFS Utils, Clusters, Notebooks and Workflows
- Should have on performance tuning of workflows and jobs in Databricks
- Should have worked as a Data Engineer
- Should be able to work independently on their stories with minimum input and directions
- Should be a proactive communicator and a team player
- 8+ Years of IT experience with relevant qualifications
- 3+ years of industry experience in AWS/Databricks
- Work experience on enterprise applications is a must.
- Extensive experience on Data Analysis, ETL Development , Design, and performance tunings using Spark on Scala,
- Should have working knowledge of python for wrapper scripts, orchestrations etc
- Should have worked with RDBMS,Data Warehouses and Unix Shell Scripts
- Financial domain knowledge is a plus
- Excellent verbal and written communication
- Agile experience
- Must have : Hadoop, Spark, Scala, Unix shell scripting, Cloud Migration,AWS, Databricks
- SVN, GIT, JFrog,Jenkins,VeraCode, SQL, ETL,RDBMS
- Nice to have : Airflow, Quantexa, JFrog,Jenkins,VeraCode
- Preferable to computer science degree
- 3+ years of experience in development in global teams
- Good at communication and implementation