Security Data Engineer
Marriott Tech Accelerator
- Hyderabad, Telangana
- Permanent
- Full-time
- Implement and maintain scalable data pipelines using tools such as Cribl Stream and Splunk
- Develop and maintain ETL (Extract, Transform, Load) processes
- Ensure data quality and implement validation checks
- Automate data workflows and processes
- Work with distributed computing frameworks (e.g., Hadoop, Spark)
- Implement solutions for processing large-scale datasets
- Utilize cloud platforms (AWS, Azure) for data management
- Optimize data retrieval and query performance
- Build integrations with various data sources
- Ensure compatibility between different systems and platforms
- Implement data security controls and access management
- Maintain data integrity and reliability
- Work closely with security data scientists, analysts, and business stakeholders
- Translate business requirements into technical specifications
- Monitor and troubleshoot data system performance
- Implement optimizations for efficiency and scalability
- Ensure high availability of data resources
- 2-4 years of data engineering, data analytics, data management, and/or information security experience that includes:
- 2+ years of experience in data engineering and/or data analytics in an enterprise environment
- 1+ years of experience in information protection / information security.
- Strong background in statistics, mathematics, and software engineering.
- Proficiency in Python, R, Java, or Scala
- Strong knowledge of SQL
- Expertise in relational databases (e.g., MySQL, PostgreSQL)
- Experience with NoSQL databases (e.g., MongoDB, Cassandra)
- Familiarity with cloud platforms (AWS, Azure, GCP) and big data frameworks such as Hadoop, Spark, and Kafka
- Experience with ETL (Extract, Transform, Load) processes
- Proficiency in data pipeline development and optimization
- Knowledge of cybersecurity principles, tools, and best practices
- Programming languages: Python, R, SQL
- Big data technologies: Hadoop, Spark, and Kafka
- Cloud platforms: AWS, Azure, GCP
- Relevant certifications such as AWS Certified Data Analytics Specialty, Google Cloud Professional Data Engineer, or IBM Certified Data Engineer
- Experience with Security information and event management (SIEM) systems such as Splunk
- Experience with data pipeline management and data transformation tools such as Cribl
- Familiarity with MLOps practice
- Understanding of machine learning algorithms and AI applications in data engineering
- Verbal and written communication skills to articulate complex technical concepts to both technical and non-technical stakeholders
- Experience working in Agile and Scrum methodologies
- Bachelors degree in computer / data science, information management, Cybersecurity or related field or equivalent experience / certification