Senior Security Data Engineer
- Hyderabad, Telangana
- Permanent
- Full-time
- Design, implement, and maintain scalable data pipelines for ingesting logs and events from CrowdStrike, ServiceNow, and other security/IT systems into centralized storage and analytics platforms.
- Build and manage robust API-based integrations (REST/JSON) to collect data from CrowdStrike Falcon APIs, ServiceNow APIs, and other SaaS tools on scheduled and near real-time cadences.
- Develop ETL/ELT processes to clean, normalize, and join disparate data sources (raw logs, ticketing, endpoint telemetry, CMDB) into curated security-domain datasets optimized for analytics and reporting.
- Model and maintain schemas, views, and tables that serve as the foundation for Tableau dashboards, KPIs, SLA reporting, and security metrics.
- Implement alerting logic and data structures that support operational dashboards supporting alerting and monitoring based on combined CrowdStrike, ServiceNow, Nimbus and log data.
- Design and automate secure, reliable data transfer workflows between 3rd party API’s, storage solutions (e.g., object storage, data warehouses, databases) using scripting and orchestration tools.
- Create and maintain reusable scripts and frameworks for data collection, transformation, data quality checks, and pipeline monitoring.
- Monitor data quality, completeness, and timeliness; implement validation, observability, and self-healing mechanisms for pipelines.
- Collaborate with security engineers, incident responders, and analysts to understand use cases and translate them into data models, metrics, dashboards, and automated alerting.
- Provide technical leadership and mentorship, code review, and mentoring for junior engineers and analysts working on data and automation initiatives.
- 5–7+ years of experience in data engineering, analytics engineering, or similar roles, preferably in a security or IT operations environment.
- Strong proficiency in Python and SQL for complex queries, Log parsing & normalization (SIEM pipelines), SOAR automation, Threat intel ingestion.
- Advanced experience with Python for building ETL/ELT jobs, API integrations, data quality checks, and automation frameworks.
- Bash and Shell for CI/CD security checks, Incident response scripts System-level data collection and Automation across environments
- Solid experience with REST APIs and JSON, including authentication, pagination, error handling, and rate limiting.
- Hands-on experience integrating data from security platforms (ideally CrowdStrike Falcon) and ITSM tools (ideally ServiceNow) into data warehouses or analytics platforms.
- Experience designing data models and pipelines to support BI tools, preferably Tableau (extracts, performance tuning, data source design).
- Strong scripting experience (e.g., Bash and/or PowerShell) to automate data movement, file handling, and integration of tasks across storage systems and platforms.
- Demonstrated experience automating data transfer between Nimbis storage and other storage platforms (e.g., cloud object storage, on-prem storage, or data lakes), including scheduling, monitoring, and error handling.
- Familiarity with workflow orchestration tools (e.g., Airflow, Prefect, dbt, or cloud-native equivalents).
- Knowledge of security/SOC concepts (incidents, detections, tickets, CMDB/asset data, log types) and how they map into analytics, alerting, and reporting.
- Strong understanding of data engineering best practices: version control, CI/CD for data, code review, testing, and documentation.
- Experience with modern cloud data warehouses (e.g., Snowflake, BigQuery, Azure Synapse, Redshift) or traditional RDBMS used as Tableau backends.
- Experience working with log storage and SIEM or data lake platforms.
- Rust for Secure systems programming, Memory safety for agents & parsers and Growing in security tooling
- Background security operations, threat hunting, or incident response.
- Demonstrates calm decision-making under pressure, able to prioritize clearly when data, requirements, and stakeholders are noisy or ambiguous.
- Thrives in greenfield or rapidly changing environments, comfortable building processes, standards, and documentation from scratch rather than relying on established playbooks.
- Natural mentor who enjoys coaching junior engineers and analysts, giving clear feedback, pairing on complex problems, and creating growth paths for the team.
- Strong communicator who can translate technical tradeoffs into language that leadership, security operations, and non-technical partners understand.
- High ownership mindset takes responsibility for outcomes, not just tasks, and proactively identifies gaps in logging, data quality, or reporting and drives them to closure.
- Balances pragmatism and engineering rigor, knowing when to ship a workable solution quickly and when to invest in robustness, automation, and refactoring.
- Comfortable setting direction for a new function (roadmaps, standards, tooling choices) and influencing without formal authority across security, IT, and data teams.
- Emotionally mature, able to absorb “chaos” (conflicting priorities, incidents, urgent asks) without passing stress downstream to junior team members.
- Collaborative and low-ego, defaults to sharing credit, taking blame when needed, and fostering a psychologically safe environment where junior teammates can learn from mistakes.