Senior Security Data Engineer

Summary

Join Halcyon, a leading anti-ransomware platform company, as a Senior Security Data Engineer. Build and maintain robust data pipelines ingesting, processing, and delivering critical security data. Implement and operate large-scale data systems handling behavioral, network, file, and product signals. Ensure reliable, real-time data access for teams to protect customers from ransomware attacks. This hands-on role involves optimizing data infrastructure for performance and reliability, directly enabling the product's defensive capabilities. Collaborate with security researchers and product teams to meet data requirements and establish data governance processes. Optimize data infrastructure costs while maintaining performance and reliability standards.

Requirements

• 5+ years of experience in data engineering, with a focus on large-scale data systems and operations
• Strong proficiency in Python, SQL, and distributed data processing frameworks (Spark, Kafka, etc.)
• Proven experience building and maintaining production data pipelines that handle high-volume, high-velocity data
• Expertise with cloud data platforms (AWS, GCP, or Azure) and infrastructure-as-code practices
• Experience with data storage solutions, including data lakes, warehouses, and more
• Strong understanding of data quality, monitoring, and operational best practices
• Familiarity with containerization (Docker, Kubernetes) and CI/CD practices
• Cybersecurity domain knowledge

Responsibilities

• Design, build, and maintain scalable data pipelines for ingesting security data from endpoints, networks, and threat intelligence sources
• Implement and optimize both batch and real-time streaming data processing systems to support detection and prevention workflows
• Ensure data quality, reliability, and availability across all security data platforms and services
• Build and maintain data storage solutions optimized for high-volume security telemetry and fast query performance
• Collaborate with security researchers and product teams to understand data requirements and deliver reliable data services
• Monitor and troubleshoot data pipeline performance, implementing automated alerting and recovery systems
• Establish data governance processes and implement security controls for sensitive threat data
• Optimize data infrastructure costs while maintaining performance and reliability standards

Preferred Qualifications

• Experience with security data formats and sources (SIEM, EDR, network logs, threat feeds)
• Familiarity with Elastic/OpenSearch and other data platforms
• Background in stream processing frameworks (Kafka Streams, Apache Flink, etc.)
• Experience with modern data architecture patterns
• Knowledge of compliance requirements for security data handling

Benefits

• Comprehensive healthcare (medical, dental, and vision) with premiums paid in full for employees and dependents
• 401k plan with a generous employer contribution
• Short and long-term disability coverage, basic life, and AD&D insurance plans
• Medical and dependent care FSA options
• Flexible PTO policy
• Parental leave
• Generous equity offering