Security Data Engineer

Summary

Join UltraViolet Cyber, a leading unified security operations company, as a Data Pipeline Engineer. You will design and build scalable data pipelines for ingesting various data types, develop and maintain orchestration workflows using tools like Apache Airflow, onboard new data sources, and manage schema drift. This role requires collaboration with multiple teams to align ingestion with security use cases. The ideal candidate possesses extensive experience in data engineering, strong Python and distributed data processing skills, and familiarity with orchestration frameworks. The position offers a competitive salary range of $150,000-$190,000 annually. UltraViolet Cyber values diversity and encourages applications from all backgrounds.

Requirements

• 8​+ years of experience in data engineering or infrastructure roles focused on pipeline development
• Strong experience with Python and distributed data processing tools like Apache Spark or PySpark
• Hands-on experience with orchestration frameworks like Apache Airflow, Dagster, or similar
• Deep understanding of ingestion best practices, schema evolution, and drift handling
• Experience working with Kafka, S3, or cloud-native storage and messaging systems
• Experience in cloud environments (AWS, Azure, or GCP)

Responsibilities

• Design and build scalable batch and streaming data pipelines for ingesting telemetry, log, and event data
• Develop and maintain orchestration workflows using tools like Apache Airflow or similar schedulers
• Use tools like Cribl, Logstash, Fluentd, or similar for data routing, filtering, and enrichment at scale
• Onboard new data sources, build connectors (API/Kafka/file-based), and normalize security-related datasets
• Monitor and manage schema drift across changing source systems and formats
• Implement observability into pipelines — logging, metrics, and alerts for health and performance
• Optimize ingestion for performance, resilience, and cost-efficiency
• Collaborate across detection, threat intel, and platform teams to align ingestion with security use cases

Preferred Qualifications

Familiarity with security tools (e.g., Crowdstrike, Wiz), OCSF, or compliance-related data