Senior Software Engineer

Summary

Join Abnormal Security's Detection Team as a Senior Software Engineer! You'll build and deploy backend ETL jobs and infrastructure for a world-class detection engine, focusing on scalability and customer-centric solutions. Collaborate closely with ML and Data Science teams, owning real-time data pipelines and feature serving services. Mentorship of junior engineers is also a key aspect of this role. The ideal candidate possesses extensive data engineering experience, expertise in various tools and technologies, and a proven ability to work effectively in a fast-paced environment. This position offers the opportunity to contribute to a significant mission of making the world a safer place.

Requirements

• 5+ years of experience as a data engineer or in a similar role, with hands-on experience in building data-focused solutions
• Expertise in ETL, data pipeline design, and data engineering tools and technologies (e.g., Apache Spark, Hadoop, Airflow, Kafka)
• Experience with maintaining real-time and near real-time data pipelines or streaming services at high scale
• Experience with maintaining large scale distributed systems on cloud platforms such as AWS, GCP, or Azure, including a strong grasp of best practices in cloud-based data engineering
• A background in implementing data quality frameworks including validation, monitoring, and anomaly detection to ensure data accuracy, consistency, and reliability. You know how to design checks and alerts to maintain data integrity and quickly respond to potential issues
• Proven ability to collaborate effectively with cross-functional teams, including data scientists, machine learning engineers, product managers, and other stakeholders. You’re able to translate requirements into actionable technical tasks, communicate progress clearly, and adapt to feedback
• Excellent problem-solving skills and the ability to work independently in a fast-paced environment. You’re capable of breaking down complex challenges into manageable steps and iterating on solutions, balancing immediate needs with long-term scalability

Responsibilities

• Architect, design, build, and deploy backend ETL jobs and infrastructure that support a world-class Detection Engine
• Ownership projects that enable us to meet ambitious goals for, such as building the plan to scale components of Detection’s Data Pipeline by 10x
• Own real-time, near real-time streaming pipelines and online feature serving services
• Collaborate closely with MLE and Data Science teams, by distilling feedback, correlating it to our strategy, and executing
• Coach and mentor junior engineers via 1on1s, pair programming, high quality code reviews and design reviews

Preferred Qualifications

• Familiarity with machine learning workflows and requirements to support data science teams effectively
• Experience with streaming data architectures and real-time processing
• Knowledge of security and compliance frameworks as they relate to data engineering and data privacy