Senior Data Engineer

Summary

Join Nord Security's Threat Intelligence team and contribute to building and maintaining scalable data pipelines using Python, SQL, and PySpark. You will develop and maintain lakehouse architectures using Apache Hudi, implement efficient ETL/ELT processes, and optimize data storage and query performance. Responsibilities include ensuring data quality, governance, and lineage, and collaborating with data scientists and engineers. This role requires a Bachelor's degree in a related field, 2+ years of experience as a Data Engineer, and expertise in Lakehouse architecture and Apache Hudi. Strong programming skills in Python and PySpark are essential, along with experience with Airflow, Kafka, or streaming data pipelines. The position offers various benefits, including access to Nord Security products, professional growth opportunities, health benefits, mental wellbeing support, team-building activities, and flexible working arrangements.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related field
• 2+ years of experience as a Data Engineer, working with large-scale distributed systems
• Proven expertise in Lakehouse architecture and Apache Hudi in production environments
• Experience with Airflow, Kafka, or streaming data pipelines
• Strong programming skills in Python and PySpark
• Comfortable working in a cloud-based environment (preferably AWS)
• Strong communication and collaboration skills

Responsibilities

• Design, build, and manage scalable data pipelines using Python, SQL, and PySpark
• Develop and maintain lakehouse architectures, with hands-on use of Apache Hudi for data versioning, upserts, and compaction
• Implement efficient ETL/ELT processes for both batch and real-time data ingestion
• Optimize data storage and query performance across large datasets (partitioning, indexing, compaction)
• Ensure data quality, governance, and lineage, integrating validation and monitoring into pipelines
• Work with cloud-native services (preferably AWS – S3, Athena, EMR) to support modern data workflows
• Collaborate closely with data scientists, analysts, and platform engineers to deliver reliable data infrastructure

Preferred Qualifications

• Knowledge of CI/CD, Infrastructure as Code (IaC) like Terraform
• Exposure to data cataloging tools (e.g., Glue Data Catalog, Amundsen)
• Interest or experience in cybersecurity or secure data design

Benefits

• Access to Nord Security products
• Professional growth. Internal and external events, online training, conferences, books - everything you need to reach full potential
• Health benefits. Private health insurance, online and on-site workouts, consultations to feel and be your best
• Mental wellbeing. Access to mental health tools like Calm, Headspace, and Mindletic. Options for therapy to keep your emotional wellbeing in check
• Team spirit. Team buildings and parties with games, shows, tastings, food coupons, gifts, and it’s on us
• More free time. Stay with us and additional vacation days will be added to your calendar
• Additional paid leave. Additional days are covered by us in cases of illness or special occasions
• Flexibility. Flexible working time arrangement