Senior Data Engineer

Summary

Join Zignal Labs as a Senior Data Engineer and design, build, and maintain a distributed data and analytics infrastructure using open-source technologies. You will build and maintain scalable data pipelines, develop and optimize distributed systems, design and implement backend services, and collaborate with various teams. The role requires proficiency in Scala, Java, and Python, experience with Apache Spark and AWS services, and a strong understanding of computer science fundamentals. Zignal Labs offers a competitive salary, flexible time off, excellent medical benefits, paid parental leave, professional development opportunities, and a collaborative work environment. The position is fully remote, with team members across the US. The estimated salary range is $165,000 - $185,000 per year.

Requirements

• Proficiency in Scala, Java, and Python for backend development and data engineering
• Experience with Apache Spark (and Spark Streaming) and platforms like Databricks or Delta Lake
• Practical experience working with AWS services (e.g., Lambda, EC2, API Gateway)
• Experience with real-time data streaming frameworks like Apache Storm, Kafka, or Pekko
• Familiarity with search technologies such as Elasticsearch
• Experience with NoSQL databases (e.g., MongoDB, Redis), and relational databases (e.g., RDS)
• Experience with cloud-native deployments, CI/CD pipelines, and DevOps best practices
• Strong understanding of computer science fundamentals, such as algorithms, data structures, and system design
• Experience in database query optimization and performance tuning
• A bachelor’s degree (or higher) in Computer Science, Engineering, or a related field, or equivalent practical experience
• At least 3 years of experience building scalable data pipelines with Apache Spark or Databricks, or equivalent experience with Apache Storm
• Strong communication and collaboration skills, and the ability to work effectively during U.S. time zones
• Proficiency in Java or Scala, with a willingness to work in Scala

Responsibilities

• Build and maintain scalable, high-performance data pipelines for large-scale data ingestion, real-time analytics, and ML services
• Develop and optimize distributed systems that support downstream NLP, LLMs, and other AI-powered applications
• Design and implement reliable, maintainable backend services and microservices
• Write scalable, testable code and follow modern engineering practices (e.g., version control, CI/CD, code reviews)
• Collaborate with product, QA, and operations teams to co-develop and deliver technical solutions that meet user needs

Preferred Qualifications

• Exposure to workflow orchestration tools like Apache NiFi
• Experience with Python

Benefits

• Competitive salary based on the work you do
• Flexible time off – work with your manager to take the time you need
• Excellent medical, dental, and vision coverage
• Paid parental leave plan
• Professional development and growth programs
• A tight knit, collaborative, and transparent environment to help you succeed