Big Data Engineer

Summary

Join ZipRecruiter's R&D center in Tel Aviv and be part of a collaborative team building cutting-edge machine learning products. This Big Data Engineer role focuses on designing and building key infrastructure components for our data science and engineering team. You will work in a high-volume production environment, mastering scalability and implementing enterprise-grade services. The position requires experience with big data technologies like Spark and cloud technologies. We offer a hybrid work environment and a fun, empowering culture that values work-life balance. ZipRecruiter is an equal opportunity employer.

Requirements

• 3+ years of coding experience with one of the following: Python, Scala
• Experience in development, maintenance, and monitoring of data applications and data pipelines
• Deal with data on high volume, high availability production systems
• Experience with Spark
• Be fluent with SQL

Responsibilities

• Build infrastructure to empower fellow engineers and data scientists to build together best-in-class machine learning based products
• Work in a high-volume production environment that gets bigger and bigger
• Master scalability and enterprise-grade production services implementation
• Take ownership - lead design for new products and initiatives as well as integrating with currently implemented best-practices
• Work with a number of modern technologies including Spark, Delta Lake, Elasticsearch, Kafka, DynamoDB, K8s, and more
• Collaborate and work as part of a highly skilled team that enjoys doing the impossible together every day

Preferred Qualifications

• Experience with one or more of these technologies: Flink, MapReduce, Airflow, Kafka, Key/Value Stores like DynamoDB, SQL DB's
• Experience working with a cloud provider (AWS / Azure / GCP)
• End-to-end experience - owning features from an idea stage, through design, architecture, coding, integration, and deployment stages
• Experience in algorithm design and implementation or Machine learning
• Bachelor's degree or higher in Computer Science or equivalent professional Software Engineering experience

Benefits

• Competitive salary
• A fun environment where work-life balance is valued
• Hybrid work environment