Senior Software Engineer, Big Data

ZipRecruiter
Summary
Join ZipRecruiter, a leading online employment marketplace, and contribute to building efficient applications and data processing pipelines at scale. We are seeking generalist software engineers to develop fast, scalable, and effective applications, stream and batch data processing, and ML infrastructure. This role involves building data-driven systems and applications to connect job seekers with opportunities. The position offers a hybrid work environment, with most US-based roles eligible for remote work. We utilize a complex technology stack and require engineers proficient in writing evolvable, well-instrumented, and efficient code within a distributed system. The ideal candidate will help drive innovation and the evolution of ZipRecruiter's platform.
Requirements
- 5+ years of professional software development experience with a focus on big data technologies
- Experience with Hadoop, Spark, Hive, and/or other big data technologies
- Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
- Experience with containerization technologies like Docker and/or Kubernetes
Responsibilities
- Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
- Deploy a range of cloud-based technologies for critical projects
- Write, test, instrument, and deploy code to our Kubernetes environment
- Help drive the innovation and evolution of ZipRecruiter
Preferred Qualifications
- 8+ years of professional software development experience, with a focus on big data technologies
- BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
- Experience with data integration tools like Apache Kafka, Flume, and NiFi
- Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
- Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks
Benefits
- Competitive compensation
- Exceptional benefits package
- Flexible Vacation & Paid Time Off
- Employer-matched 401(k) plan