Staff Software Engineer, Cloud Systems Architect

Summary

Join Zyte's Scrapy Cloud team as a product-focused engineer, combining hands-on engineering with strategic leadership. You will own a cost-efficient, highly scalable, high-availability system hosting tens of thousands of jobs simultaneously. This role requires designing and building cloud systems, not just operating or maintaining them. The ideal candidate possesses strong Java or Python skills, experience with cloud infrastructure (beyond Kubernetes/OpenShift), and expertise in load testing and hardware profiling. You'll be part of a globally distributed team, working remotely with cutting-edge technologies. Enjoy 35 days of paid holidays.

Requirements

• Experience in designing and executing experiments, ranging from load testing and performance testing, all the way to evaluate performance of hardware components and do some basic statistical analysis
• Understanding of the modern RDBMS architecture, concepts and troubleshooting strategies
• Strong skills in either Java or Python
• Ability to fix a broken build of a cross-language application
• Proficiency in Linux internals, including namespaces, containerization options and their tradeoffs, process management, file and directory management, memory management
• Ability to benchmark and integrate commodity server hardware by both cloud and bare metal providers

Responsibilities

• Design and build cloud systems
• Own a cost-efficient, highly scalable, high-availability system responsible for hosting and running tens of thousands of jobs simultaneously
• Radically improve the product in an always changing environment

Preferred Qualifications

• Experience with HBase and Mesos
• Good presentation and mentoring skills
• Experience beyond using or managing Kubernetes/OpenShift and are comfortable designing cloud infrastructure
• Experience with load testing, hardware profiling, or program benchmarking
• Expertise beyond high-level web frameworks like Spring Boot, Django, Jersey, or Vert.x
• Experience developing cloud solutions rather than primarily working as a solution architect for pre-built technologies

Benefits

• Work from anywhere
• Work with cutting-edge open-source technologies and tools
• 35 days paid holidays