Web Scraping Developer

Summary

Join Zyte's Delivery team as a Software Engineer and contribute to the development and maintenance of Scrapy web crawlers. You will leverage the Zyte platform and open-source projects for distributed data extraction and processing. This role involves identifying and resolving performance issues in large-scale distributed crawling and contributing to open-source projects like Scrapy. The ideal candidate possesses 3+ years of Python software development experience, solid Python knowledge, and familiarity with Linux/UNIX, HTTP, HTML, Javascript, and Networking. Zyte offers a flexible work environment, opportunities to attend conferences, and 35 days of paid holidays.

Requirements

• 3+ years of software development experience in Python
• Solid Python knowledge
• Familiarity with Linux/UNIX, HTTP, HTML, Javascript and Networking
• Good communication in written and spoken English
• Availability to work full time

Responsibilities

• Design, develop and maintain Scrapy web crawlers
• Leverage the Zyte platform and our open source projects to perform distributed information extraction, retrieval and data processing
• Identify and resolve performance and scalability issues with distributed crawling at scale
• Help identify, debug and fix problems with open source projects, including Scrapy

Preferred Qualifications

• Scrapy experience is a big plus
• Familiarity with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, NLTK, pandas, scikit-learn, mapreduce, nosql, etc)
• Proficient English

Benefits

• Become part of a self-motivated, progressive, multi-cultural team
• Have the freedom and flexibility to work from where you do your best work
• Attend conferences and meet with team members from across the globe
• Work with cutting-edge open source technologies and tools
• 35 days paid holidays