Competera Pricing Platform is hiring a
Senior software engineer

Summary

Competera is seeking a Senior Software Engineer with 5+ years of experience in web scraping to help build cutting-edge tech solutions using Python and various libraries. The role involves designing scalable services, mentoring junior engineers, automating processes, applying DDD principles, and staying updated with advancements in web scraping. Competera offers a rich software stack, remote work, flexible hours, regular performance reviews, onboarding support, and various benefits.

Requirements

• 5+ years of experience as a Software Engineer with a strong track record in web scraping
• Proven expertise in Python and relevant libraries like Scrapy, Selenium, Pyppeteer, Playwright
• In-depth understanding of web protocols and how modern web works (SSL, proxies, cookies, headers, browsers)
• Experience with anti-scraping detection and bypass techniques
• Experience with Kafka, Redis, and microservices architecture
• Familiarity with Domain-Driven Design (DDD) principles

Responsibilities

• Design and implement scalable and efficient services for a web scraping system using Python and relevant libraries
• Lead the development team in overcoming anti-scraping measures such as CAPTCHAs, rate limiting, and dynamic content loading
• Mentor and guide junior engineers in the team, fostering their growth and development
• Automate existing scraper development processes using tools and frameworks to improve efficiency and maintainability
• Monitor system performance and proactively identify and address any issues
• Design and implement microservices architecture for modularity and scalability

Preferred Qualifications

• Experience with cloud platforms like AWS or GCP
• Experience with data quality and cleaning techniques
• Knowledge of machine learning and data analysis techniques

Benefits

• Rich innovative software stack, freedom to choose the best suitable technologies
• Remote-first ideology: freedom to operate from the home office or any suitable coworking
• Flexible working hours (we start from 8 to 11 am) and no time tracking systems on
• Regular performance and compensation reviews
• Recurrent 1-1s and measurable OKRs
• In-depth onboarding with a clear success track
• Competera covers 70% of your training/course fee
• 20 vacation days, 15 days off, and up to one week of paid Christmas holidays
• 20 business days of sick leave
• Partial medical insurance coverage
• We reimburse the cost of coworking