Remote Senior Software Engineer

Summary

Alethea is seeking a Senior Software Engineer - Web Scraping Specialist with 8+ years of backend development experience to design, implement, and maintain web scraping processes. The role requires technical expertise in backend development, knowledge of Python, data storage, and cloud computing (AWS is a plus). The successful candidate will also engage with cross-functional teams, mentor engineers, and champion continual process improvement.

Requirements

• 8+ years of relevant experience in backend development
• Proficiency in Python is a must have
• Knowledge and experience in best of class data storage and retrieval of large volumes of scraped data
• Understanding of web scraping best practices, including handling dynamic content, user-agent rotation, and IP address management
• Proven ability in scaling and maintaining backend components in a production environment
• Experience with containerized deployments (docker, kubernetes, terraform etc.) and cloud computing (AWS is a plus)
• Conversant with continuous integration, continuous deployment, and test driven development practices
• Demonstrated experience in mentoring and coaching engineers, fostering their professional growth and enhancing team performance
• Exceptional problem-solving skills and good project management capabilities
• Outstanding communication and collaboration skills

Responsibilities

• Design and implement effective web scraping strategies to extract data from targeted websites
• Incorporate data cleansing and validation logic into the framework to uphold data integrity and accuracy
• Optimize services for efficiency and scalability, especially when dealing with a large volume of data or multiple data sources
• Stay up-to-date with legal and ethical considerations related to web scraping, including website terms of service, copyright, and privacy regulations
• Research and nominate appropriate tools, libraries, frameworks etc. for technical project designs based on factors such as performance, reliability, cost
• Engage with cross-functional teams and product management to gather requirements and generate ideas for improvements
• Drive complex projects with contributions from multiple engineers

Benefits

• The salary range for this position is $145,000 to $210,000, depending on the candidate's skills, experience, and qualifications. This range represents the base salary; actual compensation may vary based on relevant factors
• In addition to the base salary, we offer stock options, comprehensive benefits, unlimited PTO, and generous company holidays