Remote Senior Software Engineer

Summary

Sonalake is seeking a Backend Data Extraction Engineer with 8+ years of relevant experience in backend development to design, implement, and maintain web scraping processes. The role requires proficiency in Python, knowledge of best practices for data storage and retrieval, understanding of web scraping best practices, and experience with containerized deployments and cloud computing. Benefits include a remote-first approach, training budget and days, flat organizational structure, focus on innovation, indefinite period employment contract, and emphasis on open communication and team development.

Requirements

• 8+ years of relevant experience in backend development
• Proficiency in Python is a must have
• Knowledge and experience in best of class data storage and retrieval of large volumes of scraped data
• Understanding of web scraping best practices, including handling dynamic content, user-agent rotation, and IP address management
• Proven ability in scaling and maintaining backend components in a production environment
• Experience with containerized deployments (docker, kubernetes, terraform etc.) and cloud computing (AWS is a plus)
• Conversant with continuous integration, continuous deployment, and test driven development practices
• Demonstrated experience in mentoring and coaching engineers
• Exceptional problem-solving skills and good project management capabilities
• Outstanding communication and collaboration skills

Responsibilities

• Design, implement, and maintain web scraping processes to gather data from various online sources efficiently and accurately
• Incorporate data cleansing and validation logic into the framework to uphold data integrity and accuracy
• Optimize services for efficiency and scalability, especially when dealing with a large volume of data or multiple data sources
• Stay up-to-date with legal and ethical considerations related to web scraping
• Research and nominate appropriate tools, libraries, frameworks etc. for technical project designs
• Engage with cross-functional teams and product management to gather requirements and generate ideas for improvements
• Drive complex projects with contributions from multiple engineers
• Mentor engineers and develop their performance through code/design reviews and providing technical direction

Benefits

• Remote-first approach with many team-building activities
• Every Sonalaker gets a training budget and paid training days every year to upskill
• Flat organisational structure with an emphasis on open, honest communication
• Focus on innovation: we run projects to evaluate new frameworks, create tools for internal use, contribute to the open source community and research new ways to use existing products in new problem domains
• Indefinite period employment contract