Remote Backend Engineer, Data Acquisition

Summary

Join Lighthouse (formerly OTA Insight) as a Staff Backend Engineer and play a critical role in our data extraction process, ensuring high scalability and superior performance of our crawling infrastructure.

Requirements

• Master’s or Bachelor’s degree in a STEM field
• 5+ years experience in low-level or systems programming, with proficiency in languages such as Rust, C, C++, Golang, or similar
• You are adept at navigating through complex codebases and have the confidence to delve into and modify libraries/tools as needed, demonstrating a deep understanding and not just surface-level usage
• Strong problem-solving and analytical skills, with the ability to identify and troubleshoot complex technical issues
• Excellent communication and collaboration skills, with the ability to work effectively in a team environment
• Fluent in English

Responsibilities

• Drive the optimization and expansion of our crawling infrastructure, ensuring both high scalability and superior performance, while maintaining effective web scraping capabilities
• Introduce innovative methods for enhancing our monitoring and troubleshooting processes and tools
• Engineer scraping solutions by applying findings from our R&D
• Actively collaborate with diverse engineering teams to address challenges and advance initiatives related to backend infrastructure
• Serve as a subject matter expert, providing mentorship and support to team members while fostering an environment of continuous learning and development

Benefits

• Flexible working environment: Work from home or at one of our global offices
• Flexible time off: Autonomy to manage your work-life balance
• Collaborative team: High-bar, friendly, creative, and passionate colleagues
• Career development: Workshops, frameworks, tools, training, and processes to realize your full potential
• Impactful work: Shape products relied on by 85,000+ users worldwide
• Competitive compensation: Proactively maintained to value your work
• Referral bonuses: Earn rewards for bringing in new talent