Remote Staff Engineer Data Acquisition

Summary

Join Lighthouse (formerly OTA Insight) as a Staff Engineer Data Acquisition R&D to drive research and development of advanced techniques for web data extraction and processing at scale, leveraging your expertise in reverse engineering and browser technologies.

Requirements

• Master’s or Bachelor’s degree in a STEM field
• 5+ years experience in at least one of the following: Networking protocols, Browser development, Reverse engineering websites and/or mobile applications
• Strong problem-solving and analytical skills, with the ability to identify and troubleshoot complex technical issues
• Excellent communication and collaboration skills, with the ability to work effectively in a team environment
• Fluent in English

Responsibilities

• Drive the research and development of advanced techniques for web data extraction and processing at scale
• Build upon our ongoing projects, leveraging your expertise in reverse engineering and browser technologies to push the boundaries of our capabilities
• Be at the forefront of tackling web scraping challenges such as emulating user agents, scraping on multiple platforms, utilizing proxy services in a cost-efficient manner, scraping from specific locations, and effectively distributing our scraping load
• Actively collaborate with diverse engineering teams to address challenges and advance initiatives related to data extraction and infrastructure
• Serve as a subject matter expert, providing mentorship and support to team members while fostering an environment of continuous learning and development

Benefits

• Flexible working environment: Work from home or at one of our global offices
• Flexible time off: Autonomy to manage your work-life balance
• Collaborative team: High-bar, friendly, creative, and passionate colleagues
• Career development: Workshops, frameworks, tools, training, and processes to realize your full potential
• Impactful work: Shape products relied on by 85,000+ users worldwide
• Competitive compensation: Proactively maintained to value your work
• Referral bonuses: Earn rewards for bringing in new talent