Back End Engineer - Data Fetching

Summary

Join Sensor Tower's Data Fetching Team as a Software Engineer and contribute to building and maintaining systems that collect public data from third-party sources. You will participate in the full development life cycle for data ingestion projects, ensuring the accuracy, stability, and scalability of data collection processes. Collaborate with other engineers to deliver innovative data features, discover new data sources, and increase coverage and reliability of existing pipelines. Design, implement, and maintain robust data collection pipelines, build resilient systems, and monitor and troubleshoot data pipelines for completeness, accuracy, and timeliness. Work with the compliance team to ensure data fetching adheres to applicable laws and regulations. This role requires strong problem-solving skills, attention to detail, and excellent communication and collaboration skills.

Requirements

• Solid knowledge of one or more modern software languages (Ruby, Python)
• Solid understanding of RESTful systems and the principles of good API design
• Understanding of data hygiene, validation, and versioning
• Experience with REST APIs, HTTP request libraries, and HTML parsing tools
• Ability to debug and adapt in fast-changing or partially documented data environments
• Strong problem-solving skills, attention to detail, and ability to work independently
• Excellent communication and collaboration skills

Responsibilities

• Participate in the full development life cycle for data ingestion projects, including software design, implementation, quality testing, and release
• Engage in code reviews, champion best practices, and bring new ideas to life in a collaborative environment
• Work in close cooperation with the Product team to deliver innovative new data features by discovering new data sources, increasing coverage and reliability of existing data ingestion pipelines, and connecting these to downstream feature development and data modeling
• Design, implement, and maintain robust data collection pipelines to fetch public data from third party sources
• Build resilient systems that maintain high throughput within the allowed constraints of external sources
• Monitor and troubleshoot data pipelines to ensure completeness, accuracy, and timeliness
• Track changes in external data schemas (e.g. response format updates) and adjust collection logic as needed
• Automate maintenance, alerting, and recovery for your scripts to minimize manual intervention
• Work cross functionally with our compliance team to ensure data fetching is compliant with applicable laws and regulations

Preferred Qualifications

Experience fetching public data from the Apple App Store, Google Play, or similar public-facing platforms

Benefits

• Flexible time off so employees can shape their time away from work
• Health and wellness stipend to achieve and maintain a healthy lifestyle through physical and mental fitness
• Monthly internet stipend and a one-time $500 home office stipend