Software Engineer II, Data

Summary

Join FiscalNote's Data Engineering team as a Software Engineer to scale and improve data processing capabilities. You will design, build, and support services handling a large collection of policy and policymaker data, creating reliable systems for timely and accurate data delivery. This role involves designing systems that integrate with partners in applications and data science, providing customers with automated analysis and reporting. You will work with a full stack of technologies and collaborate with team members to overcome technical challenges. The ideal candidate possesses strong technical skills and experience in backend or data engineering, along with excellent communication and collaboration abilities.

Requirements

• 3-5+ years of professional experience as an individual contributor in the software development industry, with a focus on backend or data engineering
• Strong SQL skills and understanding of relational databases (especially PostgreSQL or MySQL)
• Significant experience designing and developing within a networked architecture, using APIs and/or message-based communication
• Proficiency with a version control system, especially git
• Proven ability to both work independently and as part of a collaborative team
• Have experience with a successful working relationship with Product + UI/UX teams
• Experience working with automated test and/or build systems

Responsibilities

• Design, communicate, and develop solutions to complex problems
• Evaluate technical choices and their tradeoffs objectively, ensuring the best path forward for the team
• Write robust, maintainable, and readable code
• Identify opportunities to improve our codebase or reduce the complexity of our architecture
• Build data services for batch and real-time data processing
• Enhance monitoring tools for data pipelines’ health and data quality
• Create and enhance internal tools used for data review and augmentation
• Work with a full stack of technologies, including API services, databases, scheduled workers, queuing infrastructure, AI models, UI frontends, ELT pipelines, text search infrastructure, and more!

Preferred Qualifications

• Proficiency in Python
• Experience running production services on Linux
• Familiarity with a Cloud computing platform (AWS, GCP, Azure, etc)
• Experience with containerization tools (especially Docker, Kubernetes)
• Experience with document-based stores (NoSQL, JSONB, Elasticsearch)
• Experience with Airflow
• Experience writing and maintaining code in PHP
• Familiarity with video and audio conversion tools like ffmpeg, yt-dlp