Software Engineer - Data Platform

Summary

Join Flume Health, a software company revolutionizing healthcare data management, as a talented engineer to build and operate our core data processing platform. You will design, build, and operate frameworks and infrastructure for distributed data processing using various technologies. Develop reusable tools and services to simplify data pipeline creation for healthcare integrations. Architect and implement scalable and resilient systems for real-time and batch data processing. Collaborate with cross-functional teams to deliver foundational data capabilities and ensure platform security and compliance. This role requires 3+ years of software engineering experience with a focus on backend systems and proficiency in Go and distributed data processing technologies. Flume Health offers competitive compensation, benefits, and a remote-first work environment.

Requirements

• 3+ years of professional software engineering experience, with a demonstrable focus on building backend systems, infrastructure, or platforms
• Strong proficiency in Go for building concurrent, high-performance systems-level software
• Significant experience designing, building, and operating systems leveraging distributed data processing technologies (e.g., Apache Spark, Flink, Kafka Streams) and associated cluster managers (e.g., Dataproc, EMR, YARN)
• Solid understanding of Python, particularly for data manipulation, scripting, or building frameworks
• Experience building, deploying, and operating services on cloud platforms (GCP strongly preferred, AWS acceptable) using containerization (Docker, Kubernetes)
• Proven ability to design reusable components, libraries, or frameworks that improve developer velocity and system robustness
• Deep understanding of distributed systems concepts (scalability, reliability, consistency)
• Excellent problem-solving skills and the ability to tackle ambiguous technical challenges
• Strong collaboration and communication skills

Responsibilities

• Design, build, and operate the core frameworks and infrastructure for distributed data processing using Go, Python, Apache Spark, and Google Cloud Dataproc
• Develop reusable tooling, libraries, and services that abstract complexities and empower other engineers to build reliable data pipelines for healthcare integrations (claims, eligibility, EDI)
• Architect and implement scalable and resilient systems capable of handling both real-time streams and large batch data processing workloads efficiently
• Focus on the performance, reliability, observability, and cost-effectiveness of the underlying data processing platform
• Collaborate with product managers, backend engineers, and data scientists to understand requirements and deliver foundational data capabilities
• Define and champion best practices and standards for building, deploying, and operating data processing services within Flume
• Ensure the security and compliance of the data platform, particularly given the sensitive nature of healthcare data

Preferred Qualifications

• Familiarity with data lake architectures (e.g., Apache Iceberg, Delta Lake) and associated metadata solutions
• Experience in compliance-heavy environments (Healthcare/HIPAA, Finance)
• Familiarity with healthcare data standards (EDI, HL7, FHIR)
• Experience building internal developer platforms or tooling
• Performance tuning and optimization expertise for Spark or similar distributed systems
• Experience building data quality frameworks or systems

Benefits

• Flexible PTO - you’re going to be working hard so enjoy time off
• A robust stock option plan to give our employees a direct stake in Flume’s success
• WFH stipend - we’ve always been remote first
• Competitive compensation and 401k with a 4% match
• Comprehensive health coverage (medical, dental, vision)