Senior Data Engineer

Summary

Join Topography Health as a Senior Data Engineer and contribute to improving patient outcomes through innovative clinical research. You will build and optimize big data pipelines, integrating Electronic Health Records (EHR) using FHIR standards and APIs. This role involves collaborating with cross-functional teams to ensure robust and efficient data pipelines compliant with HIPAA regulations. Leverage your expertise in data pipelining, SQL, Snowflake, and Airflow to enhance existing integrations and contribute to data-driven decision-making in clinical trials. You will also mentor junior engineers and proactively suggest improvements to data processes. This is a chance to make a significant impact on patient care and clinical research.

Requirements

• 6+ years of professional work experience in healthcare data engineering
• 4+ years of experience with Airflow or other orchestration tool (Dagster or Prefect)
• 3+ years of experience with relational databases and SQL
• 3+ years of experience with cloud-based infrastructure
• 3+ years programming proficiency in Python
• 3+ years of experience with any type of SQL databases
• 3+ years of experience with HIPAA compliance

Responsibilities

• Implement and optimize integrations with Electronic Health Records (EHR) using FHIR standards and APIs
• Enhance and maintain existing EHR integrations in an EMR/EHR agnostic environment without building from scratch
• Build and optimize scalable data pipelines and architectures for extracting, transforming, and loading (ETL) data from various sources
• Ensure data pipelines are robust, efficient, and compliant with HIPAA regulations
• Perform data exploration to understand data patterns and anomalies
• Debug and resolve issues related to data inconsistencies and pipeline failures
• Work closely with Data Scientists, Software Engineers, Product Managers, and end-users such as Clinical Research Coordinators (CRCs) and Engagement Managers
• Understand and translate business requirements into technical solutions
• Participate in building and auditing our data infrastructure, including data warehouses and reporting stacks
• Utilize modern data tools like SQL, Snowflake, and Metabase; familiarity with Airflow is a plus
• Implement best practices for data security and compliance, focusing on HIPAA requirements
• Proactively identify and address security vulnerabilities within data pipelines
• Provide guidance and mentorship to junior data engineers as the team grows
• Foster a collaborative and knowledge-sharing environment
• Proactively suggest improvements to existing data processes and infrastructure
• Implement data solutions in a cost-effective manner, optimizing for performance and resource utilization

Preferred Qualifications

• Experience with PySpark
• Experience with EHR integrations using FHIR standards and APIs
• Experience with Snowflake experience
• Experience with Metabase
• Located in NYC, NY/Madison, WI/Los Angeles, CA/Nashville, TN/San Francisco, CA