Remote Data Engineer

Summary

Join the CDC Foundation as a Data Engineer to design, build, and maintain data infrastructure for a public health organization. This role will play a crucial part in advancing the CDC Foundation's mission by providing technical solutions that enhance the use of public health data to inform decision-making.

Requirements

• Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field
• Minimum 5 years of relevant professional experience
• Proficiency in programming languages commonly used in data engineering, such as Python, Java, Scala, or SQL
• Candidate should be able to implement data automations within existing frameworks as opposed to writing one off scripts
• Strong understanding of database systems, including relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra)
• Experience regarding engineering best practices such as source control, automated testing, continuous integration and deployment, and peer review
• Knowledge of data warehousing concepts and tools
• Experience with cloud computing platforms
• Expertise in data modeling, ETL (Extract, Transform, Load) processes, and data integration techniques
• Experience with CRM tools like QuickBase and SQL to support data architecture and integration
• Familiarity with agile development methodologies, software design patterns, and best practices
• Strong analytical thinking and problem-solving abilities
• Excellent verbal and written communication skills, including the ability to convey technical concepts to non-technical partners effectively
• Flexibility to adapt to evolving project requirements and priorities
• Outstanding interpersonal and teamwork skills; and the ability to develop productive working relationships with colleagues and partners
• Experience working in a virtual environment with remote partners and teams

Responsibilities

• Create and manage the systems and pipelines that enable efficient and reliable flow of data, including ingestion, processing, and storage
• Collect data from various sources, transforming and cleaning it to ensure accuracy and consistency. Load data into storage systems or data warehouses
• Optimize data pipelines, infrastructure, and workflows for performance and scalability
• Monitor data pipelines and systems for performance issues, errors, and anomalies, and implement solutions to address them
• Implement security measures to protect sensitive information in compliance with HIPAA
• Collaborate with Informaticist, analysts, and other partners to understand their data needs and requirements, to ensure that the data infrastructure supports the organization's goals and objectives
• Collaborate with cross-functional teams to understand data requirements and design scalable solutions that meet business needs
• Implement and maintain ETL processes to ensure the accuracy, completeness, and consistency of data
• Design and manage data storage systems, including relational databases, NoSQL databases, and data warehouses
• Apply industry knowledge of best practices and emerging technologies in data engineering to the IT roadmap and organization’s data infrastructure to optimize interoperability
• Provide technical guidance to other staff
• Communicate effectively with partners at all levels of the organization to gather requirements, provide updates, and present findings
• Document all automated standards, practices, and processes
• Review recommendations and IT plans and provide recommendation for best tools and solutions
• Analyze existing IT roadmap plans and provide recommendations for technology solutions and tools to achieve project goals
• Design and implement efficient workflows and automation to streamline operations and improve system performance
• Establish effective data governance practices to improve data quality, stewardship, protection, and compliance
• Lead database migration efforts and optimize existing databases for enhanced functionality
• Drive roadmap planning with a clear vision, ensuring robust and scalable solutions

Preferred Qualifications

• 6 years of relevant experience
• Public Health or Health Care experience
• Experience with cloud-based platforms such as Snowflake
• Knowledge of Electronic Health Records (HER)/Electronic Medical Records (EMR) and FHIR standards
• Familiarity with data tools (e.g., Power Bi, Qualtrics, & Talend, SSIS (SQL Server Integration Services)