Remote Data Engineer

Summary

Join the CDC Foundation as a Data Engineer to design, build, and maintain data infrastructure for a public health organization. This role involves collaborating with the Turtle Mountain Band of Chippewa Public Health Department team to create and manage systems and pipelines that enable efficient and reliable flow of data.

Requirements

• Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field
• Minimum 5 years of relevant professional experience in data engineering
• Proficiency in programming languages commonly used in data engineering, such as Python, Java, Scala, or SQL, with the ability to implement data automations within existing frameworks
• Strong understanding of relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra)
• Experience with establishing Secure File Transfer Protocols (SFTP) and/or Simple Storage Service (S3) connections
• Familiarity with engineering best practices, including source control, automated testing, continuous integration and deployment, and peer review
• Knowledge of data warehousing concepts and tools
• Experience with cloud computing platforms
• Expertise in data modeling, ETL (Extract, Transform, Load) processes, and data integration techniques
• Understanding of agile development methodologies and software design patterns
• Strong analytical thinking and problem-solving abilities
• Excellent verbal and written communication skills, with the ability to effectively convey technical concepts to non-technical stakeholders
• Ability to adapt to evolving project requirements and priorities
• Outstanding interpersonal skills and the ability to develop productive working relationships with colleagues and partners
• Demonstrated capability to work well independently and as part of a team
• Experience working in a remote environment with distributed teams
• Proficiency in Microsoft Office

Responsibilities

• Create and manage the systems and pipelines that enable efficient and reliable flow of data, including ingestion, processing, and storage
• Design, develop, and manage data systems and pipelines to ensure efficient data flow, including ingestion, processing, and storage
• Use Rhapsody to integrate data from diverse sources, transform and clean it to maintain accuracy, and load it into data storage systems or warehouses
• Work closely with data technicians to deploy a public health surveillance system
• Optimize data pipelines, infrastructure, and workflows to enhance performance and scalability
• Monitor and troubleshoot data pipelines and systems, addressing performance issues, errors, and anomalies
• Implement security measures to safeguard sensitive information
• Work closely with data scientists, analysts, and other stakeholders to understand their data requirements and ensure that the data infrastructure supports organizational goals
• Collaborate with cross-functional teams to design scalable data solutions that align with business needs
• Develop and maintain ETL (Extract, Transform, Load) processes to ensure data accuracy and consistency
• Manage data storage systems, including relational and NoSQL databases, and data warehouses
• Stay informed about industry trends, best practices, and emerging technologies in data engineering, applying this knowledge to the organization's data infrastructure
• Provide technical guidance to internal and external team members
• Communicate effectively with all organizational levels to gather requirements, provide updates, and present findings