Remote Data Engineer

Summary

Join our team as a Data Engineer and contribute to the growth and success of our data-driven initiatives by designing, developing, and maintaining data pipelines and infrastructure.

Requirements

• Bachelor's degree or equivalent in computer science, systems engineering, or related fields
• Experience in data management involving the design, construction, and maintenance of operational and analytical data models
• Experience with programming languages and environments for data analysis
• Proactive problem detection and resolution

Responsibilities

• Design, develop, and maintain scalable and efficient data pipelines
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into robust data solutions
• Implement data integration processes to ingest, transform, and load data from various sources into data warehouses or data lakes
• Optimize data pipelines for performance, reliability, and scalability
• Monitor and troubleshoot data pipelines to ensure data quality and reliability
• Work with cloud-based data platforms and technologies to support data engineering operation
• Acquire data from primary and secondary sources and maintain databases/systems
• Interpret data, analyze results using statistical techniques, and provide ongoing reports
• Develop and implement databases, data collection systems, data analysis, and other strategies that optimize data quality and statistical efficiency
• Utilize data to answer key business questions promptly and effectively
• Own and maintain dashboards, reports, and ad-hoc requests for the organization
• Collaborate with management to prioritize business needs and insights
• Serve as the go-to person for any ad-hoc data-related inquiries

Preferred Qualifications

• 7-10 years of strong development experience performing ETL and/or data pipeline implementations
• Expert in programming languages, preferably Python
• Expert in delivering end-to-end analytic solutions using AWS services (EMR, Airflow, S3, Athena, Kinesis, Redshift)
• Experience in batch technologies like Hadoop, Hive, Athena, Presto
• Strong SQL skills, including query optimization, schema design, complex analytics
• Expert in data modeling and metadata management like Glue Catalog etc
• Experience in deployment tools like GitHub actions, Jenkins, AWS Code Pipeline etc
• Experience in data quality tools like Deque or Great Expectations is Nice To Have