Remote Senior Crypto Data Engineer

Summary

Join Astra DAO as a Senior Big Data Engineer to facilitate the operations of our Data Scientists and Engineering team, utilizing various tools and techniques to construct frameworks for big data analysis.

Requirements

• Bachelor's degree in Data Engineering, Big Data Analytics, Computer Engineering, or related field
• A Master's degree in a relevant field is an added advantage
• 3+ years of Python, Java or any programming language development experience
• 3+ years of SQL & No-SQL experience (Snowflake Cloud DW & MongoDB experience is a plus)
• 3+ years of experience with schema design and dimensional data modeling
• Expert proficiency in SQL, NoSQL, Python, C++, Java, R
• Expert with building Data Lake, Data Warehouse or suitable equivalent
• Expert in AWS Cloud
• Excellent analytical and problem-solving skills
• A knack for independence and group work
• Capacity to successfully manage a pipeline of duties with minimal supervision

Responsibilities

• Liaising with coworkers and clients to elucidate the requirements for each task
• Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed
• Reformulating existing frameworks to optimize their functioning
• Testing such structures to ensure that they are fit for use
• Building a data pipeline from different data sources using different data types like API, CSV, JSON, etc
• Preparing raw data for manipulation by Data Scientists
• Implementing proper data validation and data reconciliation methodologies
• Ensuring that your work remains backed up and readily accessible to relevant coworkers
• Remaining up-to-date with industry standards and technological advancements that will improve the quality of your outputs