Senior Crypto Data Engineer

Summary

Join Token Metrics as a Senior Big Data Engineer to build and maintain big data frameworks using various tools and techniques. You will collaborate with data scientists and engineers, employing machine learning to analyze data and optimize existing structures. Responsibilities include liaising with colleagues and clients, conceptualizing data infrastructure, and ensuring data accessibility. You will also build data pipelines, prepare raw data for analysis, and implement data validation methodologies. Staying current with industry standards is crucial. This role requires a bachelor's degree in a relevant field and significant experience in programming languages like Python, Java, SQL, and NoSQL databases.

Requirements

• Bachelor's degree in Data Engineering, Big Data Analytics, Computer Engineering, or related field
• 3+ years of Python, Java or any programming language development experience
• 3+ years of SQL & NoSQL experience (Snowflake Cloud DW & MongoDB experience is a plus)
• 3+ years of experience with schema design and dimensional data modeling
• Expert proficiency in SQL, NoSQL, Python, C++, Java, R
• Expert with building Data Lake, Data Warehouse or suitable equivalent
• Expert in AWS Cloud
• Excellent analytical and problem-solving skills
• A knack for independence and group work
• Capacity to successfully manage a pipeline of duties with minimal supervision

Responsibilities

• Liaise with coworkers and clients to elucidate the requirements for each task
• Conceptualize and generate infrastructure that allows big data to be accessed and analyzed
• Reformulate existing frameworks to optimize their functioning
• Test such structures to ensure that they are fit for use
• Build a data pipeline from different data sources using different data types like API, CSV, JSON, etc
• Prepare raw data for manipulation by Data Scientists
• Implement proper data validation and data reconciliation methodologies
• Ensure that your work remains backed up and readily accessible to relevant coworkers
• Remain up-to-date with industry standards and technological advancements that will improve the quality of your outputs

Preferred Qualifications

A Master's degree in a relevant field is an added advantage