Data Engineer

Summary

Join IOHK's Technical Intelligence team as a Data Engineer to maintain and develop data solutions and services within the blockchain industry. You will be responsible for building and improving data ingestion pipelines, designing a cloud-native data warehouse, and collaborating with data scientists. This role requires expertise in data engineering, cloud infrastructure management, and various data technologies. The ideal candidate possesses strong communication skills and a passion for blockchain technology. IOHK offers remote work, laptop reimbursement, a new starter package, learning and development opportunities, and competitive PTO.

Requirements

• BSc/MSc in a Computer Science field, or equivalent practical experience
• 4+ years of work experience in data and software engineering: data storage, data manipulation, front-end and back-end development for software applications and data systems
• Professional English
• Knowledge of big data processing platforms (such as Spark, Databricks, Google BigQuery), data orchestration (such as Airflow), and data manipulation libraries (such as Pandas, Polars)
• Knowledge of cloud services management: AWS services (such as Amazon S3, RDS, Redshift, Lambda, Glue, Athena, DynamoDB) or GCP
• Knowledge of relational databases (such as PostgreSQL, Oracle, Mssql) and writing highly optimized SQL
• Knowledge of docker container orchestration (such as Kubernetes, ECS)
• Knowledge of Continuous Integration and Continuous Delivery (CI/CD) pipelines (such as GitHub Actions, Travis, Jenkins)
• Knowledge of Infrastructure as code (such as Terraform, AWS CloudFormation, AWS CDK)
• Knowledge of blockchain on-chain data representation
• Ability to communicate well both verbally and in writing, with both technical and non-technical partners

Responsibilities

• Develop and maintain automated data ingestion (API or crawling) pipelines from source code repositories, social media, and on-chain analytics
• Simplify existing data pipelines - re-architecting where necessary
• Research existing datasets to figure out their relevance - and remove irrelevant data pipelines and sources
• Design a data warehouse that can be queried by analysts and APIs, and that will serve as a data backend for a reporting web application
• Collaborate with data scientists to operationalize ML models and deploy them into production environments
• Work closely with leadership to understand and define requirements, ensuring alignment with the department’s strategy and roadmap
• Collaborate with a Data Scientist and an Intelligence Engineer to implement technical solutions that meet project goals
• Ensure systems are functional, available, and carefully monitored for continuous performance and reliability

Preferred Qualifications

Preferable work experience with blockchain

Benefits

• Remote work
• Laptop reimbursement
• New starter package to buy hardware essentials (headphones, monitor, etc)
• Learning & Development opportunities
• Competitive PTO