Data Engineer

Summary

Join Sweed, a cannabis retail solution provider, as a Data Engineer! Work remotely as part of a data platform team using Dagster, Dbt, Airbyte, and ClickHouse. Maintain and improve data pipelines, ensuring data reliability and quality. Your responsibilities include adding data sources, improving data export, automating documentation, and enhancing platform observability. The role requires experience with data pipelines, dbt, SQL, and ClickHouse. A flexible work schedule and remote work are offered, along with benefits like medical insurance after probation and equipment reimbursement.

Requirements

• Experience in setting up ingestion pipelines and integrating various data sources (Airbyte, Fivetran)
• Creating and optimizing data transformation models using dbt, working with macros, writing tests for data quality
• Knowledge of one or more data pipeline orchestration frameworks, such as Dagster (preferred),Airflow, Kestra; managing pipelines, automating schedules, error handling
• Proficiency in SQL
• Hands-on experience with ClickHouse: Designing and optimizing queries, storage structures, working with large data sets
• Upper-Intermediate and higher English level

Responsibilities

• Be part of Data platform team, work on Data platform (Dagster+Dbt+Airbyte+Clickhouse) stability, functionality and perfomance
• Maintain and improve data pipelines to ensure that data is reliable, trustworthy, and not broken
• Troubleshoot and resolve issues related to system and application performance
• Add new sources to data lake, guarantee quality of data
• Improve export of raw data to client’s s3
• Implement fully-automated creation of documentation of exported data
• Improve observability of data platform

Preferred Qualifications

• Experience with Python
• Terraform
• Knowledge of DevOps practices: docker, k8s, helm charts

Benefits

• Flexible working hours
• Fully remote work
• Medical insurance (after probation period)
• Equipment reimbursement for essential items such as laptops and additional equipment like monitors
• 20 working days paid vacation per year
• 3 days paid sick leave