Remote Data Engineer

Hi there!

We are looking for a Data Engineer for the Sweed product startup remote. Further - more, in the Q&A.

What are we doing?

At Sweed, we offer a comprehensive cannabis retail solution with a wide range of features,  including powerful POS functionality, in-depth analytics, marketing and promotional tools,  efficient inventory management, and more. Our progressive web-app can be easily accessed  through the tablets already available in your store, without any additional hardware required.

Since our establishment, we have been committed to creating an all-in-one system tailored to  the specific needs of large cannabis retailers. Today, we are proud to be a market leader, owing  much of our success to our signature killer feature – providing a full spectrum of software in one  solution.

Why are we doing this?

At our company, we are driven by our passion for the medicinal potential of plants, particularly in  their ability to influence cancer treatment and overall well-being and quality of life. Although  there is a significant amount of stigma associated with this area, we strongly believe that these  plants possess unique properties and have helped countless people improve their quality of life.  This is a rapidly growing industry that presents immense potential for career advancement and  personal fulfillment, and we are excited to explore how we can contribute to this dynamic field.

How are we as a company / project different from others? Why is it worth working with  us?

We offer great chances for career growth in a fast-growing field. Our team is full of passionate experts who help you learn and grow. You’ll gain new experiences and have freedom to pursue your goals your way. Plus, our flat structure means less red tape and more opportunity to make an impact.

How old is the project? What stage is it at?

The project is already 4 years on the market, at the stage of active development.

Our current priority is to establish and maintain strong customer trust, which has driven the  development of our delivery processes that allow us to launch new features on a daily basis.  Given the highly specialized nature of the cannabis retail market, we are committed to rapidly  meeting the evolving needs of our customers. Furthermore, the market’s unique legal framework  presents challenges with significant variations in state-level taxes, delivery regulations, and  other factors.

What to do in the project?

• Migrating the current reporting infrastructure to a new data platform (using Airbyte, dbt, Dagster, ClickHouse, and Cube).

• Setting up a data export pipeline for clients.

• Implementing data streams for ML workflows.

• Establishing pipeline monitoring and alerting systems.

• Set up and manage ingestion pipelines and integrate various data sources using tools like Airbyte or Fivetran.

• Create and optimize data transformation models using dbt, work with macros, and write data quality tests.

What professional skills are important to us?

• Experience in Python for data processing tasks.

• Understanding of batch and real-time data processing.

• Proficiency with Git, CI/CD systems, and working with cloud platforms.

• Expertise in one or more pipeline orchestration frameworks (e.g., Airflow, Dagster, Kestra, mage.ai). Manage data pipelines, automate schedules, and handle error processing.

• Strong proficiency in SQL for complex queries and data manipulation.

• Experience in design and optimizing queries and data storage structures in ClickHouse, with experience handling large datasets.

• Understanding of C# is a plus.

• Experience with Docker, Kubernetes (k8s), and Helm charts is highly desirable.

Do you need English, and at what level?

Upper-Intermediate and higher. You will need to communicate with the English-speaking part of  the team and write and read the documentation in English.

What else is important to us?

We value proactive individuals who actively participate in feedback sessions. It’s important for us to exchange feedback to adapt quickly due to our complex product. Being involved in these sessions shows effective collaboration skills, crucial for our team’s success.

We look for people who can think critically and analyze complex issues well, given the sophisticated nature of our product. We need individuals who approach tasks strategically and thoughtfully.

In our fast-paced environment, feeling comfortable and thriving at high speeds is essential. We seek responsible individuals who take ownership of their work, persisting through challenges and learning from mistakes to grow continuously.

Why was the position opened?

We’re opening up this position because our business is getting bigger, and we need more people to help us grow.

Who will you report to and work with in this role?

You’ll report to the product owner and collaborate with cross-functional teams organized by product.Additionally, we have chapter leadswho takes on leadership responsibilities within a specific area or “chapter” of expertise, guiding and mentoring other team members in that domain.

Team size and structure?

We’ve organized our team into smaller groups, each focused on specific products. These teams typically include around 10-12 folks, covering various roles like front-end and back-end engineers, QA experts, and analysts. Each team has its own product owner to lead the way.

Right now, we’ve got about 140 team members in total. When it comes to making technical calls, folks like the CEO, account managers, and our customer success team over in the USA have a say. Our Head of Product, who’s mostly based in Spain, also plays a big part.

Our team is spread out from Europe all the way to Bali, and we’re even thinking about expanding into Latin America. We believe in involving everyone in our team when it comes to making important technical decisions.

The conditions:

Is there a trial period and how long does it last? - The trial period lasts for 3 months.

What is the work schedule? - We offer flexible working hours. Our core working hours are from 09:00 to 15:00 (GMT), but flexibility is encouraged depending on the team’s needs.

Is it possible to work remotely? - Yes, we are a remote-first company with no physical offices, providing the opportunity for full remote work.

What currency is the salary paid in and what is the form of employment? - Salary is paid in dollars under a B2B contract with the USA.

Number of vacation days? - Employees receive 20 days of vacation leave annually.

Number of sick leave days? - Employees have 3 days of sick leave per year.

Social package (medical insurance, other) - Medical insurance is available after the trial period. We also offer equipment reimbursement for essential items such as laptops and additional equipment like monitors.

The process:

45-minutes - Initial call with a recruiter

1.5-hour - Technical interview

1-hour - Final interview with Head of Backend

Some interview’s stages might be conducted in English.