Pathway is hiring a
Data Engineer

Logo of Pathway

Pathway

πŸ’΅ $64k-$107k
πŸ“Remote - Poland

Summary

The job is a Data Processing or Data Engineering role at Pathway, a deeptech start-up. The candidate will work with live client datasets, implement data flows, set up CDC interfaces, design ETL pipelines, and contribute to benchmark framework design. The team consists of overachievers who have worked in top AI labs and companies.

Requirements

  • Inside-out understanding of at least one major distributed data processing framework (Spark, Dask, Ray,...)
  • 6 months+ experience working with a streaming dataflow framework (e.g.: Flink, Kafka Streams or ksqldb, Spark in streaming mode, Beam/Dataflow)
  • Ability to set up distributed dataflows independently
  • Experience with data streams: message queues, message brokers (Kafka), CDC
  • Working familiarity with data schema and schema versioning concepts; Avro, Protobuf, or others
  • Familiarities with Kubernetes
  • Familiarity with deployments in both Azure and AWS clouds
  • Good working knowledge of Python
  • Good working knowledge of SQL
  • Experienced in working for an innovative tech company (SaaS, IT infrastructure or similar preferred), with a long-term vision
  • Warmly disposed towards open-source and open-core software, but pragmatic about licensing

Preferred Qualifications

  • Know the ways of developers in a corporate environment
  • Passionate about trends in data
  • Proficiency in Rust
  • Experience with Machine Learning pipelines or MLOps
  • Familiarity with any modern data transformation workflow tooling (dbt, Airflow, Dagster, Prefect,...)
  • Familiarity with Databricks Data Lakehouse architecture
  • Familiarity with Snowflake's data product vision (2022+)
  • Experience in a startup environment

Benefits

  • Intellectually stimulating work environment
  • Work in one of the hottest data startups in France, with exciting career prospects
  • Responsibilities and ability to make significant contribution to the company’ success
  • Compensation: annual salary of €60K-€100K + Employee stock option plan
  • Inclusive workplace culture

Share this job:

Disclaimer: Please check that the job is real before you apply. Applying might take you to another website that we don't own. Please be aware that any actions taken during the application process are solely your responsibility, and we bear no responsibility for any outcomes.

Similar Jobs

Please let Pathway know you found this job on JobsCollider. Thanks! πŸ™