Data Streaming Engineer

Xebia Poland Logo

Xebia Poland

📍Remote - Worldwide

Summary

Join Xebia as a Data Engineer to develop and deliver high-quality features for a new Data Platform. You will independently create and maintain Flink jobs, build pipelines that consume events from Kafka into S3, and make data accessible on the Databricks platform. Collaborate with the Data Foundation Team to build and maintain the Data Platform. This role requires high autonomy and minimal guidance. The ideal candidate will have 6+ years of experience in Software Development/Data Engineering, advanced knowledge of Python or Scala, and experience with AWS, Flink, Kafka Connect, and CI/CD. Work from the European Union region is required.

Requirements

  • Be ready to start within 4 weeks
  • Have 6+ years of hands-on experience in Software Development/Data Engineering
  • Have advanced knowledge of Python and/or Scala
  • Have experience in AWS Cloud usage and management
  • Have experience with Flink and Kafka Connect
  • Have experience with CI/CD
  • Have a fundamental understanding of Parquet, Delta Lake and other data file formats
  • Have experience with orchestrators such as Airflow or Kubeflow
  • Be familiar with containerization and orchestration technologies (e.g., Docker, Kubernetes)
  • Have strong written and verbal English communication skills and be proficient in communication with non-technical stakeholders
  • Work from the European Union region and have a work permit

Responsibilities

  • Develop and deliver high-quality features of a new data platform
  • Create and maintain Flink jobs that send data to the event collector and set up dual writes with the current and target platforms
  • Write and manage pipelines that consume events from Kafka into S3 and make the data available in the Databricks platform
  • Work closely with the Data Foundation Team to create and maintain the Data Platform
  • Deliver with high autonomy and minimal guidance

Preferred Qualifications

  • Have experience with Databricks
  • Have experience with Strimzi
  • Be proficient on an IaC tool such as Terraform, CDK or CloudFormation

Remote

Data

Mid-level

Share this job:

Disclaimer: Please check that the job is real before you apply. Applying might take you to another website that we don't own. Please be aware that any actions taken during the application process are solely your responsibility, and we bear no responsibility for any outcomes.

Similar Remote Jobs