Remote Data Engineer

Summary

Join our team as a Data Engineer at GetInData | Part of Xebia, where you'll craft and uphold data structures, tools, and procedures. Develop ETL and data platforms, access applications, and automate processes. Work with us to deliver innovative projects in Data, AI, Cloud, Analytics, ML/LLM, and GenAI.

Requirements

• Proficiency in a programming language like Python and Scala
• Working with Spark messaging systems
• Experience with Hadoop
• Strong programming skills with a solid understanding of software engineering principles, best practices, and solutions
• Experience with Version Control System, preferably GIT
• Ability to actively participate/lead discussions with clients to identify and assess concrete and ambitious avenues for improvement

Responsibilities

• Development and maintenance of ETL and data platforms (Python, Scala, Spark, HDFS, Hive)
• Development and maintenance of access applications for business users and user support (Airflow, Jupyterhub, Trino, Superset, MLFlow) in the context of Kubernetes, Docker, ArgoCD
• Automation and CICD (Gitlab-CI)
• Monitoring (Prometheus)
• R&D, maintenance, and monitoring of the platform's components
• Implementing and executing policies aligned with the company's strategic plans concerning used technologies, work organization, etc

Benefits

• 100% remote work
• Flexible working hours
• Possibility to work from the office located in the heart of Warsaw
• Opportunity to learn and develop with the best Big Data experts
• International projects
• Possibility of conducting workshops and training
• Co-financing sport card
• Co-financing health care
• All equipment needed for work