Mid-Senior Data Engineer

Summary

Join GetInData | Part of Xebia, a leading data company, and become a Data Engineer. You will design, build, and maintain data infrastructure, tools, and processes for efficient data management. This role involves developing data platforms using technologies like Python, Scala, Spark, and Kubernetes. You will collaborate with clients and internal teams, ensuring data accessibility and quality. The position offers 100% remote work, flexible hours, and opportunities for professional development alongside experienced Big Data experts. Competitive salary and benefits are also included.

Requirements

• Proficiency in a programming language like Python and Scala
• Working with Spark messaging systems
• Experience with Hadoop
• Hands-on experience with Kubernetes
• Strong programming skills with a solid understanding of software engineering principles, best practices, and solutions
• Experience with Version Control System, preferably GIT
• Ability to actively participate/lead discussions with clients to identify and assess concrete and ambitious avenues for improvement

Responsibilities

• Development and maintenance of ETL and data platforms (Python, Scala, Spark, HDFS, Hive)
• Development and maintenance of access applications for business users and user support (Airflow, Jupyterhub, Trino, Superset, MLFlow) in the context of Kubernetes, Docker, ArgoCD
• Automation and CICD (Gitlab-CI)
• Monitoring (Prometheus)
• R&D, maintenance, and monitoring of the platform's components
• Implementing and executing policies aligned with the company's strategic plans concerning used technologies, work organization, etc

Benefits

• Salary: 140 - 185 PLN net + VAT/h B2B (depending on knowledge and experience)
• 100% remote work
• Flexible working hours
• Possibility to work from the office located in the heart of Warsaw
• Opportunity to learn and develop with the best Big Data experts
• International projects
• Possibility of conducting workshops and training
• Co-financing sport card
• Co-financing health care
• All equipment needed for work