Data Platform Architect

Summary

Join GetInData | Part of Xebia, a leading data company, as a Solution Architect and contribute to innovative projects related to Data, AI, Cloud, Analytics, ML/LLM, and GenAI. You will build a Data Platform in Azure, mentor engineers, optimize Databricks costs, and integrate Databricks into the Azure network. The role involves automating deployments, using Terraform, implementing secure data-sharing, and working with clients to solve real-world challenges. You'll leverage your extensive experience with Azure, DevOps, and Databricks. This position offers a competitive salary, 100% remote work, flexible hours, and professional development opportunities.

Requirements

• Extensive experience working with Azure cloud provider
• Great knowledge of DevOps practices and tools, including Docker, Terraform, CI/CD
• Experience working with Databricks platform
• Strong engineering background, preferred in fields such as Computer Science, Mathematics, Software Engineering, Physics, and Data Science
• Great fundamental knowledge of Software Engineering, Data Engineering, building whole data platforms and solutions
• Understanding complexity and relationships between businesses, suppliers, partners, competitors, and clients
• Experience or interest in working with and using large-scale data to solve valuable business problems
• Experience in preparing presentations, design documents, and architecture diagrams

Responsibilities

• Building a Data Platform in the Azure cloud providing multiple Data teams with the ability to start and maintain projects in an automated fashion
• Mentoring and delegating tasks to 2-3 engineers who will help in building the Data Platform
• Evaluating and optimizing costs for Databricks workloads
• Selecting and configuring clusters tailored to specific workload requirements
• Integrating Databricks into the existing Azure network setup
• Automating the deployment and management of Databricks environments using Azure DevOps Pipelines
• Using Terraform as the primary Infrastructure as Code (IaC) tool for managing resources
• Implementing secure data-sharing solutions within Databricks

Benefits

• Salary: 200 - 240 PLN net + VAT/h B2B (depending on knowledge and experience)
• 100% remote work
• Flexible working hours
• Possibility to work from the office located in the heart of Warsaw
• Opportunity to learn and develop with the best Big Data experts
• International projects
• Possibility of conducting workshops and training
• Co-financing sport card
• Co-financing health care
• All equipment needed for work