Senior Data Engineer

Summary

Join Capco Poland, a global technology and management consultancy specializing in driving digital transformation across the financial services industry. We are passionate about helping our clients succeed in an ever-changing industry.

Requirements

• Extensive experience with Databricks, including ETL processes and data migration
• Experience with additional cloud platforms like AWS, Azure, or GCP
• Knowledge of big data technologies and frameworks
• Strong knowledge of data warehousing concepts, data modeling, and SQL
• Experience with RDBMS systems and transitioning data to modern cloud platforms
• Proficiency in programming languages such as Python, SQL, and scripting languages
• Knowledge of data governance frameworks, data quality management practices, and data security principles
• Proficiency in database technologies, including relational databases e.g., SQL Server. In-depth knowledge of data modeling, database design
• Familiarity with containerization technologies such as Docker and orchestration tools like Kubernetes
• Bachelor or Master Degree in Computer Science or related field

Responsibilities

• Design, develop, and implement robust data architecture solutions utilizing modern day data platforms like Databricks
• Ensure scalable, reliable, and secure data environments that meet business requirements and support advanced analytics
• Lead the migration of data from traditional RDBMS systems to Databricks environments
• Architect and design scalable data pipelines and infrastructure to support the organization's data needs
• Develop and manage ETL processes using Databricks to ensure efficient data extraction, transformation, and loading
• Optimize ETL workflows to enhance performance and maintain data integrity
• Ensure seamless data transition with minimal disruption to ongoing operations
• Monitor and optimize performance of data systems to ensure reliability, scalability, and cost-effectiveness within Databricks environments
• Collaborate with cross-functional teams, including data engineers, data scientists, analysts, and product managers, to understand data requirements and deliver solutions
• Define best practices and standards for data engineering/data warehouse processes and ensure adherence to them
• Evaluate and implement new technologies and tools to improve the efficiency and effectiveness of data pipelines
• Provide technical leadership and mentorship to junior members of the data engineering team
• Work closely with DevOps and infrastructure teams to deploy and manage data systems in production environments
• Ensure that all data solutions comply with organizational policies, industry standards, and regulatory requirements
• Collaborate with enterprise architects and IT leadership to ensure alignment of data architecture with overall IT architecture and strategies

Benefits

• Employment contract and/or Business to Business - whichever you prefer
• Possibility to work remotely
• Speaking English on daily basis, mainly in contact with foreign stakeholders and peers
• Multiple employee benefits packages (MyBenefit Cafeteria, private medical care, life-insurance)
• Access to 3.000+ Business Courses Platform (Udemy)
• Access to required IT equipment
• Paid Referral Program
• Participation in charity events e.g. Szlachetna Paczka
• Ongoing learning opportunities to help you acquire new skills or deepen existing expertise
• Being part of the core squad focused on the growth of the Polish business unit