Mid/Senior Big Data Engineer

Summary

Join Capco Poland, a global technology and management consultancy, as a Senior Big Data Engineer. You will design, implement, and maintain scalable data pipelines and solutions for large-scale data processing and analytics. Work on engaging projects with major banks, contributing to digital transformation through a continuous delivery model. Develop end-to-end ETL processes using Spark/Scala, collaborate within a Scrum team, and document solutions using JIRA, Confluence, and ALM. This role requires extensive experience in programming and Big Data technologies, specifically Spark with Scala. Capco offers various benefits, including remote work options, multiple employee benefit packages, access to online courses, and a supportive work culture.

Requirements

• At least 7 years of experience in programming
• At least 3 years of experience as a programming backend applications with Big Data technologies, preferably in Spark with Scala
• Agile approach for software development
• Continuous Integration (Git, GitHub, Jenkins)
• Experience in SQL
• English (at least B2+)

Responsibilities

• Develop, test, and deploy technical and functional specifications from Solution Designers/Business Architects/Business Analysts, guaranteeing correct operability and compliance with internal quality levels
• Develop end-to-end ETL processes with Spark/Scala, including data transfer to/from the data lake, technical validations, and business logic
• Use Scrum methodology and be part of a high-performance team
• Document solutions in JIRA, Confluence, and ALM
• Certify delivery and its integration with other components, designing and performing relevant tests to ensure quality

Preferred Qualifications

• Frontend development (React.js, Typescript, Next.js, Qlik)
• Jenkins orchestration
• Bash script
• ControlM
• Software development life cycle (HP ALM, ...)
• Basics of cybersecurity & Quality (Sonar)
• Basics of Cloud computing (Docker, Kubernetes, OS3, Azure, AWS)

Benefits

• Employment contract and/or Business to Business - whichever you prefer
• Possibility to work remotely
• Multiple employee benefits packages (MyBenefit Cafeteria, private medical care, life-insurance)
• Access to 3.000+ Business Courses Platform (Udemy)
• Access to required IT equipment
• Paid Referral Program
• Participation in charity events e.g. Szlachetna Paczka
• Ongoing learning opportunities to help you acquire new skills or deepen existing expertise