Senior Software Engineer

ShopBack
Summary
Join ShopBack's Data Platform team as a Senior Software Engineer and contribute to the scalability, reliability, and efficiency of our data ecosystem. You will collaborate with stakeholders, design and implement robust data pipelines, and enhance existing infrastructure using technologies like Kafka, Flink, Spark, and Airflow. This role requires proficiency in Java, Scala, or Python, experience with distributed data processing, and expertise in ETL/ELT frameworks. ShopBack offers competitive compensation, a work-from-anywhere benefit, and opportunities for career progression in a collaborative and inclusive environment. We are committed to building a world-class product and impacting the eCommerce landscape. We are looking for team members who strive to solve hard problems, take pride in delivering world-class products, and are strong team players.
Requirements
- Proficient in Java, Scala, or Python programming languages
- Experience working in building and optimizing JVM applications written in Java or Scala
- Experience with distributed data processing using Apache Flink and Apache Spark
- Expertise in ETL/ELT frameworks (Airflow, DBT, Spark, etc.)
- Proficiency in working with Amazon S3 as object storage, and Parquet file format
- Strong ability to reason about data structures, complexity, and possible engineering approaches to a problem
Responsibilities
- Collaborate with various stakeholders to translate business requirements into data solutions
- Design, implement, and manage robust data pipelines to support batch and streaming workloads
- Contribute to the ideation, technical design, implementation, and testing of scalable data pipeline solutions
- Enhance and optimize existing data pipelines & infrastructure
Preferred Qualifications
- Stream processing experience with Change Data Capture and the Kafka ecosystem
- Experience with modern DataLake table formats like HUDI, IceBerg, or DeltaLake
- Understanding of containerization technologies with Docker & Kubernetes
Benefits
- Career progression paths and opportunities to take on greater challenges that help you realise your ambitions
- Be part of a winning team on a journey to global scale
- Competitive compensation based on your performance
- Candid, open, and collaborative culture where feedback is valued, for everyone to grow and improve every day
- Work-From-Anywhere benefit to enable you to thrive personally and professionally