Data Platform Engineer

Summary

Join Pepperstone's technology team as a Data Platform Engineer and empower data and analytics teams by providing robust tools and infrastructure for data acquisition, storage, and governance. You will design, implement, and maintain scalable data platform solutions, collaborating with various teams and stakeholders. This role requires a Bachelor's degree or equivalent experience, minimum 2 years of experience in a relevant field, and proficiency in various technologies. We offer a collaborative and friendly culture, flexible and hybrid working options, including remote work, and various benefits such as competitive salary, bonus scheme, parental leave, and professional development opportunities. Your ideas matter, your growth is nurtured, and your potential is limitless at Pepperstone.

Requirements

• Bachelor’s degree in computer science, other related certification, or equivalent on-the-job experience
• Minimum 2 years of experience in a data platform, cloud, or DevOps role
• Able to work independently, self-organise, scope work and adapt to changing requirements
• Excellent communication and interpersonal skills both written and verbal including the ability to present to both technical and non-technical stakeholders
• Proficiency in IAC and CI/CD tools like Terraform, Buildkite and Github Actions
• Experience in incident and issue management
• Committed to ongoing learning and development
• Ability to live the Pepperstone values

Responsibilities

• Work with the Data Platform team to design, implement, and maintain scalable, secure, and resilient data platform solutions
• Deliver solutions that meet requirements within agreed timeframes, ensuring quality and desired outcomes
• Develop and manage data platform infrastructure using CI/CD pipelines and automation tools
• Support and manage key data platform services, such as data lakes, data warehouses, stream processing, data transformation, data integration, data quality, and analytics tools. Enable consuming teams within Enterprise Data to effectively utilise these services
• Collaborate with the Cloud team to ensure alignment with best practices while managing AWS cloud services consumed by Enterprise Data, including AWS accounts, object storage, containerised applications, relational databases, and database migration services
• Collaborate with the data governance team to enhance data security, quality, and regulatory compliance practices
• Partner with vendors and the Cloud team to define operational resilience targets, manage risks, and develop controls, procedures, and playbooks for key data platform services, ensuring alignment with observability and alerting standards
• Adhere to established incident management and reporting procedures and escalate issues to senior managers as necessary
• Stay informed about industry trends, emerging technologies, and market changes in data platforms and cloud services
• Align work and decisions with Pepperstone's values and objectives

Preferred Qualifications

• At least 1-2 years’ experience in a programming language (Python, Golang or Scala are a plus)
• Strong understanding and/or experience in core AWS services as well as relational databases (RDS) and Kubernetes (EKS)
• Experience with at least one data lake or warehousing solution (e.g. Databricks, Snowflake, Redshift), or stream processing/analytics tools (e.g. Kafka, Flink)
• Experience with orchestration frameworks such as Airflow and/or DBT
• Experience integrating core data management services with BI tools (e.g., Tableau), data science frameworks (e.g., SageMaker, MLFlow, TensorFlow), and integration platforms (e.g., Segment, Salesforce Data Cloud)

Benefits

• Competitive salary structure including company bonus scheme
• Genuinely collaborative and friendly culture
• Flexible and hybrid working
• Remote working option - work from anywhere for up to 6 weeks per year, in addition to hybrid working as standard
• Ongoing personal development & learning opportunities
• 15 weeks paid primary carers parental leave & 4 weeks paid secondary carers leave
• 3 paid volunteering days per year & Workplace Giving Program