Data Platform Engineer

Summary

Join ShipHero, a rapidly growing eCommerce platform, and become a key member of our fully remote team. You will play a crucial role in operating, improving, and extending our data infrastructure, supporting engineering teams in enhancing data services, and optimizing databases for performance and scalability. This position requires hands-on experience with data storage and processing systems, including relational and non-relational databases, data warehouses, and distributed processing systems. You will leverage your expertise in stream processing, AWS or GCP infrastructure, and infrastructure-as-code tools to automate infrastructure management. The ideal candidate is passionate about learning, collaboration, and improving data infrastructure using Python, Airflow, Redshift, and dbt. ShipHero offers a remote-first work environment with excellent benefits.

Requirements

• You have solid experience operating and improving the reliability of data storage and processing systems—including relational databases, data warehouses, data lakes, and distributed processing systems. This includes operational optimization such as indexing, query tuning, and monitoring
• You’re familiar with stream processing and have worked with tools like Kafka, Kinesis, or are excited to deepen your knowledge in this area
• You’ve had hands-on experience setting up and managing data processing infrastructure in AWS or GCP, and you’re comfortable using infrastructure-as-code tools such as Terraform or Ansible
• You’re excited to improve data infrastructure and pipelines using Python, Airflow (or similar), Redshift, and dbt to support scalable data initiatives

Responsibilities

• Operate, improve, and extend ShipHero’s data infrastructure
• Support engineering teams in enhancing the performance of reports, searches, and other data services
• Be part of the Platform Team to address performance and reliability challenges in our data systems
• Optimize both relational and non-relational databases for performance and scalability
• Automate infrastructure management using infrastructure-as-code for consistency, scalability, and repeatability
• Operate, improve, and extend ShipHero’s data infrastructure
• Rotative On-call rotation 24x7

Preferred Qualifications

Experience with the AWS data ecosystem is highly appreciated, including services like Amazon Aurora MySQL, DocumentDB/MongoDB, OpenSearch/ElasticSearch, Redshift, Glue/Spark, MSK/Kafka, Kinesis, Debezium, S3/Apache Hudi, and MWAA/Airflow

Benefits

• $2.500 so you can buy any equipment you need to be happy at your job
• 20 days paid vacation + new year & Christmas
• Conference days don't count against your vacation days, we want you to stay up-to-date
• We will pay for courses & conferences, if you learn we all learn