Remote Senior Or Staff Software Engineer, Data Platform

Summary

Join TRM's Data Platform team and contribute to building a safer financial system by developing and maintaining highly scalable data infrastructure. You will design and implement data services, ETL pipelines, and data models for processing petabytes of blockchain transaction data. This role requires strong programming skills in Python and experience with distributed systems. The ideal candidate will have a proven track record in data engineering, expertise in various data technologies, and experience with cloud platforms. TRM offers a remote-first work environment, opportunities for personal growth, and a chance to make a real-world impact. The team values async communication and collaboration, aiming for efficiency and speed in project execution.

Requirements

• Bachelor's degree (or equivalent) in Computer Science or a related field
• A proven track record, with 5+ years of hands-on experience in architecting distributed system architecture, guiding projects from initial ideation through to successful production deployment
• Exceptional programming skills in Python, as well as adeptness in SQL or SparkSQL
• Versatility that spans the entire spectrum of data engineering in one or more of the following areas: In-depth experience with data stores such as ClickHouse, ElasticSearch, Postgres, Redis, and Neo4j
• Proficiency in data pipeline and workflow orchestration tools like Airflow, DBT, Luigi, Azkaban, and Storm
• Expertise in data processing technologies and streaming workflows including Spark, Kafka, and Flink
• Competence in deploying and monitoring infrastructure within public cloud platforms, utilizing tools such as Docker, Terraform, Kubernetes, and Datadog
• Proven ability in loading, querying, and transforming extensive datasets

Responsibilities

• Build highly reliable data services to integrate with dozens of blockchains
• Develop complex ETL pipelines that transform and process petabytes of structured and unstructured data in real-time
• Design and architect intricate data models for optimal storage and retrieval to support sub-second latency for querying blockchain data
• Oversee the deployment and monitoring of large database clusters with an unwavering focus on performance and high availability
• Collaborate across departments, partnering with data scientists, backend engineers, and product managers to design and implement novel data models that enhance TRM’s products
• Build scalable engines to optimize routine scaling and maintenance tasks like create self-serve automation for creating new pgbouncer, scaling disks, scaling/updating of clusters, etc
• Enable tasks to be faster next time and reducing dependency on a single person
• Identify ways to compress timelines using 80/20 principle . For instance, what does it take to be operational in a new environment? Identify the must have and nice to haves that are need to deploy our stack to be fully operation. Focus on must haves first to get us operational and then use future milestones to harden for customer readiness. We think in terms of weeks and not months
• Identify first version, a.k.a., " skateboards " for projects. For instance, build an observability dashboard within a week. Gather feedback from stakeholders after to identify more needs or bells and whistles to add to the dashboard

Benefits

• Remote First: Our HQ is online. Tools like Zoom and Slack ensure seamless collaboration, but we also value in-person interactions, organizing regular meetups and offsites for team bonding
• Purpose and Mission: Have a real-world impact, from disrupting terrorist networks to returning stolen funds
• Inspiring Colleagues: Collaborate with industry leaders and learn something new daily
• Personal Growth: We're not just using technology; we're inventing it and taking category-defining products to market
• Annual Company Offsite : Once a year, TRMers come together from around the world to attend a 1-week mandatory company offsite. This is designed to foster in-person relationships, creativity, and strategic alignment. Employee attendance is required of all TRMers