Senior Data Engineer

Summary

Join Murmuration, a non-profit organization, as a Senior Data Engineer. You will design, develop, and maintain the core data platform and ETL pipelines for our application, ensuring alignment with technical standards and project timelines. As a key individual contributor, you will lead complex projects, contribute to architectural design, and mentor peers. Your work will directly impact our users' ability to make a difference in their communities. This is a full-time, salaried position with a comprehensive benefits package, based anywhere in the U.S., offering a competitive salary range.

Requirements

• Bachelor's degree or higher in Computer Science, Computer Engineering, or relevant field (Note: Work experience can be substituted for degree requirements)
• 5+ years of experience as a Data/Backend/Software Engineer
• Strong experience in both functional and object-oriented programing (e.g., Python, Scala, Java)
• Good experience with the AWS data stack (e.g., Lambda, ECS, Glue, Athena, EventBridge etc.)
• Experience with NoSQL databases (e.g., MongoDB, DynamoDB, Redis, Cassandra)
• Strong SQL experience/knowledge
• Experience building large-scale streaming and batch data pipelines (e.g., Kafka Streams, Apache Flink, Spark Streaming, Spark SQL) with a focus on scalability, performance, accuracy, reliability, and traceability
• Strong experience with a standard code repository (e.g., Git)
• Experience with DevOps, developing CI/CD pipelines, and automated testing
• Good experience with data modeling and physical database design
• Demonstrable design and development skills on large-scale data platform implementations
• Experience supporting a production environment
• Strong communication skills, including the ability to clearly and adequately define a position and defend it (in writing or verbally)
• Ability to clearly document a design, component, or workflow they have working knowledge of
• Ability to take a complex implementation proposal and break it into smaller workable implementation components
• Demonstrable skills both in working independently and in leading projects within a team environment
• Practical knowledge of software development lifecycle (SDLC) and agile methodologies

Responsibilities

• Develop software aligned with specifications & designs, ensuring code is well-tested, maintainable, and documented
• Work autonomously with minimal oversight, delivering production-ready solutions that prioritize long-term maintainability and supportability
• Take ownership over the delivery of select features, driving them to completion by breaking the implementation into smaller units, maintaining the team’s standard of excellence in delivery and ensuring all requirements are met
• Have a strong understanding of the various key elements of the data platform and use this knowledge to act as a representative for the Data Platform Team when working with other engineering teams
• Create, communicate, and defend design proposals to your team through engineering proposals, demo sessions, chapter meetings, and architecture reviews
• Identify areas of improvement from a performance and/or a technical debt perspective within your team, and advocate for prioritization of this work
• Take an active role in contributing to your team’s Agile processes, including contributing to the writing and refining of tickets, participating in regular retrospectives on the team’s work, and demoing your work to the broader engineering org
• Support junior engineers through facilitating pull-request reviews for your team, paired programming sessions, and technical guidance on design & best practices

Preferred Qualifications

• Experience with Entity Resolution
• Experience with JavaScript
• Demonstrable knowledge in the creation, use, and support of a document database like MongoDB
• Demonstrable knowledge in the creation, use, and support of an OLAP database like Pinot and/or Snowflake
• Advanced experience with CI/CD platforms and Infrastructure as Code technologies, such as AWS CDK or Terraform
• Experience with container technologies, such as Docker or Kubernetes
• Experience using Big Data technologies (e.g., Spark, Presto, Kafka)
• Experience with orchestration tools such as Airflow or Dagster
• Experience with graph databases (e.g., Neo4j, Neptune)
• Experience designing and building microservices (e.g., REST, GraphQL)

Benefits

• Health, vision, and dental insurance with 100% of premiums covered for you and qualifying family members
• Retirement benefits with a 5% employer match
• A flexible unlimited PTO plan
• Generous paid parental leave
• Pre-tax commuter benefits
• A company laptop
• A flexible remote work environment
• A home office setup stipend for all new employees
• Monthly reimbursement for remote work expenses
• A yearly professional development fund
• Mental health and wellness benefits through Calm and Better Help
• Yearly in-person staff retreats
• A welcoming culture that celebrates diversity, equity, inclusion, and belonging