Senior Software Engineer

Summary

Join People Data Labs as a Software Engineer and play a crucial role in building standalone data products for data teams and developers. You will manage and improve AWS and data center infrastructures, design and maintain CI/CD pipelines, and utilize centralized monitoring and logging. This role requires extensive experience in software development, AWS services, and data processing technologies. You will work collaboratively with a team to develop high-quality software while ensuring security, reliability, and operational efficiency. The position offers competitive salary, unlimited paid time off, comprehensive health benefits, and the flexibility to work remotely.

Requirements

• 5-7+ years software development experience with a background in platform or cloud infrastructure engineering and clear examples of strategic technical problem-solving and implementation
• 3+ years of experience with Python in a production environment
• Strong software development fundamentals and system design experience
• Strong experience with our core technologies (AWS, ElasticSearch / OpenSearch, Python, Docker, scaled data processing technologies)
• AWS, including EC2, Lambda, OpenSearch, API Gateway, ALB, others
• Data stores, including Postgres/MySQL, Dynamo, Redis, S3
• Experience with Infrastructure-as-code (IaC) frameworks (e.g. Pulumi, terraform, cloud formation or similar)
• Experience with network design, including public/private availability, routing, firewalls / security groups and VPN
• Experience with Identity and Access Management
• Experience with configuration management tools (e.g. Chef, Puppet, Ansible, etc)
• Experience with observability tools such as Datadog for metrics, logging, etc
• Experience with build and deploy systems, architecting and developing CI/CD infrastructure, repo management, and integrating with tools like Github Actions (or similar)
• Experience managing hybrid environments split between local datacenters and AWS; experience managing bare metal / co-location infrastructure
• Can thrive in a fast-paced environment and be able to work independently
• Can work effectively remotely (able to be proactive about managing blockers, proactive on reaching out and asking questions, and participating in team activities)
• Strong written communication skills on Slack and in documentation
• You are experienced in writing design docs (pipeline design, dataflow, schema design, engineering requirements)
• You are experienced in translating technical design documents into projects, milestones, and backlogs
• You can scope and break down projects, communicate and collaborate progress and blockers effectively with your manager, team, and stakeholders
• Strong understanding of agile engineering practices

Responsibilities

• Manage and improve our growing AWS and data center infrastructures
• Design, implement and maintain a CI/CD pipeline to improve developer workflows
• Utilize centralized monitoring and logging to improve visibility across the team
• Assist development teams in solving issues around scaling and bottlenecks
• Manage AWS services, costs, security and workflows
• Work with teammates to develop high-quality software, balancing security, reliability, and operational concerns

Preferred Qualifications

• Degree in a quantitative discipline such as computer science, mathematics, statistics, or engineering
• Expertise with Apache Spark (Java, Scala, and/or Python-based)
• Experience with SQL Data Pipeline Development
• Experience supporting developer-oriented data pipeline and workflow orchestration (e.g., Airflow (preferred), dbt, dagster or similar)
• Experience with managing, deploying, and ensuring the reliability of streaming platforms (e.g., Kafka)
• Experience evaluating data quality and maintaining consistently high standards across new feature releases (e.g., consistency, accuracy, validity, completeness)
• Experience using Databricks or similar data-development platforms

Benefits

• Stock
• Competitive Salaries
• Unlimited paid time off
• Medical, dental, & vision insurance
• Health, fitness, and office stipends
• The permanent ability to work wherever and however you want