Senior Data Engineer

Summary

Join SONAR, a top startup, as a Senior Data Engineer and contribute to our innovative team delivering news, commentary, data, and analytics for the logistics and supply chain industry. This hybrid/remote-eligible position requires expertise in data engineering, cloud technologies, and SQL. You will implement and maintain data pipelines, collaborate with other engineers, and mentor junior team members. The ideal candidate possesses strong communication skills and a positive attitude. SONAR offers a generous benefits package including comprehensive health insurance, stock options, 401k matching, and unique perks.

Requirements

• Background in SaaS/DaaS product development
• Python expertise with strong SQL proficiency (T-SQL & Standard SQL)
• Apache Airflow proficiency and Linux environment experience
• Experience with RDBMS (Postgres, MySQL) and familiarity with NoSQL databases (Elasticsearch, MongoDB)
• Experience with Google cloud services (GCS, Pub/Sub, BigQuery, etc.) or their analogues on any other cloud platform
• Expertise in dbt (or extensive experience with complex SQL transformations and experience with a templating tool like Jinja)
• Strong communication skills, able to work with technical and non-technical stakeholders
• Willingness to mentor more junior engineers, both finding solutions to problems and also understanding the benefits of that solution
• Must reside in the United States and be eligible to work

Responsibilities

• Implement ingestion pipelines using Airflow for consuming data from various sources (API, SFTP, Cloud Storage Bucket, etc.)
• Implement transformation pipelines using software engineering best practices and tools (dbt)
• Work closely with Software Engineering and DevOps to maintain reproducible infrastructure and data serving API-only customers and in-house SaaS products
• Define and implement data ingestion/transformation quality control processes using established frameworks (Pytest, dbt)
• Build pipelines using multiple technologies and cloud environments (e.g., an Airflow pipeline pulling a file from an S3 bucket and loading the data into BigQuery)
• Ensure data automation stability through monitoring and improvement
• Review existing and proposed infrastructure for architectural enhancements following software engineering and data analytics best practices
• Work closely with Data Science and facilitate advanced data analysis (like Machine Learning)

Preferred Qualifications

• Experience implementing cloud architecture changes
• Working knowledge of how to build and maintain APIs using Python/FastAPI
• Transforming similar data from disparate sources to create canonical data structures
• Surfacing data to BI platforms such as Looker Studio
• Experience with complex Data Migration, especially moving data between meaningfully different databases (e.g., BQ to Elastic Search using DataFlow)
• Certification: Professional Google Cloud Certified Data Engineer

Benefits

• An excellent work environment with shallow hierarchies and team support
• A generous benefits package including 100% employer-paid health, dental, vision and Life insurance, STD, LTD
• Stock options
• Appealing 401k matching plan
• Career Mentorship Opportunities
• Personal Development Credit (Can be used toward Student loans or relevant PD Courses)
• Annual life achievement bonus for having a baby, buying a house, or getting married (max one per year)
• No set days off Vacation policy (our team takes time off as needed with supervisor approval)
• Up to $50 for Gym membership
• Audible or Kindle Unlimited subscription