Senior Data Engineer

Summary

Join ShiftKey as a Senior Data Engineer and play a key role in enhancing our data infrastructure and creating self-service data products. You will design, build, and maintain scalable data pipelines, collaborating with various teams to ensure data accessibility and reliability. This position offers the opportunity to significantly impact data usage across the company. The role can be performed remotely or from our offices in Austin or Dallas. You must be located in the US to be considered. This is a great opportunity to make a big impact on how data is used across the company!

Requirements

• 6+ years of experience in a Data Engineer or similar Data Engineering role
• Advanced ability to design and implement data pipelines and ELT/ETL processes using Fivetran or Airflow
• Hands-on experience with programming languages such as Python, JavaScript, or other similar languages
• Hands-on experience with cloud platforms (AWS, GCP, or Azure) and related services (e.g., S3, Snowflake, or BigQuery)
• In-depth knowledge of database technologies (SQL) and data warehousing concepts
• Hands-on experience with data orchestration tools (e.g., Apache Airflow) and workflow automation
• Strong understanding of data modeling, integration, and governance principles (e.g., dbt)
• Excellent problem-solving skills and the ability to troubleshoot complex data-related issues
• Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment

Responsibilities

• Design, develop, and optimize robust, scalable, and high-performance data pipelines to ingest, process, and transform structured and unstructured data from various sources
• Collaborate with data architects and analysts to design and implement data models that support efficient data storage, retrieval, and analytics
• Manage and optimize cloud-based or on-premises data storage and processing platforms (e.g., dbt, AWS, Snowflake, Fivetran), ensuring security, scalability, and reliability
• Monitor and troubleshoot data pipelines, addressing performance bottlenecks and system failures
• Collaborate with data governance teams to enforce data security, privacy, and compliance policies
• Stay current with emerging data engineering technologies, tools, and best practices, and recommend relevant enhancements to existing processes and systems
• Proactively identify opportunities to enhance data processing efficiency and reduce latency

Benefits

• Inclusive and collaborative work environment
• Comprehensive health, vision, and dental coverage
• Benefits effective as of the first day
• Progressive PTO & Company-paid holidays with a broad selection of floating holidays to honor employees’ diverse needs
• 100% 401(k) employer match up to 6%
• Paid parental leave
• Investment in your wellness: access to mental health support