Data Engineer 4

Summary

Join TrueCar's Data Engineering team as a Data Engineer 4 and revolutionize the car-buying experience. You will design and implement scalable big data pipelines using Apache Airflow, develop high-quality product features using Java, Python, and other technologies, and develop data models and architecture solutions. Collaborate with product owners and analysts, participate in team planning, and identify process improvements. This role requires proven experience in Java and Python programming, strong algorithms and data structures knowledge, and expertise in Apache Spark and Airflow. TrueCar offers a remote work environment with benefits including 100% employer-paid health, vision, and dental premiums, a 401(k) plan, equity, and flexible PTO.

Requirements

• Proven experience programming in Java and Python
• Strong background in algorithms, data structures, and object-oriented programming
• Advanced SQL and data modeling experience
• Apache Spark development proficiency
• Expertise in orchestrating data pipelines with Apache Airflow
• Demonstrated experience improving pipeline reliability and performance
• Experience with data documentation and governance

Responsibilities

• Design and implement scalable big data pipelines using Apache Airflow with focus on reliability, monitoring and performance optimization
• Develop high-quality product features using skills in Java, Python, Spring Boot, GraphQL, Maven, and other open-source Java libraries spanning multiple product domains and integration with REST API's
• Develop and support solutions using DynamoDB for fast, scalable storage and Redis for real-time caching to improve application performance and reliability
• Develop data models and architecture solutions that align with business requirements
• Establish and maintain data quality frameworks and governance standards to ensure accuracy, consistency, and compliance across data assets
• Design, build, and maintain scalable APIs and services to enable reliable data access and integration across internal systems and platforms
• You will work closely with product owners & analysts to understand business and functional requirements and contribute to the design and prioritization discussions
• Learn how automotive marketplaces operate and contribute to providing great experiences for our customers
• Actively participate in team planning, estimation, and collaborative software design discussions
• Identify and implement process improvements that enhance team efficiency
• Be an integral member of our engineering team, fostering a culture of mentorship and continuous learning

Preferred Qualifications

• AWS Cloud Services (EMR, S3,Athena etc.), preferred
• NoSQL databases (DynamoDB, MongoDB), preferred
• Streaming technologies (Kafka, Kinesis), preferred
• GraphQL and REST APIs, preferred
• In-memory data stores (Redis), preferred

Benefits

• 100% employer-paid health, vision, and dental premiums
• A 401(k) plan with company contributions
• Equity
• A wellness reimbursement account
• Learning & development reimbursement opportunities
• Flexible PTO for exempt TrueCar Crew Members and a generous PTO accrual policy for non-exempt TrueCar Crew Members, in addition to 14 company-paid holidays and 2 floating holidays