Senior Data Engineer

Summary

Join Discogs as a Senior Data Engineer and play a pivotal role in shaping the future of our marketing initiatives. This remote position, open to candidates in OR, WA, CA, CO, TX, and IL, involves designing, developing, and optimizing data pipelines for our music-focused marketplace. You will collaborate with cross-functional teams, ensuring data integrity and driving data-driven decision-making. The ideal candidate possesses extensive experience in data engineering, strong programming skills, and a passion for music. Compensation is a contract rate of $65-$75 per hour. Benefits will be discussed upon contract completion.

Requirements

• Proficiency in data integration and ETL processes
• Knowledge of programming languages such as Python, Java, or Javascript
• Familiarity with cloud platforms and services (e.g., AWS, GCP, Azure)
• Understanding of data warehousing concepts and technologies (e.g., Redshift, BigQuery, Snowflake)
• Excellent problem-solving skills and attention to detail
• Strong communication and collaboration skills to work effectively with cross-functional teams
• Experience with marketing automation platforms
• Experience with data warehouses in a marketing context
• Bachelor’s degree in Computer Science, Information Technology, Data Science, or a related field
• 5+ years of experience as a Data Engineer or in a similar role, preferably within an e-commerce or marketplace environment
• Experience with data pipeline tools and technologies (e.g., Apache Kafka, Apache Nifi, Apache Airflow)
• Strong experience with MySQL and database management

Responsibilities

• Design, develop, and maintain data pipelines to ingest, process, and store data
• Implement data validation and quality checks to maintain the integrity of incoming data
• Optimize and automate data workflows to improve efficiency and reduce manual intervention
• Work closely with the product, engineering, marketing and analytics teams to support data-driven decision-making
• Develop and maintain documentation related to data processes, workflows, and system architecture
• Troubleshoot and resolve data-related issues promptly to minimize disruptions
• Monitor and enhance the performance of data infrastructure, ensuring scalability and reliability
• Stay updated with industry trends and best practices in data engineering and apply them to improve our systems

Preferred Qualifications

• Knowledge of API integration and data exchange formats such as JSON, XML, and CSV
• Master’s degree
• Experience in the music industry or a strong personal interest in vinyl records
• Experience with BI tools data visualization tools (e.g., Tableau, Looker)