Data Engineer

Summary

The job is for a Data Engineer at DRW, a global trading firm. The role involves managing large-scale data projects, creating and managing ETL pipelines, and collaborating with various departments. The employee will work on high-impact machine learning projects across the company's businesses.

Requirements

• A bachelor’s or a master’s degree in computer science, software engineering or equivalent
• 3+ years of experience building software systems
• Proven track record of working with large datasets (ingesting, cleaning, preprocessing, analyzing and validating data)
• Excellent programming and scripting skills (Python, SQL, Go or equivalent)
• Experience working with timeseries structured data or streaming data
• Experience with relational databases, time series databases
• Strong understanding of software engineering principles and best practices
• Strong problem-solving and analytical skills
• Excellent communication and collaboration skills

Responsibilities

• Manage large scale data projects, from design to implementation
• Create and manage ETL and data pipelines
• Continuously manage, clean and validate historical and live data for downstream ML tasks
• Combine large datasets from a variety of sources
• Design, build and maintain dashboards to visualize historical and live data
• Build scalable and performant software using software engineering best practices
• Drive data projects and lead new initiatives
• Collaborate with stakeholders from different departments

Preferred Qualifications

Experience with any of these technologies is an asset: Redis, RabbitMQ, GraphQL, Kafka, ELK, Docker, AMQP

Benefits

• Recognized as one of Canada’s Best Employers for the past 8 years
• Committed to continuous learning & development
• Industry leading benefits package and perks
• Focused on employee well-being and work-life balance
• Community initiatives, volunteer program and opportunities for giving back