Commit is hiring a
Data Engineer

Summary

The job is for a Data Engineer at a fast-growing tech company that focuses on mobile-first solutions. The role requires designing, building, and optimizing data platforms using advanced technologies while overseeing the development of efficient data pipelines. The candidate should have at least 2 years of experience with Python or Golang and demonstrated logical thinking, decision-making, and problem-solving abilities.

Requirements

At least 2 years of experience with Python or Golang, or a willingness to learn, supplemented by experience in Java, Rust, C/C++

Responsibilities

• Pioneer the selection and implementation of cutting-edge technologies for the collection of high-volume, complex datasets
• Oversee the development of one of the most advanced data infrastructures, facilitating efficient data pipelines that integrate with technologies from Snowflake to Big Query and beyond
• Craft and manage data services focusing on trust, compliance, accessibility, and metadata management
• Scale data pipelines to support real-time processing of over 100 billion messages a day
• Ensure the integrity and reliability of intricate and continuously evolving datasets

Preferred Qualifications

• Expertise in working with time-series data
• Proficiency in profiling and optimizing systems in production environments
• Experience in developing data pipelines using Kafka, Cassandra, and Clickhouse

Benefits

• Competitive salaries
• Equity options
• Comprehensive benefits
• A dynamic, collaborative environment