Commit is hiring a
Data Engineer

Summary

The job is for a Data Engineer position in Google Cloud, where the employee will work with fast-paced innovative companies as their trusted advisor on Google Cloud. The role involves working with various data engineering topics and requires at least 5 years of experience as a data engineer or in a comparable capacity.

Requirements

• 5+ years of experience serving as a data engineer or in a comparable engineering capacity
• Strong skills with Python or a JVM language (Java, Scala)
• Advanced working SQL knowledge and experience working with relational databases
• Experience working with cloud data warehouses, specifically BigQuery or Snowflake
• Experience working with data platforms built on public cloud in a production setting
• Familiarity with modern DataOps (e.g. quality eng, testing, pipeline deployments etc) practices and IaC (e.g. Terraform)
• Familiarity with the constellation of tools in the data engineering ecosystem
• Experience with batch, micro-batch, and real-time streaming architectures
• Good internal and customer-facing communication skills

Responsibilities

• Working with fast-paced innovative companies, leveraging Cloud as the key driver of their transformation
• Cover a large spectrum of technology topics like ETL/ELT, Data Warehousing, Distributed Data Processing, and Streaming Data systems

Preferred Qualifications

• Experience with GCP native data toolset is preferred
• Having built ELT or ETL pipelines processing large amounts of data. Experience with dbt or Airbyte is preferred
• Experience developing production Spark or Hadoop applications
• Gained experience with a workload scheduling and orchestration tool such as Apache Airflow/Cloud Composer

Benefits

• Relating to our customers' complexities (empathy)
• Being the missing link for customers, connecting them to Google and moving quickly when others can’t
• Removing uncertainty and risk by clearly outlining the process of cloud migration for our customers
• Accelerating timelines and do not dwell on a challenge