Remote Senior Data Engineer

Summary

Join our team at Zencore, a fast-growing company founded by former Google Cloud leaders, architects, and engineers. We're looking for candidates with significant experience in Google Cloud to help customers migrate to Google or modernize their data and applications.

Requirements

• 5+ years of experience serving in a data engineering capacity
• 2+ years of experience working with Databricks
• Familiarity with the Databricks tech stack related to data engineering: notebooks, clusters, jobs, workflows, serverless sql, unity catalog, repos, dashboards, DLT, etc
• Experience developing production Spark applications
• Strong skills with Python, PySpark and Spark SQL
• Strong understanding of Delta Lake technology and best practices to apply its capabilities during the data pipeline development lifecycle
• Experience with Spark Structured Streaming and Databricks Delta Live Tables (DLT)
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
• Understanding of incremental update patterns and technologies available on Databricks such as CDC, SCD#2, autoloader, change data feed (CDF), DLT, Delta Lake ACID, etc

Responsibilities

• Work with fast-paced innovative companies leveraging Databricks as the key driver of their transformation
• Cover a large spectrum of technology topics like ETL/ELT, Data Warehousing, Distributed Data Processing, Streaming Data systems, Data Modeling, Data Security & Governance, and BI/AI

Preferred Qualifications

Databricks' Data Engineer Associate or Data Engineer Professional certification