Principal Data Engineer

Summary

Join Scadea as a Principal Data Engineer and work remotely. This full-time role with CX Data Labs requires 6 years of experience. You will leverage your expertise in PySpark, SQL query writing and optimization, Python, and Databricks for big data solutions. Experience with Hadoop/Hive, data versioning tools (Git, Airflow, Dagster), and Azure is essential. The position is remote.

Requirements

• Have 6 years of experience
• Be proficient in PySpark
• Be proficient in writing and optimizing SQL queries
• Have experience with Python
• Have hands-on experience in Databricks for building big data solutions
• Have experience with Hadoop/Hive
• Have experience with data versioning tools like GIT, Airflow, Dagster
• Have experience with Azure

Responsibilities

• Develop big data solutions using Databricks
• Write and optimize SQL queries
• Utilize PySpark for data processing
• Work with Hadoop and Hive
• Use data versioning tools such as Git, Airflow, and Dagster
• Leverage Azure cloud services