Architect

Summary

Join Data Piper as a Resident Solutions Architect and leverage your extensive experience in data engineering, data platforms, and analytics to provide expert consulting services. This full-time, remote position requires 10+ years of experience in data engineering and consulting, along with a Data Engineering Professional certification. You will utilize your hands-on Databricks development skills and deep understanding of distributed computing with Spark. Expertise in cloud ecosystems (AWS, Azure, GCP) and familiarity with CI/CD and MLOps are essential. A strong understanding of Databricks products and features is also required. This role offers the opportunity to work remotely.

Requirements

• Possess 10+ years of experience in data engineering, data platforms, and analytics
• Have 10+ years of consulting experience
• Complete Data Engineering Professional certification and required classes
• Demonstrate hands-on experience in development on Databricks
• Show working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with deep expertise in at least one
• Possess deep experience with distributed computing with Spark and knowledge of Spark runtime internals
• Show familiarity with CI/CD for production deployments
• Demonstrate working knowledge of MLOps
• Maintain current knowledge across the breadth of Databricks product and platform features
• Show familiarity with Databricks, Unity Catalog, and DLT
• Show familiarity with Machine Learning