Resident Solutions Architect

Summary

The job is for a Resident Solutions Architect in a full-time, remote position at Data Piper. The candidate should have 7+ years of experience in data engineering, data platforms & analytics, and 10+ years of consulting experience. They must have completed the Data Engineering Professional certification and required classes, delivered at least 5+ projects with hands-on experience in development on Databricks, and have working knowledge of two or more common Cloud ecosystems.

Requirements

• 7+ years of experience in data engineering, data platforms & analytics
• 10+ years of consulting experience
• Completed Data Engineering Professional certification and required classes
• Minimum 5+ projects delivered with hands-on experience in development on databricks
• Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with deep expertise in at least one
• Deep experience with distributed computing with Spark and knowledge of Spark runtime internals
• Familiarity with CI/CD for production deployments
• Working knowledge of MLOps
• Current knowledge across the breadth of Databricks product and platform features
• Familiarity with optimizations for performance and scalability

Responsibilities

Delivering at least 5+ projects with hands-on experience in development on Databricks