Big Data Solutions Architect

Summary

Join Databricks as a Big Data Solutions Architect (Resident Solutions Architect) and work on short to medium-term customer engagements, tackling big data challenges using the Databricks platform. You will deliver data engineering, data science, and cloud technology projects, integrating with client systems and providing training. As a billable role, you'll ensure projects meet specifications and exceed customer expectations. You will report to the regional Manager/Lead. The work involves impactful customer projects, including designing reference architectures, creating how-to guides, and productionalizing customer use cases. You will also consult on architecture and design, and provide escalated support for customer operational issues.

Requirements

• Proficient in data engineering, data platforms, and analytics with a strong track record of successful projects and in-depth knowledge of industry best practices
• Comfortable writing code in either Python or Scala
• Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one
• Deep experience with distributed computing with Apache Spark™ and knowledge of Spark runtime internals
• Familiarity with CI/CD for production deployments
• Working knowledge of MLOps
• Design and deployment of performant end-to-end data architectures
• Experience with technical project delivery - managing scope and timelines
• Documentation and white-boarding skills
• Experience working with clients and managing conflicts
• Build skills in technical areas which support the deployment and integration of Databricks-based solutions to complete customer projects
• Travel to customers 30% of the time
• Databricks Certification

Responsibilities

• Work with engagement managers to scope variety of professional services work with input from the customer
• Guide strategic customers as they implement transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications
• Consult on architecture and design; bootstrap or implement customer projects which leads to a customers' successful understanding, evaluation and adoption of Databricks
• Provide an escalated level of support for customer operational issues
• Work with the Databricks technical team, Project Manager, Architect and Customer team to ensure the technical components of the engagement are delivered to meet customer's needs
• Work with Engineering and Databricks Customer Support to provide product and implementation feedback and to guide rapid resolution for engagement specific product and support issues