Databricks Architect

Summary

Join Tiger Analytics, a global leader in AI and analytics, as a Databricks Architect. You will play a key role in designing and implementing robust data solutions for Fortune 100 companies. This position requires 12+ years of experience in large-scale data ecosystem architecture and development. You will leverage your expertise in Databricks, AWS, and DevOps to optimize performance, reduce costs, and improve reliability. The role offers significant career development opportunities within a fast-growing, challenging, and entrepreneurial environment. You will be responsible for designing scalable and secure Databricks solutions, implementing DevOps processes, and driving performance initiatives.

Requirements

• 12+ years of experience in Architecture, design and data engineering development of large-scale data ecosystems
• Good exposure to AWS
• Strong communication and leadership skills
• Self-driven and able to work independently
• Experience with hadoop environment
• Experience with DevOps tools and practices, including CI/CD pipeline setup using Git, Terraform, GitHub Actions, or Jenkins
• Core Skills: Databricks platform knowledge, performance optimization, DevOps, Unity Catalog migration implementation exposure, Spark Streaming pipeline design exposure

Responsibilities

• Design and architect scalable and secure Databricks solutions platform, optimizing performance, cost, and reliability
• Be a hands-on Databricks/Dataops Architect that can help reduce consumption, and improve performance issues
• Help build monitoring tools
• Drive performance initiatives and recommendations (identify tuning opportunities, creation of performance environment etc
• Implement DevOps process on the Databricks platform, harmonized and curation pipelines across all the programs

Benefits

• Significant career development opportunities exist as the company grows
• The position offers a unique opportunity to be part of a small, fast-growing, challenging, and entrepreneurial environment, with a high degree of individual responsibility