Remote Data Bricks Technical Lead

Summary

Join Ardent as a highly skilled and experienced Databricks Technical Lead to design, implement, and optimize data processing workflows and analytics solutions using the Databricks platform. As the Databricks Technical Lead, you will lead a team of talented data engineers and data scientists, ensuring the successful delivery of high-quality solutions that meet business objectives.

Requirements

• Bachelor's or Master's degree in Computer Science, Data Science, or other related IT field
• Proven experience as a Technical Lead with a focus on Databricks and big data technologies
• In-depth knowledge of Apache Spark and Databricks architecture
• Strong programming skills in languages such as Python or Scala
• Experience with data engineering concepts, ETL processes, and data modeling
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud Platform
• Excellent leadership and communication skills
• Ability to thrive in a fast-paced, collaborative environment

Responsibilities

• Design and implement scalable and efficient data processing architectures using Databricks
• Make strategic decisions regarding data organization, storage, and processing
• Lead and mentor a team of data engineers and data scientists
• Provide technical guidance and support to ensure the team's success
• Oversee the implementation of data processing workflows, analytics, and machine learning models using Databricks
• Write code, configure Databricks clusters, and ensure adherence to best practices
• Optimize the performance of big data processing tasks and analytics jobs
• Identify and implement improvements to enhance resource efficiency
• Collaborate with cross-functional teams, including data science, business intelligence, and infrastructure teams
• Ensure seamless integration of data pipelines with various systems
• Establish and enforce best practices and coding standards
• Ensure consistency, quality, and maintainability of the codebase
• Provide technical support for the team in troubleshooting issues
• Optimize queries and resolve technical challenges during development and production
• Manage the technical aspects of projects, including timelines and resource allocation
• Coordinate with stakeholders to ensure project goals are met

Benefits

• Highly competitive benefits
• Professional development opportunities