Remote Data Bricks Technical Lead

Logo of Ardent

Ardent

📍Remote - Worldwide

Job highlights

Summary

Join Ardent as a highly skilled and experienced Databricks Technical Lead to design, implement, and optimize data processing workflows and analytics solutions using the Databricks platform. As the Databricks Technical Lead, you will lead a team of talented data engineers and data scientists, ensuring the successful delivery of high-quality solutions that meet business objectives.

Requirements

  • Bachelor's or Master's degree in Computer Science, Data Science, or other related IT field
  • Proven experience as a Technical Lead with a focus on Databricks and big data technologies
  • In-depth knowledge of Apache Spark and Databricks architecture
  • Strong programming skills in languages such as Python or Scala
  • Experience with data engineering concepts, ETL processes, and data modeling
  • Familiarity with cloud platforms such as AWS, Azure, or Google Cloud Platform
  • Excellent leadership and communication skills
  • Ability to thrive in a fast-paced, collaborative environment

Responsibilities

  • Design and implement scalable and efficient data processing architectures using Databricks
  • Make strategic decisions regarding data organization, storage, and processing
  • Lead and mentor a team of data engineers and data scientists
  • Provide technical guidance and support to ensure the team's success
  • Oversee the implementation of data processing workflows, analytics, and machine learning models using Databricks
  • Write code, configure Databricks clusters, and ensure adherence to best practices
  • Optimize the performance of big data processing tasks and analytics jobs
  • Identify and implement improvements to enhance resource efficiency
  • Collaborate with cross-functional teams, including data science, business intelligence, and infrastructure teams
  • Ensure seamless integration of data pipelines with various systems
  • Establish and enforce best practices and coding standards
  • Ensure consistency, quality, and maintainability of the codebase
  • Provide technical support for the team in troubleshooting issues
  • Optimize queries and resolve technical challenges during development and production
  • Manage the technical aspects of projects, including timelines and resource allocation
  • Coordinate with stakeholders to ensure project goals are met

Benefits

  • Highly competitive benefits
  • Professional development opportunities

Job description

Why do you need to choose between doing important work and having a fulfilling life? At Ardent, we have both. Ardent employees are committed to solving our customers’ most difficult problems—and we are committed to the well-being, personal goals, and professional development of our employee. We are “All In.” We put forth our strongest effort possible to get the mission accomplished and we do it together. We respect the skills and experience you bring to the Ardent team. And we provide a rewarding environment to help you succeed.

We offer highly competitive benefits, professional development opportunities, and an exceptional culture that embraces flexibility, innovation, collaboration, and career growth. A collective service mindset underpins our work, and a shared camaraderie to serve clients, colleagues and our communities set us apart. Our full commitment to being “All In” for our employees and our clients is not just our approach, it is our standard. If this sounds like the perfect fit for you, choose Ardent and make a difference with us.


Ardent is seeking a highly skilled and experienced Databricks Technical Lead to join our dynamic team. As the Databricks Technical Lead, you will play a crucial role in designing, implementing, and optimizing data processing workflows and analytics solutions using the Databricks platform. You will lead a team of talented data engineers and data scientists, ensuring the successful delivery of high-quality solutions that meet business objectives. This role requires a deep understanding of big data technologies, particularly Apache Spark, as well as expertise in data engineering and analytics.

Responsibilities:

Architecture and Design:

  • Design and implement scalable and efficient data processing architectures using Databricks.
  • Make strategic decisions regarding data organization, storage, and processing.

Team Leadership:

  • Lead and mentor a team of data engineers and data scientists.
  • Provide technical guidance and support to ensure the team’s success.

Implementation:

  • Oversee the implementation of data processing workflows, analytics, and machine learning models using Databricks.
  • Write code, configure Databricks clusters, and ensure adherence to best practices.

Performance Optimization:

  • Optimize the performance of big data processing tasks and analytics jobs.
  • Identify and implement improvements to enhance resource efficiency.

Collaboration:

  • Collaborate with cross-functional teams, including data science, business intelligence, and infrastructure teams.
  • Ensure seamless integration of data pipelines with various systems.

Best Practices and Standards:

  • Establish and enforce best practices and coding standards.
  • Ensure consistency, quality, and maintainability of the codebase.

Troubleshooting and Support:

  • Provide technical support for the team in troubleshooting issues.
  • Optimize queries and resolve technical challenges during development and production.

Project Management:

  • Manage the technical aspects of projects, including timelines and resource allocation.
  • Coordinate with stakeholders to ensure project goals are met.

Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Data Science, or other related IT field.
  • Proven experience as a Technical Lead with a focus on Databricks and big data technologies.
  • In-depth knowledge of Apache Spark and Databricks architecture.
  • Strong programming skills in languages such as Python or Scala.
  • Experience with data engineering concepts, ETL processes, and data modeling.
  • Familiarity with cloud platforms such as AWS, Azure, or Google Cloud Platform.
  • Excellent leadership and communication skills.
  • Ability to thrive in a fast-paced, collaborative environment.

Due to the nature of the work we support, all candidates in consideration for this role must be U.S. Citizens willing to undergo the government issued background investigation process.


Ardent is an equal opportunity employer. We will not discriminate and will take affirmative action measures to ensure against discrimination in employment, recruitment, advertisements for employment, compensation, termination, upgrading, promotions, and other conditions of employment against any employee or job applicant on the bases of race, color, gender, national origin, age, religion, creed, disability, veteran’s status, sexual orientation, gender identity or gender expression.

Share this job:

Disclaimer: Please check that the job is real before you apply. Applying might take you to another website that we don't own. Please be aware that any actions taken during the application process are solely your responsibility, and we bear no responsibility for any outcomes.

Similar Remote Jobs

Please let Ardent know you found this job on JobsCollider. Thanks! 🙏