Senior Big Data Hadoop Ml Engineer

Summary

Join our team as a Senior Big Data Engineer! This remote position requires a strong background in developing batch processing systems using the Apache Hadoop ecosystem and experience with Java and Machine Learning pipelines. You will develop scalable code, manage batch pipelines, leverage GCP, and implement DevOps best practices. The ideal candidate will have a Bachelor's degree in a related field, 10+ years of customer-facing experience, and 5+ years of experience with cloud migrations and GCP solutions. Competitive salary and benefits are offered.

Requirements

• Bachelor’s degree: Computer Science, Software Engineering or related field of study
• 10+ years of experience in customer-facing software/technology or consulting
• 5+ years of experience with “on-premises to cloud” migrations or IT transformations
• 5+ years of experience building, and operating solutions built on GCP
• Strong experience in the Apache Hadoop ecosystem
• Proficiency in in the Hadoop ecosystem especially with Oozie and Pig
• Strong programming skills with Java, Python, and Spark
• Experience in Infrastructure and Applied DevOps principles in daily work
• Experience with continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) tool like Terraform
• Proven experience in engineering batch processing systems at scale
• Experience with batch pipelines supporting Machine Learning workloads

Responsibilities

• Develop scalable and robust code for large scale batch processing systems using Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, Hbase
• Develop, manage, and maintain batch pipelines supporting Machine Learning workloads
• Leverage GCP for scalable big data processing and storage solutions
• Implement automation/DevOps best practices for CI/CD, IaC, etc

Benefits

• Remote work
• The anticipated starting pay range for Colorado is: $182,100 - 227,600
• The anticipated starting pay range for the states of Hawaii and New York (not including NYC) is: $191,600 - 239,500
• The anticipated starting pay range for California, New York City and Washington is: $199,300 - $249,100
• Unless already included in the posted pay range and based on eligibility, the role may include variable compensation in the form of bonus, commissions, or other discretionary payments