Remote Senior Data Engineer

Summary

Join Collective[i], a private 100% remote company, in their search for a Lead Data Engineer to construct applications managing operations on a global scale. The ideal candidate will collaborate with engineering, operations, and product teams to implement new applications, enhance existing components, and conceive novel functionalities. Proficiency in Open Source and Big Data technologies is required.

Requirements

• Proficiency with Open Source and Big Data technologies
• Hands-on experience with Hadoop, Cloudera, or similar platforms
• Expertise in Java development, with a focus on crafting efficient and scalable solutions
• Strong background in messaging systems like Kafka, ensuring seamless data integration and communication
• In-depth knowledge of SQL/NoSQL technologies to manage and analyze large-scale datasets
• Proven ability to design and develop complex workflows using Oozie or Airflow
• Demonstrated success in building secure, scalable, and high-performance big data platforms to handle and analyze complex data using open-source tools
• Familiarity with cloud computing infrastructure (e.g., AWS, GCP, Snowflake), with a deep understanding of scalable, distributed systems
• Experience with a range of analytical tools, languages, or libraries
• Expertise in architecting and implementing large-scale data intelligence solutions, especially within Snowflake Cloud Data Warehouse, is a bonus

Responsibilities

• Collaborate extensively with engineering, operations, and product teams
• Implement new applications onto our data framework
• Enhance existing outdated components
• Conceive novel functionalities for our products

Benefits

$100,000 - $150,000 a year