Data Engineer

Summary

Join our team as a Data Engineer with 8+ years of experience and expertise in Apache NiFi. You will design, develop, and maintain data pipelines, optimize data workflows, and ensure data integrity. Proficiency in big data processing and pipeline orchestration is crucial. Collaboration with data scientists and stakeholders is expected. This is a 6+ month contract role.

Requirements

• 8+ years of experience in Data Engineering
• Expertise in Apache NiFi for data integration and pipeline orchestration
• Strong understanding of big data processing, ETL workflows, and cloud-based data platforms
• Knowledge of SQL, Python, or Java for data manipulation and scripting
• Ability to work with structured and unstructured data in large-scale environments
• Strong problem-solving skills and experience in optimizing data performance

Responsibilities

• Design, develop, and maintain data pipelines using Apache NiFi
• Optimize data ingestion, transformation, and processing for high performance and scalability
• Work with Kafka, Airflow, Impala, and Snowflake to streamline data workflows
• Ensure data integrity, security, and governance across the data ecosystem
• Collaborate with data scientists, analysts, and stakeholders to deliver high-quality data solutions
• Troubleshoot and resolve issues in data pipelines, streaming, and ETL processes

Preferred Qualifications

Experience with Kafka, Airflow, Impala, and Snowflake