Big Data Engineer

Summary

Join our client as a Big Data Engineer (Junior-Mid Level) to work on internal technical initiatives in data engineering, data analytics, and software integration. This is a remote position, though DMV area candidates are preferred. The role involves designing, building, and optimizing data pipelines, collaborating with stakeholders, optimizing algorithms, working within an AWS environment, and using Python, Java, or Scala for development.

Requirements

• 3-6 years of hands-on experience in data engineering
• Strong expertise in Python (or Java/Scala), with proven coding proficiency
• Advanced experience in SQL, specifically for structuring complex queries
• Experience building data pipelines (not ETL) and optimizing algorithms
• Knowledge of AWS EMR and working in a big data environment
• Familiarity with Spark and test-driven development

Responsibilities

• Design, build, and optimize data pipelines to support business initiatives
• Collaborate with the internal business stakeholders to improve data engineering and analytics capabilities
• Optimize algorithms and work on complex SQL queries for data solutions
• Work within an AWS environment, particularly EMR, to manage and process large data sets
• Use Python, Java, or Scala for development, alongside test-driven development practices