Senior Data Engineer

Summary

The job is for a Senior Data Engineer based in Brazil on a 6-month contract with potential extension. The role involves building server-side components of interactive applications, designing data storage solutions, troubleshooting, optimizing, and collaborating. Essential skills required are proficiency in English, Python, SQL, AWS (especially AWS Glue), and experience delivering at a Senior Developer level in an enterprise and agile environment.

Requirements

• Proficient communication in English (oral and written) and excellent communication skills
• Experience delivering at a Senior Developer level in an enterprise and agile environment
• Proficient in Python, with demonstrated experience using data libraries such as Pandas, NumPy, or similar
• Strong proficiency in SQL, including query optimization and relational database management
• Hands-on experience with Apache Spark for large-scale data processing
• In-depth knowledge of AWS, particularly AWS Glue (jobs, data catalog, orchestration, connections, etc.), and a solid understanding of the broader AWS platform and services

Responsibilities

• Build server-side components of interactive applications
• Design data storage solutions
• Troubleshoot and debug applications
• Optimize applications for maximum speed and scalability
• Get feedback from, and build solutions for, users and clients
• Collaborate with internal and client teams

Preferred Qualifications

• Previous experience with Data Lakes, including but not limited to non-AWS solutions
• Familiarity with open table formats such as DeltaLake, Apache Iceberg, or Apache Hudi
• Experience in designing and implementing robust data pipelines and data lakes
• Experience with Terraform for provisioning and managing cloud infrastructure
• Experience working as a consultant

Benefits

• Work remotely
• Work flexibly
• The Wellness Hub: We have a genuine commitment to fostering/improving NearFormers’ wellbeing; we offer resources and support, including a NearForm advice line which offers confidential support for anything from relationship issues to staying healthy