Senior Data Engineer

Summary

Join NearForm, a digital and AI engineering consultancy, as a remote Senior Data Engineer based in Brazil. You will build server-side components of interactive applications for enterprise clients, utilizing technologies like Python, AWS, and various data platforms. Responsibilities include designing data pipelines, implementing security, optimizing applications, and collaborating with client teams. This role requires extensive experience in server-side development, agile environments, and specific technologies like Python, SQL, and Snowflake. Excellent communication skills and advanced English proficiency are essential. NearForm offers remote work flexibility, a wellness hub, and other location-specific benefits.

Requirements

• Excellent communication skills and advanced English proficiency level for oral and written communication
• Experience delivering at a Senior Developer level in an enterprise environment
• Practical experience of delivering in an agile environment
• Practical experience of knowledge of developing real-world solutions and platforms
• Deep understanding of server side code, with experience developing in Python and utilising SQL
• Production experience of Snowflake or Databrick platforms
• Deep understanding of ELT/ETL pipelines and toolchains
• Deep understanding of Relational and Document data stores
• Deep understanding of how modern web services are built
• Deep understanding of modern testing methodologies, tools and practices
• Deep understanding of versioning control tools including Git
• Understanding of tools such as AWS serverless compute, Apigee, CloudRun and containerisation
• Understanding of security and performance considerations
• Understanding of architectural and design patterns in one or more of AWS/GCP/Azure
• Understanding of deployment tools and systems integration
• Understanding with a wide variety of open-source technologies and tools
• Excellent analytical and multitasking skills
• Excellent communication and collaboration skills
• Empathy and people skills

Responsibilities

• Design & build data pipelines and solutions using Python, AWS, Pyspark, SQL, Neo4j, and Airflow
• Support system design, development and maintenance and take responsibility for personal technical quality standards within the project team
• Assist with defining structured practices, especially in source code management, building and deployment
• Design and implement data storage solutions
• Implement security and data protection
• Execute meticulous automated tests in line with best practice
• Troubleshoot and debug applications
• Optimize applications for maximum speed and scalability
• Use appropriate tools to maintain version control and build processes
• Get feedback from, and build solutions for, users and clients
• Work with and support the Delivery Architect (team lead) in project execution and timely delivery
• Collaborate with client teams
• Write documentation and guides
• Follow new and emerging technologies
• Contribute to NearForm tooling and open-source projects
• Understand and embrace the NearForm culture

Preferred Qualifications

• Experience with tools such as Neo4j
• Experience with other programming languages e.g. Javascript and Java
• Experience with multiple cloud technologies
• Experience debugging infrastructure
• Infrastructure as code technology such as Terraform and Cloud Formation
• Previous consultancy experience

Benefits

• Work remotely; we have a genuine dedication to work/life balance
• Work flexibly; we appreciate there are more important things in life than work so our flexible working culture allows you to work around what matters - school run, no problem!
• The Wellness Hub: We have a genuine commitment to fostering/improving NearFormers’ wellbeing; we offer resources and support, including a NearForm advice line which offers confidential support for anything from relationship issues to staying healthy
• Other benefits according to your location