Senior Data Engineer

Summary

Join Encora as a Data Engineer in Brazil and work remotely, building and maintaining ELT pipelines using Kotlin and Python. You will develop high-performance APIs for real-time data, collaborate with internal users, and architect scalable solutions on Azure cloud services. Experience with Kafka/Pulsar, Kubernetes, and microservices architecture is essential. This full-time role requires expertise in distributed systems and real-time data processing. You will participate in CI/CD, observability, and performance tuning.

Requirements

• Experience building ELT or streaming data pipelines
• Strong Kotlin, Python development skills (or experience with JVM languages and willingness to learn Kotlin)
• Deep understanding of distributed systems and real-time data processing
• Proven experience with microservices architecture and API development
• Solid understanding of Kubernetes concepts: pods, services, autoscaling, Helm charts, etc
• Cloud deployment experience, ideally on Azure with exposure to Databricks or similar platforms

Responsibilities

• Design, build, and maintain ELT pipelines in Kotlin and Python that ingest and transform data from real-time sources like Kafka and Pulsar
• Develop and maintain high-performance APIs to serve real-time data from databases, services, and caches
• Collaborate with internal users and microservice consumers to ensure reliable access to up-to-date data
• Architect and implement scalable solutions to handle growing traffic and data volume across services
• Work with Azure cloud services, including Databricks, for data processing and analytics
• Manage containerized workloads using Kubernetes, with a focus on high availability and auto-scaling
• Participate in CI/CD, observability, and performance tuning across the platform

Preferred Qualifications

Experience with Typescript is a plus