Remote Senior Data Platform Engineer

Summary

Join QuintoAndar's data engineering team as a Data Platform Engineer and contribute to building a high-performance data platform that meets the company's needs, connects with product solutions, and leads analytical innovation.

Requirements

• Knowledge in Big Data technologies, solutions, and concepts (Spark, Hive, MapReduce) and multiple languages (YAML, Python)
• Proficiency in Python, or one of the main programming languages, and a passion for writing clean and maintainable code
• Understanding of the data lifecycle and concepts such as lineage, governance, privacy, retention, anonymization, etc
• Excellent communication skills, proactively sharing and seeking context to collaborate with different teams

Responsibilities

• Build and maintain a high-performance data platform that meets the company's needs, connects with product solutions, and leads analytical innovation, enabling incredible architectures and efficient platforms
• Responsible for the entire code development lifecycle (monitoring deployment, adding metrics and alarms, ensuring SLO budget compliance, and more)
• Align with stakeholders to understand their primary needs, while also having a holistic view of the problem and proposing extensible, scalable, and incremental solutions
• Conduct PoCs and benchmarks to determine the best tool for a given problem, and decide whether to use an off-the-shelf solution or develop one in-house
• Contribute to defining the strategic vision, crossing team and service boundaries to solve problems

Preferred Qualifications

• You have participated in building large-scale data platforms for big data sets and teams using Big Data technologies such as Spark, Trino, Hive, Atlas, Ranger, etc
• You have knowledge of AWS and GCP cloud resources
• You have experience with Apache Airflow or other tools for data workflows
• You have experience with columnar storage solutions and/or data lakehouse concepts
• You have experience with Databricks Platform resources
• You have knowledge in infrastructure areas such as containers and orchestration (Kubernetes, ECS), CI/CD strategies, infrastructure as code (Terraform), observability (Prometheus, Grafana), among others

Benefits

• Competitive salary package
• Bonus
• Meal allowance ("Flash benefícios")
• Health plan
• Dental plan (optional)
• Life insurance
• Daycare subsidy
• Subsidy to sports practicing (Gympass)
• Extended maternity and paternity leave
• Reserved room for breast-feeding*
• Discount on our parking lot;*
• Language learning support
• Free transfer from Vila Madalena and Fradique Coutinho stations to the office*
• Free bike rack in our parking lot.*