Data Engineer Specialist

Summary

Join QuintoAndar, the largest real estate ecosystem in Latin America, as a Data Engineer Specialist. Build and maintain a high-performance data platform, create and edit data pipelines, and develop data modeling and transformation workflows. You will investigate data inconsistencies, enable self-service data access, and align with stakeholders to understand their needs. Conduct PoCs and benchmarks to determine the best tools, contribute to the strategic vision, and advocate for data analytics. This remote-first role offers opportunities to work from anywhere in Brazil, with access to offices in São Paulo and Campinas.

Requirements

• Has 7 or more years of experience in Data Engineering roles
• Specialist in technologies, solutions, and concepts of Big Data (Spark, Hadoop, Hive, MapReduce) and multiple languages (YAML, Python)
• Experience with Airflow, Spark, AWS and Databricks
• Strong foundation in software engineering principles, with experience working on data-centric systems
• Experience with columnar storage solutions and/or data lakehouse concepts
• Proficiency in Python, or one of the main programming languages, and a passion for writing clean and maintainable code
• Strong knowledge in optimizing SQL query performance
• Experience in building multidimensional data models (Star and/or Snowflake schema)
• Understanding of the data lifecycle and concepts such as lineage, governance, privacy, retention, anonymization, etc
• Knowledge in infrastructure areas such as containers and orchestration (Kubernetes, ECS), CI/CD strategies, infrastructure as code (Terraform), observability (Prometheus, Grafana), among others
• Proficiency in English - our code, documentation, tools, and materials are often structured in English
• Excellent communication skills, proactively sharing and collaborating with both technical and non-technical stakeholders to translate business needs into scalable data solutions
• Experience as a tech/project lead or similar
• Curiosity, detail-orientation, and thrive in a fast-paced, data-driven environment

Responsibilities

• Build and maintain a high-performance data platform that meets the company's needs, connects with product solutions, and leads analytical innovation, enabling incredible architectures and efficient platforms
• Create and edit data pipelines, considering business logic that best applies to the area in question, choosing levels of aggregation, grouping and transforming fields, checking data quality, and cleaning the data
• Create data modeling and transformation workflows, enabling the creation of clear and accessible data abstractions
• Responsible for the entire code development lifecycle (monitoring deployment, documentation, performance, security, adding metrics and alarms, ensuring SLO budget compliance, and more)
• Investigate inconsistencies and be able to trace the source of differences (data troubleshooting)
• Enable teams across the company to access and use data more effectively through self-service tools and well-modeled datasets
• Align with stakeholders to understand their primary needs, while also having a holistic view of the problem and proposing extensible, scalable, and incremental solutions
• Conduct PoCs and benchmarks to determine the best tool for a given problem, and decide whether to use an off-the-shelf solution or develop one in-house
• Contribute to defining the strategic vision, crossing team and service boundaries to solve problems
• Advocate for the value of data analytics and engineering within the organization and fostering a data-driven culture
• Be a reference within the chapter on technical concepts, tools, and/or best coding practices

Preferred Qualifications

• You have participated in building large-scale data platforms for big data sets and teams using Big Data technologies such as Spark, Trino, Hive, Atlas, Ranger, etc
• Experience in building semantic layers

Benefits

• Competitive salary package
• Bonus
• Meal allowance ("Flash benefícios")
• Health plan
• Dental plan (optional)
• Life insurance
• Daycare subsidy
• Subsidy to sports practicing (Wellhub)
• Extended maternity and paternity leave
• Reserved room for breast-feeding*
• Language learning support