Data Engineer Tech Lead

Dev.Pro Logo

Dev.Pro

๐Ÿ“Remote - Brazil

Summary

Join a team in Brazil, Argentina, or Colombia as a Senior Data Engineer for a large-scale data modernization effort. Lead the Data Engineering team in migrating legacy data pipelines to a modern cloud environment. Collaborate with architects, DevOps, QA, and product stakeholders. Work with modern technologies like GCP, Snowflake, Apache Iceberg, dbt, Airflow, Dataflow, and BigQuery. Gain hands-on experience with Google Landing Zones. This role combines hands-on engineering with technical leadership, acting as a bridge between engineering and solution architecture.

Requirements

  • 10+ years of experience in software engineering, with last 5+ years in data engineering and data warehouse modeling, with a deep understanding of the data lifecycle
  • Proven track record in designing, building, and scaling ETL/ELT pipelines for both batch and streaming data
  • Strong hands-on experience with Google Cloud Platform (GCP) - about 2+ years ideally not older than 2021, including: BigQuery, GCS, Cloud Composer (Airflow), Dataflow, Dataproc, Pub/Sub, Cloud Functions
  • Proficient in Python for ETL scripting, DAG development, and data manipulation
  • Experience using dbt for data transformation, testing, and orchestration
  • Familiar with CI/CD pipelines and Infrastructure as Code (IaC) using tools like Git, Terraform, and Serverless Framework
  • Strong architectural mindset: able to design scalable, cost-efficient, and maintainable data solutions
  • Acts as a tech lead and architect hybridโ€”can drive technical direction (both in customer negotiations & planning and implementation), mentor engineers, and remain hands-on
  • Strong leadership and team collaboration skills; able to influence decisions, set standards, and support delivery
  • Continuously explores new technologies, best practices, and modern data stack tools
  • Degree in Computer Science, Information Systems, Data Engineering, or a related technical field
  • Upper-Intermediate or higher level of English (B2+); excellent communicator and team player

Responsibilities

  • Lead a skilled Data Engineering team through high-impact data platform transformation in a production environment
  • Work hands-on with modern, in-demand technologies like GCP, Snowflake, Apache Iceberg, dbt, Airflow, Dataflow, and BigQuery
  • Gain hands-on experience with Google Landing Zones
  • In this role, youโ€™ll combine hands-on engineering work with technical leadership responsibilities, acting as a bridge between engineering and solution architecture, guiding technical direction, mentoring engineers and contributing to code and design to ensure scalable, high impact project delivery
  • Review and analyze existing ETL solutions for migration to the new architecture
  • Design, optimize, and migrate batch and streaming data pipelines to the GCP Landing Zone
  • Build and manage data transformations with dbt, supporting ELT pipelines in Snowflake
  • Ensure the new data infrastructure meets performance and quality SLAs/SLOs
  • Implement monitoring and alerting for pipelines to ensure system fault tolerance
  • Develop migration scripts to transfer historical data to Iceberg tables
  • Act as a liaison between the technical team and the client to ensure clear communication
  • Break down complex tasks into smaller, manageable technical deliverables for the team
  • Proactively identify risks and take steps to mitigate them

Preferred Qualifications

  • Experience building and managing streaming data pipelines and event-driven architectures
  • Experience writing Bash scripts
  • Experience with Java for Dataflow jobs
  • Familiarity with data lakehouse architectures using Iceberg tables
  • Proficiency with Docker for containerizing data pipelines and supporting orchestration
  • Familiarity with AI-assisted tools like GitHub Copilot

Benefits

  • Join a fully integrated delivery team built on collaboration, transparency, and mutual respect
  • Get 30 paid days off per year to use however you like โ€” vacations, holidays, or personal time
  • 5 paid sick days, up to 60 days of medical leave, and up to 6 paid days off per year for major family events like weddings, funerals, or the birth of a child
  • Partially covered health insurance after the probation, plus a wellness bonus for gym memberships, sports nutrition, and similar needs after 6 months
  • We pay in U.S. dollars and cover all approved overtime
  • Join English lessons and Dev.Pro University programs, and take part in fun online activities and team-building events
  • We are 99.9% remote โ€” you can work from anywhere in the world

Share this job:

Disclaimer: Please check that the job is real before you apply. Applying might take you to another website that we don't own. Please be aware that any actions taken during the application process are solely your responsibility, and we bear no responsibility for any outcomes.