Senior Data Engineer

Summary

Join DaCodes, a leading software and digital transformation firm, and contribute to innovative technological solutions for clients in LATAM and the US. As a Data Engineer, you will leverage cutting-edge technologies and participate in challenging projects impacting major global companies. You'll work with disruptive startups and global brands, contributing your expertise and knowledge. DaCodes offers opportunities for professional growth and a collaborative environment. The ideal candidate will have experience in AWS native ingestion and orchestration, data lake and warehouse modeling, and large-scale data processing. You will build and automate data pipelines, model data, and ensure data quality and governance. DaCodes provides a remote work environment with flexible hours and various benefits.

Requirements

• Proven experience in AWS native architectures for data ingestion and orchestration
• Advanced handling of tools and services for large-scale data processing (Spark, Lambda, Kinesis)
• Solid knowledge of open-table data modeling and Data Lake and Data Warehouse architectures
• Mastery of programming in Python or Scala for ETL/ELT and transformations
• Experience in data quality assurance and continuous monitoring (Great Expectations, Datadog)
• Knowledge of cloud security, encryption, and data governance

Responsibilities

• Build batch or micro-batch pipelines (SLA ≤ 24 hours) for ingesting events and profiles from S3/Kinesis to data warehouses
• Automate campaign-specific DAGs with AWS Step Functions or Managed Airflow, provisioned at the start and deleted after campaign completion
• Model data in partitioned open-table formats in S3 using technologies like Iceberg, Hudi, or Delta, with versioning by campaign
• Perform ELT loads to Redshift Serverless or queries in Athena/Trino using snapshot and incremental patterns
• Develop data transformations with Glue Spark jobs or EMR on EKS for heavy processes, and use Lambda or Kinesis Data Analytics for lightweight enrichments
• Program in Python (PySpark, Pandas, boto3) or Scala for data processing
• Implement declarative data quality tests with tools like Great Expectations or Deequ that run daily during active campaigns
• Manage infrastructure and code pipelines using GitHub Actions or CodePipeline, with alerts configured in CloudWatch or Datadog
• Ensure data security and governance with Lake Formation, column-level encryption, and compliance with regulations like GDPR/CCPA
• Manage IAM roles with the principle of least privilege for temporary campaign pipelines
• Expose semantic models in Redshift/Athena for BI tools like Looker (LookML, PDTs) or connected to Trino

Preferred Qualifications

• Automatic pipeline generation using templates in Terraform or CDK for parameterized deployments
• Experience with real-time feature serving systems such as SageMaker Feature Store, DynamoDB, or Redis
• Competence in FinOps, optimizing costs in serverless infrastructure or with intelligent scaling
• Design of schemas for gamification and ad-tech, handling high-speed events (10k events/sec)
• Knowledge of experimentation frameworks such as A/B testing, incrementality measurement, or reinforcement learning for personalized games
• English preferred, for effective technical communication with international teams (not mandatory)

Benefits

• Work with global brands and disruptive startups
• Remote work/Home office
• If hybrid or in-person modality is required, you will be informed from the first session
• Schedule adjusted to the assigned work/project cell
• Work Monday to Friday
• Legal benefits (apply to Mexico)
• Day off on your birthday
• Major medical insurance (applies to Mexico)
• Life insurance (applies to Mexico)
• Multicultural work teams
• Access to courses and certifications
• Meetups with special guests from the IT area
• Virtual integration events and interest groups
• English classes
• Opportunities within our different lines of business
• Proudly certified as Great Place to Work