Senior Data Engineer

closed
Logo of MentorMate

MentorMate

πŸ“Remote - Paraguay

Job highlights

Summary

Join MentorMate Paraguay, the Latin American headquarters of a global digital transformation consultancy, as a Senior Data Engineer. You will leverage your expertise in Spark and AWS to build and maintain scalable data pipelines, working with diverse data sources and collaborating with cross-functional teams. This role requires significant experience in data engineering, specifically with Apache Spark and AWS services. You will play a crucial role in ingesting, processing, and storing data to support data-driven decision-making. MentorMate offers competitive pay and benefits, and flexible working models. The company is part of Tietoevry Create, a global technology company with over 10,000 experts.

Requirements

  • 7+ years of experience in Data Engineering
  • Proven experience as a Senior Data Engineer with a strong focus on Apache Spark
  • Experience with AWS services such as S3, Redshift, and Aurora PostgreSQL
  • Strong knowledge of ingesting and processing data from diverse sources
  • Good understanding and practical experience with medallion architecture
  • Experience with modern SDLC, CI/CD and SCM
  • Excellent problem-solving skills and ability to work independently or as part of a team
  • Strong communication skills to collaborate effectively with technical and non-technical stakeholders

Responsibilities

  • Develop and maintain scalable data pipelines using Apache Spark
  • Work within Databricks notebooks to run data processing tasks
  • Ingest data from various sources including enterprise software such Salesforce and NetSuite, as well as internal software systems
  • Utilize AWS tools, including S3, Redshift, and Aurora PostgreSQL, to manage and store data
  • Implement a medallion architecture for data organization and processing
  • Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions
  • Maintain and enhance existing data pipelines with a focus on performance and scalability
  • Ensure data quality, integrity, and security across all managed systems

Preferred Qualifications

Experience working with Databricks for data processing

Benefits

  • Competitive pay and benefits
  • Flexible working models
This job is filled or no longer available