Senior Data Engineer

Summary

Join MentorMate Paraguay, the Latin American headquarters of a global digital transformation consultancy, as a Senior Data Engineer. You will leverage your expertise in Spark and AWS to build and maintain scalable data pipelines, working with diverse data sources and collaborating with cross-functional teams. This role requires significant experience in data engineering, specifically with Apache Spark and AWS services. You will play a crucial role in ingesting, processing, and storing data to support data-driven decision-making. MentorMate offers competitive pay and benefits, and flexible working models. The company is part of Tietoevry Create, a global technology company with over 10,000 experts.

Requirements

• 7+ years of experience in Data Engineering
• Proven experience as a Senior Data Engineer with a strong focus on Apache Spark
• Experience with AWS services such as S3, Redshift, and Aurora PostgreSQL
• Strong knowledge of ingesting and processing data from diverse sources
• Good understanding and practical experience with medallion architecture
• Experience with modern SDLC, CI/CD and SCM
• Excellent problem-solving skills and ability to work independently or as part of a team
• Strong communication skills to collaborate effectively with technical and non-technical stakeholders

Responsibilities

• Develop and maintain scalable data pipelines using Apache Spark
• Work within Databricks notebooks to run data processing tasks
• Ingest data from various sources including enterprise software such Salesforce and NetSuite, as well as internal software systems
• Utilize AWS tools, including S3, Redshift, and Aurora PostgreSQL, to manage and store data
• Implement a medallion architecture for data organization and processing
• Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions
• Maintain and enhance existing data pipelines with a focus on performance and scalability
• Ensure data quality, integrity, and security across all managed systems

Preferred Qualifications

Experience working with Databricks for data processing

Benefits

• Competitive pay and benefits
• Flexible working models