Data Engineer

Summary

Join MentorMate Paraguay, the Latin American headquarters of a global digital transformation consultancy, as a skilled Data Engineer. You will leverage your expertise in Spark and AWS to build and maintain scalable data pipelines, working with diverse data sources and utilizing AWS tools like S3, Redshift, and Aurora PostgreSQL. This role demands experience in data ingestion, processing, and storage, implementing a medallion architecture, and collaborating with cross-functional teams. MentorMate offers competitive pay and benefits, flexible working models, and advancement opportunities within a global technology company.

Requirements

• 3+ years of experience in Data Engineering
• Proven experience as a Data Engineer with a strong focus on Apache Spark
• Experience with AWS services such as S3, Redshift, and Aurora PostgreSQL
• Strong knowledge of ingesting and processing data from diverse sources
• Good understanding and practical experience with medallion architecture
• Experience with modern SDLC, CI/CD and SCM
• Excellent problem-solving skills and ability to work independently or as part of a team
• Strong communication skills to collaborate effectively with technical and non-technical stakeholders

Responsibilities

• Develop and maintain scalable data pipelines using Apache Spark
• Work within Databricks notebooks to run data processing tasks
• Ingest data from various sources including enterprise software such Salesforce and NetSuite, as well as internal software systems
• Utilize AWS tools, including S3, Redshift, and Aurora PostgreSQL, to manage and store data
• Implement a medallion architecture for data organization and processing
• Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions
• Maintain and enhance existing data pipelines with a focus on performance and scalability
• Ensure data quality, integrity, and security across all managed systems

Preferred Qualifications

Experience working with Databricks for data processing

Benefits

• Competitive pay and benefits
• Flexible working models
• Advancement opportunities