Senior Data Engineer
MentorMate
Job highlights
Summary
Join MentorMate Paraguay, the Latin American headquarters of a global digital transformation consultancy, as a Senior Data Engineer. You will leverage your expertise in Spark and AWS to build and maintain scalable data pipelines, working with diverse data sources and collaborating with cross-functional teams. This role requires significant experience in data engineering, specifically with Apache Spark and AWS services. You will play a crucial role in ingesting, processing, and storing data to support data-driven decision-making. MentorMate offers competitive pay and benefits, and flexible working models. The company is part of Tietoevry Create, a global technology company with over 10,000 experts.
Requirements
- 7+ years of experience in Data Engineering
- Proven experience as a Senior Data Engineer with a strong focus on Apache Spark
- Experience with AWS services such as S3, Redshift, and Aurora PostgreSQL
- Strong knowledge of ingesting and processing data from diverse sources
- Good understanding and practical experience with medallion architecture
- Experience with modern SDLC, CI/CD and SCM
- Excellent problem-solving skills and ability to work independently or as part of a team
- Strong communication skills to collaborate effectively with technical and non-technical stakeholders
Responsibilities
- Develop and maintain scalable data pipelines using Apache Spark
- Work within Databricks notebooks to run data processing tasks
- Ingest data from various sources including enterprise software such Salesforce and NetSuite, as well as internal software systems
- Utilize AWS tools, including S3, Redshift, and Aurora PostgreSQL, to manage and store data
- Implement a medallion architecture for data organization and processing
- Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions
- Maintain and enhance existing data pipelines with a focus on performance and scalability
- Ensure data quality, integrity, and security across all managed systems
Preferred Qualifications
Experience working with Databricks for data processing
Benefits
- Competitive pay and benefits
- Flexible working models
Share this job:
Similar Remote Jobs
- πUnited States
- π°$52kπSlovak Republic
- πCzechia
- πUnited States
- πUnited States
- πUnited States
- π°$170kπUnited States
- πIndia
- π°$225k-$255kπUnited States
- πMexico