Remote Senior Data Engineer

Summary

Join Experian as a Senior Data Engineer to help expand and enhance our data ecosystem, manage our Data Lake, and ensure efficient flow and quality of data.

Requirements

• Advanced degree preferably in a related quantitative field (Data Science, Computer Science, Math, Statistics, Engineering, Physics, or Economics)
• Minimum 8-10 years of work experience in data engineering and data design
• Minimum 8-10 years of work experience in Python programming
• Minimum 4+ years of experience
• Minimum 5 years of experience with AWS data ecosystem (Redshift, EMR, S3, MWAA)
• Minimum 5 years of experience working in an Agile environment
• Experience with Tableau or other data visualization tool
• 2+ years of experience with Apache Airflow DAGs or equivalent tools (AWS MWAA) for the orchestration of data pipelines
• Hands-on experience working and building with Python API-based data pipelines
• Excellent knowledge in the Shell scripting

Responsibilities

• Lead the integration of new and varied datasets into the data ecosystem, ensuring seamless data flow and accessibility
• Work with platform and infrastructure teams to design and implement data solutions that support our goals
• Perform data pinning and matching to ensure consistency and accuracy across heterogeneous datasets
• Conduct rigorous quality control checks to maintain high standards of data integrity and reliability
• Develop, maintain, automate and increase data pipelines and ETL processes to ensure efficient data processing and transformation
• Implement and enforce data governance best practices to ensure data security, compliance, and integrity
• Identify, troubleshoot, and resolve data-related issues promptly to minimize disruptions
• Be a liaison between business and technical teams to achieve project goals, delivering solutions
• Stay updated on industry trends and emerging technologies, seeking opportunities to improve data engineering practices and inspire creativity
• Prepare comprehensive documentation and reports on data processes, methodologies, and findings for internal and external stakeholders

Benefits

• Medical insurance
• Life and dental insurance
• Asociacion Solidarista
• International Share Save Plan
• Flex Work/Work from home
• Paid time off
• Annual Performance Bonus
• Education Reimbursement
• Family Bonding
• Bereavement Leave
• Referral Program