Remote AWS Data Architect

Summary

Mactores is seeking an experienced AWS Data Engineer to join their team. The role involves mapping business processes, defining data models, developing and managing data pipelines, collaborating with Business Analysts, and implementing data cleanliness pipelines among other responsibilities. Ideal candidates should have a Bachelor's degree in Computer Science or related field, 4+ years of experience as a Data Architect with a focus on data governance, proficiency in Spark and Airflow, familiarity with Looker for analytics, and knowledge of best practices in unit testing and CICD for data pipelines.

Requirements

• Bachelor's degree in Computer Science, Engineering, or related field
• 4+ years experience as a Data Architect with a focus on data governance
• Strong proficiency in mapping business processes and defining data models
• Expertise in developing and managing data pipelines, particularly in a DataBricks' DeltaLake format
• Experience with Spark and Airflow for orchestration
• Familiarity with Looker for analytics
• Knowledge of best practices in unit testing and CICD for data pipelines
• Excellent communication and collaboration skills

Responsibilities

• Map cross-functional business processes and identify data locations
• Define data models based on query/export interfaces and reporting requirements
• Develop data pipelines to consolidate, transform, and ensure data quality
• Collaborate with Business Analysts to address key business questions
• Review and evaluate the organization’s current and desired state of Data Governance
• Develop data products aligned with robust data governance principles
• Establish a medallion-style definition for data in the data lake, enabling easy identification of authoritative data sources for analytics
• Review, edit, and occasionally author new data pipelines
• Implement unit tests for newly developed pipelines
• Provide guidance on continuous integration and continuous deployment (CICD) processes related to data pipeline development
• Act as a consultant to the business for ad-hoc analytic queries executed via Looker
• Enable data-driven decision-making by providing expert guidance on data consumption and newly developed capabilities like data products
• Establish gold-standard data sources
• Implement data cleanliness pipelines and processes
• Formalize model review and ownership processes
• Publish access and interfaces to gold data through formal data products

Preferred Qualifications

• AWS Data Analytics Specialty Certification
• Experience with Agile development methodology