Data Architect

Summary

Join Encora as a seasoned Data Architect to lead a long-term data modernization project. You will design data models and database architecture, oversee data migration strategies, and ensure data integrity and quality. This role requires collaboration with Solution Architects and Data Engineers to implement efficient data solutions using open-source and cloud-native technologies. You will migrate data from legacy systems to an integrated data environment, focusing on PostgreSQL, Snowflake, and AWS. This is a work-from-home opportunity requiring 15+ years of experience. The ideal candidate will have a strong background in data architecture and experience managing complex data migration and transformation projects.

Requirements

• 10+ years of experience in data architecture and database management, particularly with PostgreSQL (AWS Arora or Citus), Snowflake, and SQL Server
• Strong understanding of data warehousing concepts and techniques
• Strong expertise in cloud-based architectures (preferably AWS) and experience with data migration to cloud-native solutions
• Hands-on experience with ETL tools and orchestration technologies such as AWS Glue, Apache Airflow, and dbt
• Proven experience implementing data governance and security measures within a complex data ecosystem
• Experience with data migration and transformation projects

Responsibilities

• Partner with Solution Architect to design and implement data models and database architecture
• Lead the design and development of robust, scalable, and performant data models that support the client's business requirements, ensuring data integrity, quality, and accessibility across the entire project
• Develop and oversee the execution of comprehensive data migration strategies, ensuring a smooth transition from legacy systems to the new data platform, working closely with data engineers to implement the migration plan and address any challenges
• Develop and oversee data engineers as they implement change data capture (CDC) and data transformation workflows using tools such as Apache Airflow and AWS Glue
• Develop and oversee the ETL processes, ensuring smooth data migration from SQL Server to PostgreSQL and Snowflake with minimal downtime
• Implement data quality checks and validation procedures to ensure the accuracy, completeness, and consistency of data throughout the data lifecycle
• Collaborate with the Data Governance Lead to establish and enforce data quality standards
• Collaborate with the client on role-based access controls and audit trails to ensure data privacy and regulatory adherence
• Work closely with the Solution Architect to ensure alignment between the overall data platform architecture and the specific data models and database implementations
• Collaborate effectively with Data Engineers to ensure efficient implementation of data solutions and participate in technical discussions and decision-making processes
• Facilitate knowledge transfer and provide technical guidance to client’s in-house data engineering team
• Conduct performance tuning for PostgreSQL (e.g. AWS Aurora) and Snowflake to enhance scalability, efficiency, and cost-effectiveness
• Assist in decommissioning legacy SQL Server systems while ensuring data integrity and continuity

Preferred Qualifications

• Familiarity with Citus and AWS Aurora for horizontal scaling of PostgreSQL or equivalent distributed database systems
• Experience with CDC technologies and real-time data streaming, such as Amazon Kinesis
• Strong understanding of data governance tools like DataHub and data validation frameworks like Great Expectations

Benefits

Work from home