Senior Data Engineer

Summary

Join a pioneering financial services company redefining homeownership through innovative, data-driven solutions. As a Senior Data Engineer, you will design and build scalable data pipelines, transform complex datasets, and ensure reliable data infrastructure. You will collaborate with data scientists and analysts, providing critical insights for strategic decisions. This role offers the chance to contribute to cutting-edge projects and shape the future of data architecture. The position requires extensive experience in Python development, data engineering, and cloud technologies. Success in this role demands strong collaboration and communication skills.

Requirements

• 5+ years of Python development experience
• Desirable experience with AWS, including services like DynamoDB, S3, EMR, Glue, Athena, and Redshift
• Knowledge of distributed computing engines, such as Apache Spark
• Proficiency in both relational and non-relational databases, along with data modeling expertise
• Experience setting up code pipelines using CloudFormation or Terraform
• Familiarity with ETL pipeline development in OLAP and Data Warehouse environments
• Hands-on experience with orchestration tools like Airflow
• Understanding of serverless architectures and scalable application design principles
• Proficiency with version control systems, particularly Git

Responsibilities

• Design and implement scalable data pipelines in a horizontally scaled environment
• Collaborate with cross-functional teams to understand business needs and define transactional scenarios across multiple microservices
• Write high-quality, maintainable code that meets established standards and best practices
• Build strong relationships with clients by understanding their business model and delivering solutions that align with their goals
• Influence and communicate effectively at all levels, including management and engineering teams
• Utilize distributed computing systems to transform and manage large datasets efficiently
• Work with cloud-based technologies such as AWS to support the company’s data infrastructure
• Contribute to continuous integration/continuous delivery (CI/CD) pipelines and DevOps practices
• Collaborate with data scientists to ensure the availability and accessibility of critical insights for decision-making

Preferred Qualifications

• Experience with Node.js , DevOps, and CI/CD practices is a plus
• Background in cloud technologies (AWS/ Azure / GCP) and fintech or banking is desirable