Senior Data Engineer

Summary

Join Titan Wealth's Cape Town team as a Senior Data Engineer, designing, building, and maintaining scalable data solutions using Microsoft Azure and Fabric. Collaborate with cross-functional teams to translate business needs into technical solutions, ensuring data governance, security, and compliance. Lead the development of data pipelines, optimize the data warehouse, and implement ETL/ELT processes. Mentor data professionals and stay current with emerging technologies. Enjoy a flexible remote work environment with a focus on work-life balance and competitive benefits.

Requirements

• 3+ years of experience as a Senior Data Engineer, with expertise in ETL/ELT processes, and pipelines
• 2-3 years of experience designing and developing streaming data pipelines for ingestion or transformation using Azure Technologies
• Familiarity with Microsoft Azure and DevOps principles
• Experience working within Agile/Scrum teams, contributing to collaborative development processes
• Microsoft Certified: Fabric Analytics Engineer Associate, Fabric Data Engineer Associate or similar certifications
• Experienced with Microsoft Azure and DevOps
• Experienced with High Availability
• Experienced with Data Ingestion
• Experienced with Data Governance
• Experienced with Data Warehousing and Data Lakes
• Experienced with monitoring tools like DataDog
• Experience designing, building, and maintaining data warehouses and data lakes
• Experience designing, building, and maintaining ETL/ELT pipelines/processes
• Experience with programming languages such as Python, and SQL
• Experience with relational databases
• Experience with data visualization tools
• Experienced at working independently within a team and has the demonstrated knowledge and skills to deliver data outcomes without supervision

Responsibilities

• Collaborate with IT Infrastructure teams to ensure the data infrastructure is secure, stable, scalable, and architected for high availability, with built-in automation and disaster recovery capabilities
• Collaborate with stakeholders to translate business requirements into technical solutions
• Collaborate with Data Analysts, Software Engineers, and Cloud Engineers as part of a team to contribute to the data architecture detail designs and ensure that data solutions deliver business value
• Lead the design, development, and maintenance of scalable data pipelines using Microsoft Fabric
• Architect and optimise the data warehouse using Azure Data Services
• Implement and maintain ETL/ELT pipelines, ensuring that reasonable data quality checks are implemented in the data pipelines to maintain a high level of data accuracy, consistency and security
• Oversee data ingestion, transformation, and integration to support business intelligence and analytics
• Provide mentorship, training, and career development for data professionals
• Stay up to date with emerging technologies in data engineering, analytics, and Microsoft Fabric advancements
• Support incident management by troubleshooting issues, tracking root causes, providing timely resolutions, and generating performance and incident reports
• Develop and maintain documentation, including schemas, configurations, procedures, and troubleshooting guides, to support knowledge transfer and ensure consistency and reliability in data operations
• Conduct capacity planning and scalability assessments, forecasting resource requirements and growth trends, and recommending infrastructure upgrades or optimizations to accommodate future needs
• Proactively assess the current implementations, configurations, processes, platforms, technologies, budgets, strategies, and plans
• Adhere to change management processes, documenting and communicating changes, updates, and maintenance activities to stakeholders, and obtaining approvals as required

Preferred Qualifications

ITIL, DevOps, or Agile certifications are a plus

Benefits

• Flexible working environment with remote work as the focus, we use Workshop 17 at the V&A Waterfront in Cape Town as a co-working location when face-to-face would be beneficial to the team
• We believe in a healthy work/life balance, especially with the shift to a remote work focus. We encourage our team members to take time off, refocus, and reenergize and that a healthy separation from work can be maintained
• We have an open, trusting, empowering, friendly and importantly informal and relaxed environment. Your ideas and experience could contribute to shaping how we work, what we work on and help us continually drive innovation and improvement
• Competitive salary – we keep up with the latest market trends and strive to pay competitively
• Competitive holiday leave – 20+ days’ annual leave (earn an extra day for every year worked, up to 3 extra days)
• Performance-related discretionary annual bonus
• Retirement, Risk, and Medical-Aid contribution – we will contribute to a medical aid of your choosing
• Training budget allowance for further study or attending conferences, including paid days off to study