Data Engineer

Summary

Join Keypath's new APAC IT division as a Data Engineer and be part of a dynamic team building a data infrastructure from the ground up. Collaborate with the APAC Data Engineering team to design and maintain essential data infrastructure and pipelines. Act as a technical expert in system integration, data warehouse modeling, and creating semantic layers for actionable insights. Optimize data pipelines and models for efficiency and reliability, driving growth across the Asia & Pacific region. This role offers the opportunity to influence key decisions and develop your career within a global company committed to technological excellence. Key responsibilities include managing the data engineering lifecycle, analyzing business domains, and designing effective data pipelines and models.

Requirements

• Minimum BS/BA Degree, preferably in a Technology, Computer Science, Mathematics or Statistics related discipline
• 4+ years of data engineering experience with a proven history of successfully developing and deploying data-warehouse and data integration solutions using Microsoft Azure technologies
• 3+ years of experience with PowerBI and proficiency with semantic modelling and data packaging concepts (Cubes, Tabular Models)
• 2+ years of experience with Agile and scrum engineering practices and principles
• Expert in Microsoft SQL Server database and Azure data engineering (Azure Data Factory, Azure Functions, Azure Data Lake, Logic Apps) with strong ETL/ELT and SQL/T-SQL scripting skills
• Proven expertise in Business Intelligence and reporting tools (Microsoft PowerBI, DAX, Power Query, Azure Analysis Services) and related tools (Power Automate, Visual Studio, Tabular Editor, ALM Toolkit)
• Hands-on experience with Azure Machine Learning and Python programming skills for building ML Workflows
• Strong understanding of the CI/CD process using Azure DevOps (Pipelines, Board, GitHub)

Responsibilities

• Design and implement scalable and efficient data integration pipelines using Azure Data factory which ingests structured and semi-structured data from diverse sources like APIs, databases, file-shares, data streams
• Develop resilient system integration solutions leveraging Azure Functions, Python, .Net codebases and related development frameworks
• Design and develop comprehensive data warehouse models using Kimball dimensional modelling techniques that are scalable and efficient
• Develop and manage Azure Analysis Services semantic-layer tabular models to support business intelligence initiatives and self-service capabilities
• Maintain data dictionaries and metadata repositories to document data models and their elements, ensuring compliance with cross-region and customer data policies
• Create comprehensive Power BI solutions including advanced data models, interactive reports, data visualisation and dashboards through expert use of Power Query, DAX, and Power BI Service
• Implement robust Power BI security, including Row-Level Security (RLS), to meet diverse cross-functional team and regional access needs
• Manage the PowerBI instance including workspace, datasets, monitoring and troubleshooting and user access issues
• Develop scientific modeling solutions using Machine Learning and Artificial Intelligence technologies to generate actionable insights
• Implement predictive and prescriptive analytics solutions using advanced analytics methodologies to optimize decision-making and improve business outcomes
• Deliver complex data engineering solutions using Agile methodologies and iterative development processes
• Ensure quality of data engineering solutions by aligning with team’s architecture, development, productivity standards and processes
• Collaborate closely with the Product team and subject matter experts to understand and translate data engineering and integration requirements into technical solutions
• Ensure alignment of data engineering solutions with broader organizational strategic objectives and key performance indicators
• Design and maintain robust Continuous Integration and Continuous Deployment (CI/CD) pipelines for seamless system integrations
• Develop and maintain automation frameworks that enhance deployment efficiency and reduce manual intervention
• Conduct thorough code reviews and manage pull request approvals in Azure DevOps to ensure code quality and knowledge sharing
• Proactively monitor data product health, security, data governance adherence, and regulatory compliance, ensuring operational stability and risk reduction
• Manage and resolve data related incidents through thorough root cause analysis and timely implementation of effective remediation activities
• Optimise the performance of data pipelines, queries, and overall data products for enhanced speed, efficiency, scalability and cost reduction
• Review and implement continuous improvement activities to boost data product efficiency and quality

Preferred Qualifications

• Think logically and be able to articulate thoughts in a clear, concise manner
• Comfortably work both individually and as part of APAC team with team members located in Australia and Asia
• Take ownership of assignments and see them through to completion
• Quickly learn and adapt when dealing with unfamiliar systems and applications
• Be able to communicate clearly and effectively with business partners and co-workers
• Meet deadlines and complete work in a timely manner
• Display exceptional follow-through, personal drive, and the desire to make a difference
• Contribute to and participate in an open environment with a team that likes to have fun at work

Benefits

• Opportunity to work in office, hybrid or remotely
• All the necessary equipment for success including laptop
• Access to health & wellbeing programs including an Employee Assistance Program and Mental Health Days
• Learning & growth opportunities including access to LinkedIn Learning, Career Development Programs and Learning Labs
• Employee led Initiatives such as Culture Club, Team Green, Sustainability and more
• Company events and activities run in office and remotely