Lead Data Engineer

Summary

Join Tide, a rapidly growing finance platform for small businesses, as a Data Engineer. You will be responsible for building and maintaining data pipelines and services supporting business functions. This role involves developing ETL/ELT pipelines, designing scalable data processes, mentoring junior engineers, and troubleshooting technical issues. You will work with data analysts to optimize data feeds and ensure data quality. Tide offers a competitive salary and benefits package, including flexible working arrangements, health insurance, and professional development opportunities.

Requirements

• Have 4+ years of extensive development experience using Snowflake or similar data warehouse technology
• Have working experience with dbt and other technologies of the modern data stack, such as Snowflake, Apache Airflow, Fivetran, AWS, git, Looker
• Have experience in agile processes, such as SCRUM
• Have extensive experience in writing advanced SQL statements and performance tuning them
• Have experience in Data Ingestion techniques using custom or SAAS tools like Fivetran
• Have experience in data modeling and can optimize existing/new data models
• Have experience in data mining, data warehouse solutions, and ETL, and using databases in a business environment with large-scale, complex datasets
• Have experience working in an agile cross-functional delivery team
• Have high development standards, especially for code quality, code reviews, unit testing, continuous integration, and deployment
• Have strong technical documentation skills and the ability to be clear and precise with business users
• Have business-level English and good communication skills

Responsibilities

• Develop end-to-end ETL/ELT pipelines working with Data Analysts of business functions
• Design, develop, and implement scalable, automated processes for data extraction, processing, and analysis in a Data Mesh architecture
• Mentor other Junior Engineers in the Team
• Be a “go-to” expert for data technologies and solutions
• Provide on-the-ground troubleshooting and diagnosis to architecture and design challenges
• Troubleshoot and resolve technical issues as they arise
• Look for ways of improving both what and how data pipelines are delivered by the department
• Translate business requirements into technical requirements, such as entities that need to be modeled, DBT models that need to be built, timings, tests, and reports
• Own the delivery of data models and reports end-to-end
• Perform exploratory data analysis to identify data quality issues early in the process and implement tests to prevent them in the future
• Work with Data Analysts to ensure that all data feeds are optimized and available at the required times. This can include Change Capture, Change Data Control, and other “delta loading” approaches
• Discover, transform, test, deploy, and document data sources
• Apply, help define, and champion data warehouse governance: data quality, testing, coding best practices, and peer review
• Build Looker Dashboards for use cases if required

Preferred Qualifications

• Have experience architecting analytical databases (in Data Mesh architecture)
• Have a basic understanding of various systems across the AWS platform
• Have worked in a digitally native company, ideally fintech
• Have experience with Python, governance tools (e.g., Atlan, Alation, Collibra), or data quality tools (e.g., Great Expectations, Monte Carlo, Soda)

Benefits

• Competitive salary
• Self & Family Health Insurance
• Term & Life Insurance
• OPD Benefits
• Mental wellbeing through Plumm
• Learning & Development Budget
• WFH Setup allowance
• 15 days of Privilege leaves
• 12 days of Casual leaves
• 12 days of Sick leaves
• 3 paid days off for volunteering or L&D activities
• Stock Options
• Flexible working arrangements
• Working Out of Office (WOO) policy allowing colleagues to work remotely from home or anywhere in their assigned Indian state, with the option to work from a different country or Indian state for 90 days of the year