Senior Data Engineer

Summary

Join Truelogic, a leading provider of nearshore staff augmentation services, as a Senior Data Engineer. You will spearhead the Lead Data Engineering team, building and maintaining data pipelines using AWS serverless technology to support sales and marketing efforts. This pivotal role involves designing, developing, and maintaining robust data pipelines, collaborating with various teams, and ensuring data quality and reliability. You will leverage your expertise in AWS Glue, Appflow, Python, and data transformation to optimize lead data operations and build a scalable infrastructure. The position requires proficiency in Python, experience with Tealium, and expertise in AWS Glue and Appflow.

Requirements

• Proficiency in Python programming
• Experience with Tealium
• Expertise in AWS Glue and Appflow
• Solid understanding of data transformation and ETL processes, especially as they relate to lead data
• Demonstrated experience in building and managing data pipelines that support sales and marketing functions
• Experience in working with Snowflake and relational Database

Responsibilities

• Architect and Implement: Design, develop, and maintain robust data pipelines, leveraging AWS Glue, Appflow, and other relevant services, with a focus on capturing, processing, and enriching sales and marketing lead data
• Collaborate: Partner with sales, marketing, data engineers, and data scientists to understand lead data requirements and translate them into effective pipeline designs
• Transform Data: Develop and execute data transformation logic using Python, ensuring lead data integrity, quality, and readiness for use by sales and marketing teams
• Ensure Reliability: Rigorously test and validate data pipelines to guarantee accuracy, reliability, and performance, minimizing disruptions to lead flow
• Monitor and Optimize: Proactively monitor data pipelines, identify bottlenecks, and implement optimizations to maintain seamless lead data operations
• Build for Scale: Collaborate with fellow engineers to architect and maintain a scalable, resilient data infrastructure capable of handling growing lead volumes
• Stay Ahead: Keep abreast of emerging trends and technologies in data engineering, with a particular focus on advancements related to sales and marketing lead management