Senior Data Engineer

Summary

Join NBCUniversal's Data & Analytics team as a Senior Data Engineer and build data pipelines to process internal and external datasets. You will create applications that provide data insights for strategic decision-making. The role demands agility and comfort with ambiguity, focusing on backend engineering while adhering to cybersecurity compliance. Collaborate with business partners to understand their needs and develop analytical tools. Leverage prototyping to design creative solutions using AWS technologies, including data lake, Python, Spark, Scala, and more. Educate business partners on best practices and assist in analyzing business requirements, data modeling, and metadata for reporting. Maintain clear documentation and architecture diagrams.

Requirements

• Bachelor’s degree in Engineering, Computer Science, Information Systems or related field with 5+ years of relevant experience
• 1+ Experience in Data Modeling, Data architecture, Data Quality, Metadata, ETL and Data Warehouse methodologies and technologies
• Demonstrated experience as an engineering lead in implementing scalable, distributed, and highly available systems using cloud technologies, specifically Amazon Web Services
• Experience in any combination of the following: SQL, AWS EMR/Lambda, Iceberg, Linux, Python, Web technologies, APIs, Spark, Scala
• 2+ years’ experience with AWS tech stack
• Basic understanding of relational data modeling and be able to clearly articulate the reasons to use non-relational systems in our architecture

Responsibilities

• Build data pipelines to land, profile, and store multiple internal & external datasets
• Build applications that surface this data to support our business partners’ strategic decision making for analytics solution in media industry
• Be a Contributor to the overall Data Product roadmap by working closely with our business partners to understand their challenges and develop analytical tools to help drive business decisions
• Leverage prototyping methodologies to propose and design creative business solutions that exploit our broad toolset of technologies (AWS tech stack, data lake, Python, Spark, Scala, Iceberg, EMR Serverless, SNS, SQS, AWS Lambda, Step Functions, Event Triggers etc.)
• Educate and inform business partners on architecture, capabilities, best practices, and solutions to build out future enhancements
• Assist in analyzing business requirements, source systems, understand underlying data sources, transformation requirements, data mapping, data model and metadata for reporting solutions
• Write easily understood documentation and architecture diagrams and keeping them up to date as code and frameworks change over time

Preferred Qualifications

• Experience in Media industry with various linear & digital platforms such as Operative One, Google Ad Manager, Freewheel, WO Traffic etc
• Experience in Snowflake is desired but relevant experience in any of the following is acceptable: Redshift, SingleStore, Athena, MSSQL Server, Oracle
• Decent understanding for the media ad sales business and ad serving technologies with experience working with ad serving transactional data logs
• Experience in any BI tool is desired with a preference for MicroStrategy but is not required
• Candidate will have strong analytical focus, results-oriented and execution driven with strong problem-solving skills
• Ability and desire to work within a cross-functional team environment with people from multiple business units, vendors, countries, and cultures
• Self-driven/self-initiator and resourceful to achieve goals independently as well as in teams. Promotes an open flow of information so that all stakeholders are well informed
• Committed and solution focused with the ability to perform under pressure and meeting deadlines
• Experience using serverless technologies is highly desirable
• Experience with Python and Pandas in an AWS Lambda framework is a nice to have

Benefits

• This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other discounts and perks
• Fully Remote: This position has been designated as fully remote, meaning that the position is expected to contribute from a non-NBCUniversal worksite, most commonly an employee’s residence