Staff Data Engineer

Summary

Join NBCUniversal as a Staff Data Engineer and build the next generation of data pipelines and applications. You will leverage emerging technologies, including generative AI and large language models (LLMs), to design, build, and scale data pipelines. Collaborate with cross-functional teams, including data scientists and visualization experts. This role requires expertise in data integration frameworks, API design, and machine learning services. You will be instrumental in defining the team's strategy and integrating data patterns and technologies. The position offers a fully remote work arrangement and a competitive salary and benefits package.

Requirements

• 8+ years of experience in a data engineering role, with a strong emphasis on leading data engineering teams
• Ability to think critically about problems, decipher user preferences versus challenging requirements, and effectively use online and onsite resources to find appropriate solutions
• Proven ability to thrive in an agile development environment, adept at incorporating feedback and adjusting to changing priorities
• Understanding REST-based APIs, vectorized embeddings, and other Retrieval Augmented Generation AI workload components
• Direct experience with data modeling, ETL/ELT development principles, cloud development, and data warehousing concepts
• Knowledge of cloud technologies such as AWS, Azure, GCP
• Knowledge of data management fundamentals and data storage principles
• Experience in building data pipelines using Python/SQL or similar programming languages
• General understanding of cloud data engineering design patterns and use cases
• Bachelor's degree in computer science, Data Science, Statistics, Informatics, Information Systems or related field

Responsibilities

• Design, build, and scale data pipelines across a variety of source systems and streams (internal, third-party, and cloud-based), distributed/elastic environments, and downstream applications and self-service solutions
• Deep understanding of Machine Learning best practices (e.g., training/serving, feature engineering, feature/model selection, imbalance data, RAG patterns) and algorithms (e.g., deep learnings, optimization)
• Solid understanding of data modeling, warehousing, and architecture principles
• Implement appropriate design patterns while optimizing performance, cost, security, and scale and end-user experience
• Collaborate with cross-functional teams to understand data requirements and develop efficient data acquisition and integration strategies
• Interface with other technology teams to extract, load, and transform data from a wide variety of data sources using cloud-native data engineering principles
• Become a subject matter expert for data engineering-related technologies and designs
• Coach and guide others within the organization to build scalable pipelines based on foundational data engineering principles
• Participate in development sprints, demos, and retrospectives alongside releases and deployment
• Build and manage relationships with supporting engineering teams to deliver work products to production effectively
• Have worked well with data scientists, business analysts, and machine learning infrastructure to connect the dots between business and technology partners
• Develop automated tests for your code, ensuring every function, service, and object is compatible with your team's work and with the many systems within the NBCUniversal system portfolio and cross-device and browser compatibility
• Create documentation for developers and business users to help them understand our products
• Work collaboratively with a multidisciplinary team within a matrixed organization, leveraging strong interpersonal skills to navigate system complexities and deploy solutions efficiently
• Deploy to cloud-based platforms and troubleshoot application, cloud, and configuration issues when necessary
• Utilize tools for code & test generation to dramatically accelerate the delivery of features and components you create

Preferred Qualifications

• Familiarity with integrating large language models and AI-generated content technologies into applications
• Familiarity with the development ecosystem evolving around LLM integration, such as langchain
• Proven adaptability in a fast-paced, evolving technology landscape, with a strong problem-solving ability and quick learning curve
• Effective communication skills, capable of working collaboratively across diverse teams and navigating a large, matrixed organization efficiently
• Ability to translate business needs into clear technical requirements
• Analytical – You have experience in delivering self-service analytics solutions that promote data discovery
• Experience with Snowflake, Amazon Web Services, or related cloud platforms a plus
• Understanding of big data technology stacks (Hive / Spark etc) is a plus
• Experience moving on prem technologies to the cloud is a plus
• Action-oriented – You're constantly figuring out new problems and are regularly showing results with a positive attitude, always displaying ethical behavior, integrity, and building trust
• Strong understanding of Agile principles and best practices
• You’ve dealt with ambiguity and can make quality decisions in a dynamic, fast-paced environment

Benefits

• Fully Remote: This position has been designated as fully remote, meaning that the position is expected to contribute from a non-NBCUniversal worksite, most commonly an employee’s residence
• Company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other discounts and perks
• Salary range: $130,000 - $170,000 (bonus eligible)