BENlabs is hiring a
Sr. Data Engineer

Summary

The job is for a Data Engineer at BENlabs, a global AI-powered marketing and content creation company. The role involves designing and implementing data pipelines, architecting and optimizing data solutions, and leading a team of data engineers. Requirements include 4+ years of experience in data engineering with AWS technologies, Databricks, and end-to-end data pipeline design.

Requirements

• 4+ years of experience in data engineering, with a strong focus on AWS technologies, Databricks and end-to-end data pipeline design
• Proven track record in designing and implementing scalable data architectures from the ground up
• Experience with Python, SQL, and data modeling
• Experience working with machine learning teams and deploying ML models
• Familiarity with orchestration systems such as EMR, Airflow or Dagster

Responsibilities

• Lead the design and implementation of robust data pipelines, starting from data ingestion to processing, storage, and consumption
• Architect and optimize data solutions using AWS technologies to support business needs
• Develop and maintain comprehensive data models (conceptual, logical, and physical) to support business applications and analytics
• Engage with internal stakeholders to understand their data requirements and use cases, translating them into scalable pipeline architectures
• Leverage AWS services such as S3, Redshift, RDS, Glue, and Lambda to design and manage large-scale data infrastructure
• Utilize orchestration systems like EMR, Airflow or Dagster to automate and manage complex data workflows
• Optimize cloud-based databases for performance, availability, and reliability
• Guide and mentor a team of data engineers, fostering a culture of continuous learning and improvement
• Lead by example in driving best practices in data engineering and software development

Preferred Qualifications

• Collaboration with ML Teams & Graph Databases: Experience collaborating with machine learning teams to support the deployment and maintenance of ML models within the data pipelines
• Experience with social media data and corresponding APIs