Senior Data Engineer

Summary

Join Owkin's Engineering team as a Data Engineer to design, build, and optimize scalable ETL/ELT pipelines using Airflow. You will work with complex datasets, ensuring reliability and performance while collaborating with cross-functional teams. This role requires expertise in data architecture, Python, SQL, and cloud platforms like AWS and Kubernetes. The position is based in Paris or Nantes, or remotely in France. Owkin offers a flexible work organization and a friendly working environment. A Master's degree in computer science and 5+ years of experience as a Data Engineer are required.

Requirements

• Master degree in computer sciences or specialization in Data
• Significant experience (minimum 5 years) as a Data Engineer and have good knowledge of DataOps practices
• Experience in Python and SQL and you have familiarity with R
• Experience in architectural design of complex data platforms
• Proficient in the technologies like Airflow, AWS steps functions, PostgreSQL, Docker, Kubernetes, Grafana, Infrastructure as Code
• Autonomous, meticulous, and enjoy teamwork
• Software development with a focus on code quality, simplicity, maintainability
• Experience in designing data architecture and building data products , pandas
• Experience handling sensitive personal information
• Fluent in English

Responsibilities

• Design and optimize data pipelines using Airflow
• Develop robust solutions in Python and SQL
• Design, develop, and operate scalable ETL/ELT pipelines to process and transform datasets
• Work with cross-functional teams, including data scientists, business developers, software engineers and bio medical researchers to deliver high-quality data solutions
• Manage and monitor containerized data infrastructures with Docker and Kubernetes and other cloud platforms
• Implement and enforce best practices for data governance, security, and compliance
• Build, optimize and maintain data architectures, including data lakes, data warehouses, and analytical Insights
• Productionize the data processing pipelines, setting and enforcing standards and best practices across scientific teams to deliver high quality data in an efficient and scalable way

Preferred Qualifications

• Knowledge in healthcare or biology areas
• Data quality tools: Great expectation, pydantic, pandera, SQLMesh etc
• Knowledge of other programming languages like Go, Java, Rust
• Debugging & Refactoring skills

Benefits

• Flexible work organization
• Friendly and informal working environment
• Opportunity to work with an international team with high technical and scientific backgrounds