Remote Senior Software Engineer, Query Engine

Logo of Dremio

Dremio

πŸ“Remote - Portugal

Job highlights

Summary

Join Dremio as a Senior Software Engineer and contribute to building the future of unified lakehouse platforms for self-service analytics and AI. As part of the Datalake team, you will focus on enhancing our query engine with a particular emphasis on the Iceberg table format and efficient scans of various file formats.

Requirements

  • B.S., M.S. or PhD in Computer Science or in a related technical field
  • 5+ years of software engineering experience, with a focus on database systems, query execution or related fields
  • Strong programming skills in an object oriented language such as Java or C++
  • Understanding of database internals, query planning, distributed systems, concurrency control, data replication, and storage systems
  • Familiarity with cloud object stores, such as AWS S3, ADLS or GCS
  • Experience with Apache Iceberg, Parquet, AVRO and/or Delta

Responsibilities

  • Designing and implementing features for Dremio’s query engine with a focus on the Iceberg table format
  • Optimizing file scan operations for various file formats, including Parquet, Avro and others
  • Collaborating with members of the query planning and query execution teams to ensure seamless integration of features across the code stack
  • Working with and contributing to open-source projects like Apache Iceberg, Parquet and Arrow
  • Maintaining and enhancing compliance with the Iceberg table format specification
  • Conducting performance tuning and benchmarking to enhance query execution speed
  • Understanding and reasoning about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment
  • Participating in code reviews and providing constructive feedback to peers

Share this job:

Disclaimer: Please check that the job is real before you apply. Applying might take you to another website that we don't own. Please be aware that any actions taken during the application process are solely your responsibility, and we bear no responsibility for any outcomes.
Please let Dremio know you found this job on JobsCollider. Thanks! πŸ™