Software Engineer - Query Planner & Reflections

Summary

Join Dremio, a unified lakehouse platform company, and work on core features like Reflections, a key component of Dremio's query engine. You will design, implement, test, and support next-generation features related to Dremio’s Query Planner and Reflections technologies, collaborating with other developers and mentoring team members. The role involves working with open source projects, using modular design patterns, solving complex technical problems, and designing architectures for public clouds. You will collaborate with product management and support teams to ensure customer success. Dremio offers a hybrid work environment with Workplace Wednesdays in the office.

Requirements

• B.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience
• 2+ years of experience developing production-level software
• Fluency in Java, C++ or another modern language
• Strong foundation in data structures, algorithms, multi-threaded and asynchronous programming models, and their use in developing distributed and scalable systems
• Experience in developing complex and scalable distributed systems and delivering, deploying, and managing microservices
• Passion for learning, quality, zero downtime upgrades, availability, resiliency, uptime of the platform, and using latest technologies
• Interested and motivated to be part of a fast-moving startup with a fun and accomplished team

Responsibilities

• Own design, implementation, testing, and support of next-generation features related to Dremio’s Query Planner and Reflections technologies
• Work with open source projects like Apache Calcite and Apache Iceberg
• Use modular design patterns to deliver an architecture that’s elegant, simple, extensible and maintainable
• Solve complex technical problems and customer issues while improving our telemetry and instrumentation to proactively detect issues before they arise and make debugging more efficient
• Design and deliver architectures that run optimally on public clouds like GCP, AWS, and Azure
• Mentor other team members for high quality and design
• Collaborate with Product Management to innovate and deliver on customer requirements and with Support and field teams to ensure customer success

Preferred Qualifications

• Strong database fundamentals including SQL, performance, and schema design
• Understanding of distributed file systems such as S3, ADLS, or HDFS
• Experience with AWS, Azure, and Google Cloud Platform and background in large scale data processing systems (e.g., Hadoop, Spark, etc.)
• Experience with materialized views and incremental view maintenance
• Experience with distributed query engines
• Hands on experience in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, storage systems, heap management, Apache Arrow, SQL Operators, caching techniques, and disk spilling
• Hands on experience with multi-threaded and asynchronous programming models

Benefits

Workplace Wednesdays - to break down silos, build relationships and improve cross-team communication. Lunch catering / meal credits provided in the office and local socials align to Workplace Wednesdays. In general, Dremio will remain a hybrid work environment. We will not be implementing a 100% (5 days a week) return to office policy for all roles