Senior Software Engineer

Summary

Join Elastic's Extract and Transformation team as a Search Senior Engineer and contribute to the development of large-scale applications using multi-modal data with LLMs. You will architect, optimize, and maintain data pipelines, collaborate with international teammates in a remote-first environment, and work with data scientists and product teams. The ideal candidate possesses experience building software using Ruby and/or Python, ETL pipelines, and operational components of modern web applications. Excellent communication and practical judgment are essential. Elastic offers competitive pay, health coverage, flexible schedules, generous vacation time, donation matching, volunteer time off, and parental leave.

Requirements

• Experience building software using Ruby and/or Python
• Previous experience building and maintaining ETL pipelines and processes
• Previous experience with operational components of modern web applications including asynchronous job queues, daemonized services, and CI/CD pipelines
• Previous experience with open source
• Excellent practical judgment. You know how to prioritize, when to collaborate and ask for help, and when to be independent
• Measured and articulated written and spoken communication skills. You work well with others and can craft concise and expressive thoughts into correspondence: issues, investigations, documentation, and onboarding material
• An interest in learning new tools, languages, workflows, and philosophies that can help you grow. You can function well in an environment that drives towards change
• Experience with multi-modal data, including formats like PDF, HTML, Word docs. Also, general knowledge of tooling and transformer architecture around LLMs

Responsibilities

• Contribute to the development of large-scale applications using multi modal data with LLMs
• Architect, optimize, and maintain pipelines for processing and analyzing various data, including PDF, HTML, and image formats
• Collaborate with and mentor international teammates in a mostly text-based, asynchronous, remote-first team environment with occasional video calls and yearly conferences
• Be hands-on with the team and codebase, reviewing work and providing constructive feedback
• Collaborate with the team on features, breaking them down into technical deliverables
• Act as an important and communicative part of an engaged and spirited team, working with data scientists and product teams to integrate AI-driven solutions

Benefits

• Competitive pay based on the work you do here and not your previous salary
• Health coverage for you and your family in many locations
• Ability to craft your calendar with flexible locations and schedules for many roles
• Generous number of vacation days each year
• Increase your impact - We match up to $2000 (or local currency equivalent) for financial donations and service
• Up to 40 hours each year to use toward volunteer projects you love
• Embracing parenthood with minimum of 16 weeks of parental leave