Senior AI Platform Engineer

Summary

Join Instructure and become an AI Platform Engineer, building and maintaining core LLM-powered services and APIs for the next generation of online learning tools. You will architect and implement scalable services and infrastructure to support rapid development and deployment of LLM-powered features. Collaborate with feature teams to understand their needs and design intuitive APIs. Establish best practices for AI and LLM use, ensuring high standards for performance, security, and reliability. This role offers the opportunity to make a significant impact on the lives of millions of learners while working in a supportive and innovative environment.

Requirements

• Prior software engineering experience with API design and distributed system development
• Strong experience building backend services and REST or GraphQL APIs
• Knowledge of API design best practices around security, performance monitoring, rate limiting, and more
• Understanding of LLM integration and usage patterns
• Strong collaboration and written and verbal communication skills
• Past experience with cloud infrastructure, preferably on AWS
• Experience with Node.js or a desire to learn
• Experience with TypeScript or a desire to learn

Responsibilities

• Design and implement APIs and domain services that abstract the complexity of using an LLM and enable rapid feature development from our product teams
• Build scalable AWS infrastructure for LLM interactions, including prompt management, context handling, auditing, and response processing
• Create developer tooling and documentation that makes integration with your services intuitive and easy
• Establish best practices for AI and LLM use at Instructure, considering things like auditability, cost, and performance
• Collaborate with feature teams to understand their needs and solve them with platform capabilities
• Design, develop, and maintain scalable and performant APIs
• Write clean, maintainable, and well-documented code
• Participate in code reviews and provide constructive feedback to other developers

Preferred Qualifications

Background in developer tooling and API documentation

Benefits

• Competitive salary, equity and 401k
• Medical, dental, disability, and life insurance
• HSA program, vision, voluntary life, and AD&D
• Tuition reimbursement
• Paid time off, 11 paid holidays, and flexible work schedules
• LifeStyle Spending Account