Senior AI Platform Engineer

Summary

Join Instructure and become an AI Platform Engineer, building and maintaining core LLM-powered services and APIs for the next generation of online learning tools. You will architect and implement scalable services and infrastructure on AWS, enabling rapid development and deployment of LLM-powered features. Collaborate with feature teams, establish best practices for AI and LLM use, and create intuitive developer tooling and documentation. This role requires strong software engineering experience, API design expertise, and knowledge of LLM integration. Instructure offers a supportive environment with opportunities for professional development and growth.

Requirements

• Prior software engineering experience with API design and distributed system development
• Strong experience building backend services and REST or GraphQL APIs
• Knowledge of API design best practices around security, performance monitoring, rate limiting, and more
• Understanding of LLM integration and usage patterns
• Strong collaboration and written and verbal communication skills
• Past experience with cloud infrastructure, preferably on AWS
• Experience with Node.js or a desire to learn
• Experience with TypeScript or a desire to learn

Responsibilities

• Design and implement APIs and domain services that abstract the complexity of using an LLM and enable rapid feature development from our product teams
• Build scalable AWS infrastructure for LLM interactions, including prompt management, context handling, auditing, and response processing
• Create developer tooling and documentation that makes integration with your services intuitive and easy
• Establish best practices for AI and LLM use at Instructure, considering things like auditability, cost, and performance
• Collaborate with feature teams to understand their needs and solve them with platform capabilities
• Design, develop, and maintain scalable and performant APIs
• Write clean, maintainable, and well-documented code
• Participate in code reviews and provide constructive feedback to other developers

Preferred Qualifications

Background in developer tooling and API documentation

Benefits

• Thoughtful mentorship
• Hack weeks
• Internal conferences
• A culture where innovation and ownership thrive