Senior Staff Software Engineer

Summary

Join ServiceNow as a Generative AI Architect to drive the architecture and implementation of GenAI-driven features across our products. Design and build scalable and reusable platform services leveraging LLMs for enhanced user experiences. Collaborate with product, research, and platform teams to translate business goals into GenAI solutions. Define best practices for prompt engineering, fine-tuning, and evaluating LLM performance. Serve as a thought leader in Generative AI adoption, guiding teams through design patterns and ethical considerations. This role requires extensive experience with GenAI technologies, LLMs, and object-oriented programming languages like Java. A strong understanding of prompt engineering and modern UI frameworks is also essential.

Requirements

• Hands-on experience with GenAI technologies, including working with LLMs (e.g., OpenAI, Anthropic, Gemini, Mistral, etc.)
• Strong understanding of prompt engineering techniques and experience in prompt tuning, retrieval-augmented generation (RAG), or fine-tuning LLMs for domain-specific applications
• Ability to critically evaluate and integrate GenAI into workflows, decision-making, and customer-facing capabilities
• 10+ years of experience with Java or a similar object-oriented programming language
• Passion for JavaScript and the Web as a platform, with a strong belief in reusability and componentization
• Proficiency in data structures, algorithms, object-oriented design, design patterns, and performance/scale considerations
• Experience with modern UI frameworks such as React, or Vue
• Strong experience working with relational databases, including schema design, performance tuning, and optimization
• Exposure to diverse tech stacks: Cloud Development, Web/Platform Engineering, Frameworks, or Service-Oriented Architectures
• Ability to manage large-scale, complex projects and serve as a technical owner or functional lead across multiple teams

Responsibilities

• Drive the architecture and implementation of GenAI-driven features across our products
• Design and build scalable and reusable platform services that leverage LLMs to power user experiences
• Collaborate cross-functionally with product, research, and platform teams to translate business goals into GenAI solutions
• Define best practices for prompt engineering, fine-tuning, and evaluating LLM performance across different use cases
• Serve as a thought leader in Generative AI adoption, guiding teams through design patterns, performance trade-offs, and ethical AI considerations

Benefits

• Health plans, including flexible spending accounts
• A 401(k) Plan with company match
• ESPP
• Matching donations
• A flexible time away plan
• Family leave programs