Senior AI Inference Engineer

Summary

Join Tether and be part of a global team building the next generation of AI models. This role focuses on deploying machine learning models to edge devices using various frameworks. You will collaborate with researchers, integrate AI features into existing products, and contribute to innovation in AI through an accessible and transparent approach. The company offers a fully remote work environment and has a history of rapid growth and efficient operations. Tether is committed to making advanced AI technologies more accessible and is seeking individuals with strong programming skills and experience in AI and machine learning.

Requirements

• Excellent programming skills in Python, and a solid understanding of C/C++
• Experience with platforms such as Llama.cpp, ONNX, TVM, MLC LLM, and IREE (MLIR), which facilitate the deployment of models to specific GPU architectures
• Experience in NLP, transformers, fine-tuning, computer vision, TensorFlow, PyTorch, JAX and CUDA toolkit
• Demonstrated ability to rapidly assimilate new technologies and techniques
• A degree in Computer Science, AI, Machine Learning, or a related field, complemented by a solid track record in AI R&D

Responsibilities

• Work on deploying machine learning models to edge devices using frameworks such as Llama.cpp, ONNX, TVM, MLC LLM, and IREE (MLIR)
• Collaborate closely with researchers to assist in coding, training and transitioning models from research to production environments
• Integrate AI features into existing products, enriching them with the latest advancements in machine learning

Preferred Qualifications

Experience working with LLMs, fine tuning, RAG, transformers is a plus