Senior AI Inference Engineer

Summary

Join Tether and be part of a global team building the next generation of AI models. This role focuses on deploying machine learning models to edge devices using various frameworks. You will collaborate with researchers, integrate AI features into existing products, and contribute to innovation in AI through an accessible and transparent approach. The company is committed to making advanced AI technologies more accessible and offers a fully remote work environment. Tether has experienced rapid growth and is a leader in the industry. This position requires excellent programming skills, experience with specific AI frameworks and platforms, and a degree in a related field.

Requirements

• Excellent programming skills in Python, and a solid understanding of C/C++
• Experience with platforms such as Llama.cpp, ONNX, TVM, MLC LLM, and IREE (MLIR), which facilitate the deployment of models to specific GPU architectures
• Experience in NLP, transformers, fine-tuning, computer vision, TensorFlow, PyTorch, JAX and CUDA toolkit
• Demonstrated ability to rapidly assimilate new technologies and techniques
• A degree in Computer Science, AI, Machine Learning, or a related field, complemented by a solid track record in AI R&D

Responsibilities

• Work on deploying machine learning models to edge devices using frameworks such as Llama.cpp, ONNX, TVM, MLC LLM, and IREE (MLIR)
• Collaborate closely with researchers to assist in coding, training and transitioning models from research to production environments
• Integrate AI features into existing products, enriching them with the latest advancements in machine learning

Preferred Qualifications

Experience working with LLMs, fine tuning, RAG, transformers is a plus