Senior LLM Engineer

Senior LLM Engineer

I'm currently working with an exciting, forward-thinking company that's looking to bring on aSenior Large Language Model (LLM) Engineerto join their fully remote international team. They're focused on cutting-edge AI technologies, especially in deploying highly realistic AI characters and models at scale.

If you're passionate about training and fine-tuning open-source LLMs and working with the latest AI models, this could be a perfect opportunity for you.

The Role:

• You'll be responsible for training open-source LLMs (like Llama and Mistral) and fine-tuning them for immersive, high-quality chat experiences.
• Build, curate, and manage datasets, including leveraging models like GPT-4 to improve smaller LLMs.
• Help deploy these models at scale using tools like Hugging Face's Text Generation Inference (TGI).
• Collaborate with a remote team using asynchronous communication (Slack, video meetings).

Tech Stack You'll Be Using:

• LLMs & Frameworks:Llama 3, Mistral, Axolotl, HF Transformers, PyTorch, NumPy
• Infrastructure:Linux, Docker, AWS, Kubernetes, Cloud GPU Providers
• Inference:Hugging Face TGI

What You'll Need:

• At least 1 year of experience training open-source LLMs.
• Strong underst...