Profile cover
S

AI Model Distillation Engineer

Stella Tran

Freelance · Job · Warsaw

About the role

Hugging Face models, PyTorch training loops and MLflow tracking are the daily tools here. Lontex Tech runs LLM infrastructure for software companies, and many of our customers pay for frontier models on tasks that a much smaller model could handle. We want a freelance engineer to build our distillation workflow: generate teacher outputs, train compact student models, and compare quality, latency and cost. The engagement starts with two customer pilots and roughly 30 hours a week for four months.

Responsibilities

  • Build a repeatable distillation pipeline from teacher outputs to deployable student models
  • Run experiments on two customer pilots and document trade-offs in quality, latency and cost
  • Containerize trained student models for our serving platform
  • Track all runs in MLflow so results are reproducible

Requirements

  • Hands-on experience training or fine-tuning transformer models
  • Strong PyTorch and Hugging Face skills
  • Understanding of distillation, quantization or LoRA-style methods
  • Able to communicate results clearly to non-research stakeholders

Benefits

  • About 30 hours per week for four months
  • Fully remote, async-friendly
  • GPU compute provided
  • Possible long-term engagement

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

AI & Machine Learning Engineers MLOps & AI Infrastructure

Skills

python pytorch hugging face docker mlflow

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Lead Solutions Architect - Generative AI (EMEA Emerging DNB)

RemoteAI company

Full-time Lead

Lead Solutions Architect - Generative AI (EMEA Emerging DNB)

RemoteAI company

Full-time Lead

Lead Solutions Architect - Generative AI (EMEA Emerging DNB)

RemoteAI company

Full-time Lead

Technical Support Engineer

RemoteAI company

Full-time

Senior Machine Learning Engineer, Driving Product

RemoteAI company

Full-time Senior

3D Reconstruction Research Scientist/Engineer

RemoteAI company

Full-time

Job Type

Freelance

Level

Mid-Level

Language

English

Salary Range

$130k – $160k / year

AI Expertise

AI & Machine Learning Engineers MLOps & AI Infrastructure

Skills

python pytorch hugging face docker mlflow

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile