Profile cover
J

AI Multilingual QA Tester

John Mueller

Part-time · Job · Berlin

About the role

Our translation QA tool catches errors in e-commerce product descriptions across 8 languages. But how do you test an AI that tests translations? Carefully, systematically, and with native speaker judgment that no automated metric can replace. This part-time role (15-20h/week) is for someone who speaks English and at least one other European language fluently. You'll evaluate our AI's translation quality assessments — does it correctly identify mistranslations? Does it flag cultural mismatches? Does it miss errors that a native speaker would catch? You'll build evaluation datasets, score model outputs, and help us understand where the AI's language understanding breaks down. Perfect for a linguistics student or multilingual professional interested in NLP quality.

Responsibilities

  • Evaluate AI translation quality assessments against native speaker judgment
  • Build multilingual evaluation datasets with annotated error examples
  • Score model outputs across different error types and severity levels
  • Identify systematic weaknesses in AI language understanding per language
  • Document evaluation findings and recommend model improvements

Requirements

  • Fluent English plus native-level proficiency in German, French, or Spanish
  • Basic Python skills for data analysis
  • Strong attention to linguistic detail and translation quality
  • Interest in NLP and machine translation
  • Available for 15-20 hours/week

Benefits

  • Part-time (15-20h/week) with flexible hours
  • Fully remote
  • Learn NLP evaluation methodology
  • Option to expand hours or transition to full-time

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

NLP & Prompt Engineering AI Product & Strategy

Skills

python hugging face pandas sql

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Technical Writer

RemoteAI company

Part-time

Product Manager, Developer Experience

RemoteAI company

Full-time

Software Engineer, Full Stack - UK

RemoteAI company

Full-time

Software Engineer, Applications (Scientific Development Solutions) (High Seniority)

RemoteAI company

Full-time Senior

Senior Autonomy Engineer, Data Curation

RemoteAI company

Full-time Senior

Drone Platform Integration & Network Support Engineer

RemoteAI company

Full-time

Job Type

Part-time

Level

Junior

Language

English

Salary Range

Under $60k / year

AI Expertise

NLP & Prompt Engineering AI Product & Strategy

Skills

python hugging face pandas sql

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile