A

Artem K.

AI Automation Engineer · Mid-Level

  • Spain
  • Madrid (UTC+1)
  • Rate on request

You need a company account. No job post needed.

Professional Overview

LLM Evaluation specialist — 5 years building evaluation harnesses, benchmark sets, and regression frameworks at Apple. I measure what others demo: accuracy, consistency, hallucination rates, edge-case handling. Built eval workflow tool, 25% error reduction and a 287-vector security benchmark. Python, RAG, prompt engineering, SQL.

Experience

Company
Apple
Nov 2020 – Mar 2026
Role title
AI Quality Evaluation Specialist

AI Expertise

NLP & Prompt Engineering AI & Machine Learning Engineers

Skills

Python SQL LangChain Docker OpenAI API Prompt Engineering RAG

Employment Type

Full-time

Description of Responsibilities

  • Built repeatable evaluation workflows for LLM-powered voice assistant features
  • Created benchmark datasets from real historical cases establishing ground-truth
  • Designed failure analysis frameworks to uncover edge cases and bias patterns
  • Partnered with product teams to translate business requirements into measurable

Key Achievements / KPIs

  • Developed Assistant - reduced grader error rates by 25%
  • Built security benchmark with 287 attack vectors for LLM system prompts
  • Delivered quality evaluation across 5+ LLM model generations
Company
Apple
Nov 2020 – Jun 2026
Role title
AI Quality Evaluation Specialist

AI Expertise

NLP & Prompt Engineering AI Product & Strategy

Skills

Python Prompt Engineering OpenAI API LangChain Docker RAG

Employment Type

Full-time

Description of Responsibilities

  • Evaluated LLM outputs across multilingual voice assistant scenarios, identifying
  • Built PODE Assistant — AI-assisted evaluation tool, reducing grader error rates
  • Implemented LLM-as-Judge evaluation: designed judge prompts, validated alignment
  • Curated golden datasets from production interactions, built regression test feed
  • Compared model performance across OpenAI, Anthropic, on-device: cost, latency, q

Key Achievements / KPIs

  • Reduced grader error rates by 25% with PODE Assistant toolContributed to evaluat
  • Built System Prompt Benchmark: 287 attack vectors for LLM security evaluation
Company
CPM International (Airbnb Project)
Dec 2018 – Jul 2020
Role title
Customer Experience Coach

AI Expertise

AI Product & Strategy AI Business, Marketing & Strategy

Skills

Prompt Engineering Python OpenAI API

Employment Type

Full-time

Description of Responsibilities

  • Designed evaluation frameworks and performance metrics for distributed teams

Education

School
Vanderbilt University (Coursera)
Jan 2024 – Dec 2024
Degree / Program
Certificate

Field of Study: AI Agents and Agentic AI with Python and Generative AI

School
Vanderbilt University (Coursera)
Jan 2024 – Dec 2024
Degree / Program
Certificate

Field of Study: Prompt Engineering for ChatGPT

School
Penza State University of Architecture and Civil Engineering
Sep 2000 – Jun 2005
Degree / Program
Specialist Degree in Marketing

Field of Study: Marketing

Areas of Expertise

Automation & AI Workflows

Build intelligent automation pipelines, integrate AI APIs into existing tools, and replace manual workflows with agentic AI systems.

NLP & Prompt Engineering

Build natural language processing systems, fine-tune large language models, and craft reliable production prompts for AI-powered products.

MLOps & AI Infrastructure

Architect scalable ML infrastructure — CI/CD for ML, model versioning, experiment tracking, monitoring, and cloud deployment on AWS, GCP, or Azure.

Open to
Full-time, Contract, Part-time, Contract-to-hire
Time zone
Madrid (UTC+1)
Work language
English

More AI Automation Engineers available for hire

Browse mid-level AI Automation Engineers specialized in OpenAI API, RAG, LLM — available for remote hire on RemoteAI.

Hiring an AI Automation Expert?

Message Artem K. with a company account, or post the job to reach the talents it matches. One free job a month, open 14 days; reviewed first if your website is not verified.