Profile cover
C

AI Log Pattern Mining Developer

Caleb Rodriguez

Full-time · Job · London

About the role

Application logs are a goldmine of debugging information — if you can find the signal in 50 million lines per day. Engineers grep for error messages they already know about, but the most dangerous issues are the ones nobody is looking for: a new log pattern that appears 3 hours before every outage, a subtle change in log frequency that indicates a memory leak, or a sequence of warnings that individually seem harmless but together predict a cascade failure. You'll build the log pattern mining pipeline: parsing unstructured log lines into structured events, clustering similar events into patterns, tracking pattern frequency over time, and flagging new or changing patterns that correlate with incidents. It's a text mining problem at massive scale with real operational impact. The observability team is five engineers. You'll start with the log parsing and event extraction layer — turning messy, unstructured log lines into structured records that the downstream analysis can work with. Your senior teammate handles the correlation with incidents; you handle the data preparation that makes correlation possible.

Responsibilities

  • Build log parsing pipelines extracting structured events from unstructured logs
  • Cluster similar log events into canonical patterns
  • Track pattern frequency changes over time
  • Flag new patterns and frequency anomalies for investigation
  • Handle diverse log formats across different application stacks
  • Write tests for parsing accuracy and pattern detection quality

Requirements

  • 1+ year of Python development experience
  • Basic understanding of text processing and regular expressions
  • Familiarity with log files and debugging concepts
  • Interest in observability, DevOps, or SRE
  • Comfort working with large-scale data processing

Benefits

  • Fully remote across UK/EU time zones
  • 25 days PTO plus bank holidays
  • Private health insurance
  • £1,500 learning budget
  • Structured mentorship program

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Job Type

Full-time

Level

Junior

Language

English

Salary Range

Under $60k / year

AI Expertise

MLOps & AI Infrastructure Automation & AI Workflows

Skills

python sql docker aws pandas

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile

Interested in this role? Create your free profile to apply.

Apply — create free profile