AI Streaming Data Architect

About the role

Responsibilities

• Design real-time streaming data architecture for ML feature delivery
• Build Kafka-based ingestion pipelines from IoT sensor networks
• Implement Spark Structured Streaming for real-time feature computation
• Create a unified feature serving layer for batch and online inference
• Define SLAs for feature freshness and data quality in streaming pipelines

Requirements

• 6+ years in data engineering with streaming system experience
• Deep Kafka and Spark Structured Streaming expertise
• Experience building real-time ML feature pipelines
• Strong AWS and Docker skills for infrastructure
• Understanding of streaming semantics (exactly-once, watermarks, late data)

Benefits

• Fully remote — US time zones
• Senior equity package
• $4,000 annual learning budget
• Greenfield architecture project with full autonomy

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.