Big Data Engineer - ML Analytics & Search (f/m/x)

INNOVATION IS IMAGINING WHAT NO ONE ELSE CAN.

At the BMW Group, everything begins with passion. It transforms a profession into a vocation. It drives us to continually reinvent mobility and bring innovative ideas to the roads. Enthusiasm for collaborative projects turns a team into a strong unit where every opinion is valued. It is only when expertise, highly professional processes, and enjoyment of work come together that we can shape the future collectively.

We train models on petabyte-scale automotive sensor data, but training is only half the story. Before a single GPU cycle is spent, engineers need to find, filter, evaluate, and understand the data. We build the analytics and search infrastructure that makes petabytes of measurements and recordings queryable in seconds, enabling rapid dataset assembly, quality analysis, and model evaluation at scale.

What awaits you?

• You design and build high-performance search and query pipelines over PB-scale MDF4 and MCAP data lakes, enabling ML engineers to find relevant driving scenarios, sensor conditions, and edge cases across billions of records in seconds.
• Furthermore, you build and operate indexing and cataloguing systems for automotive sensor data, including metadata extraction, signal-level indexing, scene tagging, and embedding-based similarity search.
• You implement distributed compute pipelines for large-scale data evaluation, such as batch statistics, distribution analysis, annotation coverage reports, and data-quality scoring.
• In addition, you build fast analytical queries that enable interactive exploration on top of raw data.
• You develop dataset assembly pipelines that automatically assemble, version, and register training and evaluation datasets.
• You optimise for cost and performance through intelligent partitioning, tiered storage, caching strategies, and query pushdown to minimise scan volumes over PB-scale data.
• You operate observability stacks for data pipelines, including query latency dashboards, pipeline health, and data freshness monitors.