Jobs / Animore
Senior Data Platform Engineer (F/M/D)
Animore · München, BY, Deutschland
München, BY, DeutschlandExp: 5+ yrsRemote
Remuneration
Not specified
Location
München, BY, Deutschland
Visa sponsorship
Not specified
Job summary
The Senior Data Platform Engineer role focuses on architecting and scaling data systems to enhance AI models in robotics. Key responsibilities include building distributed data pipelines using Ray/Anyscale, developing Python tooling for data quality, and overseeing real-world data collection while ensuring dataset quality and coverage.
Qualifications
- 5+ years in Data/ML Engineering, including 2+ years in a senior or lead role
- Experience with large-scale real-world data (robotics, autonomous systems, or video AI)
- Strong experience with Ray/Anyscale or Spark for distributed pipelines
- Advanced Python (performance, concurrency, ML stack like NumPy/PyTorch)
- Experience working with video and sensor data formats (e.g., H.264/H.265, ROS bags, MCAP)
- Experience building scalable data pipelines for GPU-based training workloads (AWS/GCP)
- Experience with data versioning tools such as DVC or LakeFS
- Proven experience owning systems and mentoring engineers
Responsibilities
- Drive the model–data loop by connecting application requirements with data collection
- Build and scale distributed data pipelines for TB-scale video, sensor, and robotics datasets
- Design multimodal data schemas aligning video, actions, and high-frequency sensor streams
- Develop Python tooling for data quality, including cleaning, anomaly detection, and dataset versioning
- Own dataset quality and coverage, including annotation workflows, data diversity, and storage trade-offs
- Lead a small team and coordinate with data providers and annotation vendors
- Oversee real-world data collection, including technical setup, compliance, and secure data handling
Skills
AWSGCPPythonSpark
Relocation
No