Data Engineer (Kubernetes, AWS, Python) (m/w/d) 90% remote ID02864

Job summary

Seeking a Data Engineer with Kubernetes, AWS, and Python experience for a project in the Transport and Logistics sector. The role involves designing data pipelines, architecting databases and data warehouses, integrating real-time data, and implementing data quality rules and CI/CD for data pipelines. The position is 90% remote.

Qualifications

• Experience managing Kubernetes clusters (3+ years)
• Experience with AWS Cloud and AWS Services (3+ years)
• Practical experience with REST-API based interfaces (3+ years)
• Practical experience with SQL (3+ years)
• Extensive experience in Python programming (3+ years)
• Experience in the Transport and Logistics sector (at least 1 reference)
• Experience with Docker (3+ years)
• Experience with Grafana (3+ years)
• Experience with Kafka (3+ years)
• Experience with Kinesis (3+ years)
• Experience with Polars (3+ years)
• Experience with Prometheus (3+ years)
• Experience with Open Telemetry (3+ years)

Responsibilities

• Design data pipelines for data ingestion and processing
• Architect databases and data warehouses
• Integrate real-time data
• Provide data governance consulting
• Implement data quality rules
• Develop test automation and CI/CD for data pipelines

Skills

Industry

Relocation