Jobs / Logius (ministerie van BZK)
Senior Data Platform Engineer
Logius (ministerie van BZK) · Den Haag, ZH, Netherlands
Den Haag, ZH, Netherlands4,818-7,094 EUR/monthlyHybrid
Remuneration
4,818-7,094 EUR/monthly
Location
Den Haag, ZH, Netherlands
Visa sponsorship
Not specified
Job summary
The Data Platform Engineer role involves developing a robust data platform on a private cloud using modern open-source tools. Key responsibilities include designing and maintaining data pipelines, optimizing Kubernetes environments, implementing security measures, and ensuring data quality through monitoring and testing. Technologies utilized include Airflow, Spark, dbt, and Keycloak.
Benefits
Individueel Keuzebudget (IKB)StudiefaciliteitenBedrijfsfitnessVolledige vergoeding van je OV-reiskosten woon-werkverkeerGedeeltelijk betaald ouderschapsverlof
Qualifications
- Extensive experience with Kubernetes, Docker, CI/CD, and IaC tools like Helm
- Several years of experience in setting up data pipelines and data modeling (SQL, dbt, Spark)
- Experience with security (authorization, network) in data platforms
- Knowledge of AI; regulations, risks, and opportunities in a data-driven environment
Responsibilities
- Develop and maintain private-cloud environment based on Kubernetes
- Automate processes with CI/CD and GitOps
- Implement and improve security controls: encryption, key management, network segmentation
- Build robust data pipelines and data models (SQL, dbt)
- Monitor data quality through implementation of monitoring, alerting, and data quality tests
- Implement authentication, authorization (RBAC), and data masking
- Enhance developer experience for the team and users
- Develop Proof of Concepts with AI
Skills
AirflowdbtDockerHelmIAMKeycloakKubernetesSpark
Degrees
Hbo/wo werk- en denkniveau
Relocation
No