Jobs / Basic-Fit
Data Platform Engineer
Basic-Fit · Hoofddorp, NH, Netherlands
Hoofddorp, NH, NetherlandsExp: 1+ yrs3,500-5,500 EUR/monthlyHybrid
Remuneration
3,500-5,500 EUR/monthly
Location
Hoofddorp, NH, Netherlands
Visa sponsorship
Not specified
Job summary
The Data Platform Engineer role focuses on building and optimizing a data platform that supports millions of members across Europe. Key responsibilities include developing batch and streaming pipelines in Databricks, automating workflows with AI, and designing data models for Power BI, while collaborating with various teams to enhance data quality and usability.
Qualifications
- Hands-on experience with Databricks (around 1+ year)
- Curiosity about newest Databricks features
- Understanding of batch vs. streaming data processing
- Strong skills in SQL, PySpark, and Python
- Experience building data pipelines with Azure Data Factory
- Awareness of data quality, governance, and scalability
- Experience and curiosity towards AI
- Comfortable communicating in English
- Experience with Power BI or other reporting tools is a plus
Responsibilities
- build batch and streaming pipelines in Databricks
- continuously improve Databricks with latest technologies
- collaborate with analysts for self-service reporting
- automate workflows using AI
- migrate legacy pipelines to modern Databricks platform
- optimize performance, cost, governance, and reliability
- design data models for Power BI
Skills
AzureDatabricksPython
Relocation
No