Jobs / Insitoo freelances
Data Engineer Azure / Databricks – DevOps (H/F) (IT) / Freelance
Insitoo freelances · Lyon, ARA, France
Lyon, ARA, FranceExp: 3+ yrs500-580 EUR/dailyOnsite
Remuneration
500-580 EUR/daily
Location
Lyon, ARA, France
Visa sponsorship
Not specified
Job summary
The Data Engineer Azure / Databricks – DevOps role focuses on developing and optimizing data processing on a Data Cloud platform using Azure technologies. Key responsibilities include designing Databricks/PySpark treatments, supervising Azure Data Factory pipelines, and enhancing infrastructure with Terraform and Jenkins, while ensuring data quality and performance.
Responsibilities
- Design and develop Databricks / PySpark treatments
- Work on a Medallion architecture (Bronze / Silver / Gold)
- Utilize and optimize Parquet / Delta / CSV data
- Optimize performance, data quality, and costs
- Supervise Azure Data Factory flows and pipelines
- Contribute to the reliability and industrialization of the Data platform
- Evolve infrastructure and pipelines with Terraform / Jenkins
- Participate in GitHub workflows / CI-CD and code reviews
- Occasionally conduct opportunity studies and architecture documents
Skills
AzureDatabricksGitGitHubJenkinsPythonTerraform
Relocation
No