Jobs / Viveris
Ingénieur Data / DevOps Azure - Databricks H/F
Viveris · Lyon 6e, ARA, France
Lyon 6e, ARA, France40,000-45,000 EUR/yearlyRemote
Remuneration
40,000-45,000 EUR/yearly
Location
Lyon 6e, ARA, France
Visa sponsorship
Not specified
Job summary
The role focuses on supporting the evolution and industrialization of an Azure Data Cloud platform within the transport sector. Key responsibilities include designing and developing data processing with Databricks/PySpark, optimizing data pipelines, automating Azure infrastructure using Terraform, and maintaining CI/CD pipelines with Jenkins and GitHub.
Qualifications
- Demonstrated autonomy, rigor, and initiative with the ability to analyze complex issues and propose relevant solutions
- Strong organizational skills and adaptability to thrive in a demanding corporate environment
- Comfortable managing priorities and collaborating with diverse technical and business stakeholders
- Strong writing and interpersonal skills for formalizing work and ensuring clear documentation
- Proficient in professional English, both written and spoken
Responsibilities
- Design and industrialize data processing with Databricks (PySpark) using Bronze/Silver/Gold architecture
- Develop, optimize, and maintain data pipelines ensuring performance, quality, and cost control
- Utilize data formats (Delta, Parquet, CSV) and implement associated best practices
- Supervise the data platform via Azure Data Factory: monitoring, alerting, data quality tracking, and reporting
- Enhance reliability and resilience of processes by managing incidents, detecting anomalies, and continuous improvement
- Contribute to DevOps and Cloud activities by maintaining CI/CD infrastructures and pipelines (Terraform, Jenkins, GitHub) and collaborating with business and technical teams
Skills
AzureAzure Key VaultDatabricksGitHubJenkinsPythonSparkTerraformVault
Relocation
No