Data engineer ( Python & PySpark & Databricks & data factory & ADLS & Azure & DevOps ) (IT) / Freelance

Job summary

The role focuses on developing a data product for actuaries, emphasizing the creation of efficient data processing pipelines using technologies such as Python, PySpark, and Databricks. Responsibilities include proposing technical solutions, participating in Agile workshops, and ensuring code quality through unit testing and documentation.

Qualifications

• Cloud Azure (Data Factory, ADLS, Databricks)
• Mandatory PySpark and Python skills
• Scala is a plus
• Strong knowledge of data architectures and cloud
• Familiarity with collaborative processes and development tools
• SQL proficiency

Responsibilities

• Propose and validate technical solutions
• Develop technical proposals to meet business needs
• Address performance challenges
• Submit proposals for lead validation
• Participate in workshops to define requirements
• Analyze and enhance User Stories
• Develop efficient data processing pipelines
• Adhere to established development standards
• Implement unit tests
• Support testers in validation
• Document implemented solutions

Skills

Relocation