Platform Engineer

Job summary

Experienced Platform Engineer to support and develop Cloudera, Elastic Stack, and Dataiku platform environment.

Qualifications

• Strong experience with at least two of the following platforms: Cloudera, Elastic Stack, Dataiku DSS
• Good knowledge of Hadoop ecosystem technologies such as HDFS, YARN, Hive, Spark and Kafka
• Experience with Elasticsearch, Logstash, Kibana and Beats
• Experience designing data pipelines, ETL processes and streaming solutions
• Programming or scripting experience with Python and/or Scala
• Experience integrating platforms and external systems through REST APIs
• Good knowledge of GitHub, branching strategies, pull requests and code reviews
• Experience with CI/CD, infrastructure automation and deployment processes
• Understanding of clean code, secure coding and documentation standards
• Strong troubleshooting, analytical and communication skills
• Ability to translate business requirements into practical technical solutions
• Professional English skills

Responsibilities

• Support, maintain and optimise Cloudera, Elastic Stack and Dataiku platforms
• Design and develop data pipelines, workflows, dashboards and platform integrations
• Build and support real-time streaming solutions using Apache Kafka
• Develop custom scripts, plugins and integrations using Python, Scala and REST APIs
• Design and automate ETL and data ingestion processes
• Create Kibana dashboards, reports, queries and search solutions
• Support deployment and operationalisation of machine learning models in Dataiku
• Automate platform deployments and operations using Ansible, Terraform or similar tools
• Implement CI/CD pipelines using GitHub Actions, Jenkins or comparable technologies
• Troubleshoot platform, workflow and integration issues
• Create reusable scripts, templates, libraries and technical documentation
• Provide guidance, training and platform support to users and internal teams

Skills

Relocation