Jobs / Etraveli Group

Sr. Data Platform Engineer

Etraveli Group · Toronto, ON, Canada
Toronto, ON, CanadaExp: 7+ yrs140,000-170,000 CAD/yearlyHybrid
Remuneration
140,000-170,000 CAD/yearly
Location
Toronto, ON, Canada
Visa sponsorship
Not specified

Job summary

Tripstack is seeking a Sr. Data Platform Engineer to lead the migration of their data stack to Kubernetes on OpenStack and ensure the operational health of their data platform.

Qualifications

  • Strong Kubernetes experience with stateful workloads
  • Senior-level Infrastructure as Code experience
  • Observability and RCA discipline
  • Production operations experience with Apache Druid, Kafka, Redpanda, Spark, or Elasticsearch
  • 7+ years in production data or platform systems
  • Clear written and verbal English

Responsibilities

  • Plan and execute the migration of Druid, Spark, Redpanda, and orchestration layer from bare-metal VMs to Kubernetes on OpenStack
  • Design StatefulSet, PVC, pod-disruption-budget, and rolling-upgrade patterns for production data systems
  • Codify the migration with Infrastructure as Code
  • Own the operational health of Druid, Spark, Redpanda, Airflow, PostgreSQL, and Elasticsearch
  • Build KPIs, alerting, dashboards, and runbooks
  • Optimize queries, reports, segments, and tiering
  • Build Prometheus, Grafana, and distributed-tracing coverage
  • Partner with SRE on hardware, networking, and Kubernetes fundamentals

Skills

AirflowArgo CDCephElasticsearchFluxGoGrafanaHelmKafkaKubernetesKustomizeOpenStackPostgreSQLPrometheusPythonSparkTerraformVault

Relocation

No