Jobs / High Tech Genesis
Lead Data Platform Engineer
High Tech Genesis · Toronto, ON, Canada
Toronto, ON, CanadaExp: 8+ yrs80-85 CAD/hourlyRemote
Remuneration
80-85 CAD/hourly
Location
Toronto, ON, Canada
Visa sponsorship
Not specified
Job summary
Lead Data Platform Engineer to design, build, and optimize scalable data platforms and pipelines for enterprise analytics, combining hands-on engineering with technical leadership.
Qualifications
- 8+ years of experience in data engineering, including 2+ years in a technical leadership role.
- Strong Python skills (Pandas, NumPy, PySpark) and experience with Impala.
- Hands-on experience with Hadoop, Databricks, and large-scale data processing.
- Advanced SQL and experience with relational and distributed databases.
- Experience with cloud platforms such as Azure or AWS, including Databricks or Snowflake.
- Strong knowledge of ETL/ELT tools such as Apache Airflow, Apache NiFi, or Azure Data Factory.
- Experience with CI/CD, DevOps practices, and enterprise data platforms.
- Understanding of data modeling, governance, and performance optimization.
Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
- Build and optimize data platforms using Hadoop, Databricks, and cloud-based technologies.
- Integrate structured and semi-structured data into reliable, high-quality data solutions.
- Partner with cross-functional teams to translate business and analytics requirements into scalable engineering solutions.
- Lead technical design discussions and promote best practices in data modeling, performance optimization, and governance.
- Mentor data engineers and contribute to engineering standards, architecture, and platform scalability.
- Support innovation through proof-of-concepts, automation, and continuous platform improvements.
Skills
AirflowAWSAzureDatabricksHadoopPythonSnowflake
Relocation
No