Senior Data Platform Engineer

Job summary

Designs, builds, and operates secure, scalable data platforms on Google Cloud Platform for financial-sector clients. The role develops batch and streaming pipelines with Dataflow, Dataproc, Pub/Sub, and Cloud Composer; architects BigQuery data lake, warehouse, and lakehouse solutions; and manages infrastructure with Terraform and CI/CD. It also covers data governance, security, platform reliability, stakeholder communication, and mentoring engineers.

Qualifications

• At least 7 years of data engineering or data platform engineering experience, including at least 3 years in a senior or lead capacity.
• Hands-on experience building and operating data platforms on GCP.
• Experience with BigQuery, Dataflow, Dataproc, Cloud Composer, Pub/Sub, Cloud Storage, Bigtable, and Cloud SQL.
• Proficiency in Python and SQL, with experience in Spark or Apache Beam.
• Experience designing data lake and warehouse architectures and data models.
• Experience with Terraform and CI/CD tools such as Jenkins, GitHub, or Cloud Build.
• Knowledge of data security in regulated environments, DevOps, DataOps, and Agile delivery.
• Strong written communication, analytical, debugging, and problem-solving skills.
• GCP Professional Data Engineer or Professional Cloud Architect certification is advantageous.
• Experience with financial services, data governance tools, container orchestration, other data platforms, or AI/ML workloads is advantageous.

Responsibilities

• Design, build, and maintain scalable GCP data platforms for financial-sector clients.
• Develop and optimize batch and streaming pipelines using Dataflow, Dataproc, Pub/Sub, and Cloud Composer.
• Architect data lake, warehouse, and lakehouse solutions, including BigQuery data modeling and performance tuning.
• Provision and manage data infrastructure with Terraform and CI/CD pipelines.
• Implement data governance, lineage, quality, and cataloging frameworks.
• Apply security controls, including IAM, encryption, KMS, data masking, and access controls.
• Monitor and troubleshoot platform performance, reliability, and data quality.
• Translate business needs into technical solutions with client teams and stakeholders.
• Mentor engineers, contribute to technical standards, and promote DataOps practices.
• Communicate architecture decisions and progress to technical and non-technical audiences.

Skills

Certifications

Languages

Industry

Relocation