Lead Data Platform Engineer

Job summary

Leads the architecture, development, and scaling of an enterprise data platform that connects operational, foundry, and product quality analytics in semiconductor and photonics environments. The role builds ETL/ELT pipelines and a central lakehouse, develops Python and FastAPI applications and REST APIs, and oversees PostgreSQL, Docker Swarm, and GitLab CI/CD infrastructure. It also sets the data and automation roadmap, raises software engineering standards, and deploys dashboarding, process automation, and AI-assisted developer tools.

Qualifications

• Senior- or Lead-level experience owning production data platform architectures and end-to-end data pipelines.
• Advanced Python proficiency and experience with ETL/ELT orchestrators such as Airflow, Dagster, or Prefect.
• Experience with analytical databases such as PostgreSQL and DuckDB.
• Hands-on experience developing secure backend services and APIs with FastAPI.
• Experience with Docker, Docker Swarm, PostgreSQL administration and scaling, and GitLab CI/CD.
• Experience deploying AI agentic coding tools, LLM-based documentation systems, and dashboarding platforms.
• Ability to lead technical roadmaps, mentor engineers, establish software quality standards, and work with cross-functional teams and external partners.

Responsibilities

• Architect, build, and optimize scalable ETL/ELT pipelines and a central data lakehouse.
• Integrate operational, foundry, and product quality datasets across engineering teams.
• Build secure internal data applications and REST APIs using Python and FastAPI.
• Manage Docker Swarm deployments and administer and tune PostgreSQL database servers.
• Own GitLab CI/CD pipelines, security configurations, and developer infrastructure.
• Define and execute enterprise data and automation roadmaps.
• Set coding guidelines, maintain the developer handbook, and standardize project templates.
• Deploy and scale dashboards, process automation, AI-assisted coding tools, and internal AI documentation systems.

Skills

Languages

Work schedule

Industry

Relocation