Data Platform Engineer

Job Title: Data Platform Engineer (Infrastructure & Data Engineering)
Purpose
Support the design, build, and operation of the Data Platform, blending infrastructure engineering with data engineering practices to keep the Databricks/Azure environment reliable, automated, and self-service for platform users.
Key Responsibilities
Design and maintain CI/CD pipelines (DevOps/GitHub Actions) for infrastructure and application deployments
Write and maintain Terraform IaC for Azure services and Azure Databricks (Unity Catalog, workspaces, networking, compute policies)
Develop and support application code in Python and/or .NET for platform tooling and automation
Build and maintain shared libraries/modules used by data engineers and analysts across the platform
Design and implement pipelines/processes that support platform management (cost tracking, governance, provisioning, monitoring)
Collaborate with data engineers, analysts, and security/infra teams to translate requirements into platform capabilities
Troubleshoot infrastructure, pipeline, and integration issues (networking, auth, connectivity)
Contribute to platform documentation and best-practice standards
Required Skills & Experience
Solid experience with Microsoft Azure infrastructure (Entra ID, Key Vault, networking, storage)
Hands-on Azure Databricks experience (Unity Catalog, cluster/job management)
Terraform (IaC) experience, ideally in a multi-environment setup
Proficiency in Python; working knowledge of SQL; .NET is a plus
Experience building/maintaining CI/CD pipelines (Azure DevOps, GitHub Actions, or similar)
Understanding of data platform governance and cost management concepts
Comfortable working across the infra/data engineering boundary
Nice to Have
Experience with medallion architecture (Bronze/Silver/Gold)
Exposure to FinOps/cost attribution practices

Work arrangement
No