Live opening · Posted 13 days ago
At a glance
The key details from the original listing.
Your early-applicant advantage
Live timing from JobBeeper.
About the role
Description supplied by the original job listing.
Senior Data Engineer
Openings: 3
Location: Remote
Compensation: $150K–$155K
Industry: Healthcare / Specialty Pharmacy
Overview
Client is looking for Senior Data Engineers to build, support, and optimize enterprise data warehouse pipelines in an Azure Databricks environment.
This is a hands-on role focused on Data bricks, Delta Lake, SQL, Python/PySpark, data modeling, pipeline reliability, and data quality across Bronze, Silver, and Gold layers.
Key Responsibilities
Build and support enterprise data pipelines and data models using Databricks Medallion Architecture.
Develop Bronze ingestion and Silver transformation pipelines.
Build dimensional, harmonized, and Gold-layer data models.
Own production data domains, including SLA, monitoring, troubleshooting, and incident resolution.
Develop and optimize Delta Lake pipelines.
Support migration from batch processing to event-driven / low-latency ingestion.
Implement data validation, reconciliation, quality gates, and data contracts.
Optimize Databricks pipelines for performance, reliability, latency, and cost.
Simplify legacy transformation layers and document architecture/data flows.
Use Azure DevOps, Git, and CI/CD for development and deployment.
Perform code reviews and mentor other Data Engineers.
Collaborate with Data Governance, QA, Analytics, and business stakeholders.
Must-Have Skills
6+ years of Data Engineering experience
Strong production experience with Azure Databricks
Delta Lake & Medallion Architecture
Unity Catalog
Advanced SQL
Strong Python & PySpark
Enterprise Data Warehousing & Dimensional Modeling
Azure Data Lake Storage (ADLS)
Azure Data Factory (ADF)
Azure DevOps / Git / CI/CD
Production pipeline ownership, monitoring, troubleshooting, and optimization
Strong understanding of data quality, reconciliation, SLAs, and reliability
Nice to Have
Healthcare, pharmacy, specialty pharmacy, or regulated-industry experience
Azure Event Hubs / Kafka / Structured Streaming
Zerobus Ingestion
Spark Declarative Pipelines
Data contracts / ODCS
Monte Carlo
Atlan / Collibra
Data lineage, cataloging, and governance
Technical mentoring and code-review experience
Bachelor's degree in CS, Data Engineering, Information Systems, or related field
Candidate Preference: Native American / Indigenous candidates, where permitted and applicable under the client's hiring requirements.
Work arrangement
No
More openings worth a look
Recently tracked roles with full details and direct application links.