Live opening · Posted 2 days ago
At a glance
The key details from the original listing.
Your early-applicant advantage
Live timing from JobBeeper.
About the role
Description supplied by the original job listing.
We are looking for a Data Engineer II with strong GCP and data engineering expertise to build scalable data pipelines, transformations, and reusable data-platform solutions.
Responsibilities:
Build and maintain production-grade ETL/ELT pipelines on GCP.
Develop batch and incremental processing using BigQuery, Dataform/dbt, and Airflow/Cloud Composer.
Build distributed processing solutions using Dataflow/Apache Beam or Dataproc/Spark/PySpark.
Develop reusable, metadata-driven, and configuration-driven data components.
Design data models, schemas, data contracts, and incremental/idempotent pipelines.
Implement data quality, validation, reconciliation, monitoring, and lineage.
Optimize BigQuery queries and pipelines for performance and cloud cost.
Implement automated testing and CI/CD for data workloads.
Troubleshoot production issues and perform root-cause analysis.
Collaborate with data, platform, DevOps, architecture, and business teams.
Requirements:
4+ years of hands-on data engineering experience.
Strong GCP, BigQuery, SQL, and Python expertise.
Hands-on ETL/ELT development experience.
Experience with Cloud Composer / Apache Airflow.
Experience with Dataform and/or dbt.
Experience with Dataflow/Apache Beam or Dataproc/Spark/PySpark.
Strong understanding of data modelling and large-scale datasets.
Experience with incremental/idempotent pipelines and data quality.
Knowledge of Git, automated testing, CI/CD, monitoring, and troubleshooting.
Ability to independently design and deliver production solutions.
Good to Have:
Apache Iceberg / modern lakehouse technologies.
Streaming / event-driven processing and CDC.
Data Mesh / Data Product principles.
Terraform / Infrastructure as Code.
Experience building reusable platform components.
Core Stack: GCP, BigQuery, GCS, SQL, Python, Dataform/dbt, Airflow, Dataflow/Beam, Spark/PySpark, Git, CI/CD.
Experience
6-8 yrs
More openings worth a look
Recently tracked roles with full details and direct application links.