Live opening · Posted 9 days ago
At a glance
The key details from the original listing.
Your early-applicant advantage
Live timing from JobBeeper.
About the role
Description supplied by the original job listing.
We are hiring for a Senior Data Engineer to join a globally distributed team building next-generation, large-scale cloud data platforms.
This opportunity is ideal for candidates currently based in India who are open to relocating to Portugal in the future. The selected candidate will initially start working remotely from India while the relocation process is managed by the company.
Requirements:
7+ years of experience in Data Engineering or Software Engineering.
Strong expertise in Python within large-scale production environments.
Hands-on experience with Spark/PySpark and distributed data processing frameworks.
Strong understanding of distributed systems and modern data architectures.
Experience with Apache Kafka and streaming data platforms.
Strong experience with cloud technologies, preferably GCP (BigQuery, Dataflow, Pub/Sub, Dataproc).
Proven experience in large-scale data platform migrations from Cloudera (CDH/HDP) to Snowflake or Databricks.
Expertise in: Re-architecting Hive/Impala workloads, Migrating HDFS data, Refactoring ETL pipelines to cloud-native frameworks
Strong hands-on experience with: Snowflake (Snowpipe Streaming, Tasks, Streams), Databricks (Auto Loader, Delta Sharing, Unity Catalog), Reverse ETL, CDC, API ingestion frameworks.
Experience
7-11 yrs
More openings worth a look
Recently tracked roles with full details and direct application links.