Live opening · Posted 7 days ago

Senior Staff Data Platform Engineer - Apache Iceberg - Apache Spark

ServiceNow · San Diego, CALIFORNIA, United States
Smartrecruiters Hybrid Full-time
You are 7 days behind. JobBeeper subscribers saw this role while it was still new.

At a glance

The key details from the original listing.

Posted 7 days ago
CompanyServiceNow
LocationSan Diego, CALIFORNIA, United States
Job typeFull-time
Work modeHybrid
SourceSmartrecruiters
Listed7 days ago

Your early-applicant advantage

Live timing from JobBeeper.

Live data
8 min from Smartrecruiters publishing this role to us finding it
3 min median time from a role going live to a subscriber being told
6 hours subscribers had this role before this page existed
17,031 roles found in the last 24 hours — the newest are not on this site yet
Start your free trial →

About the role

Description supplied by the original job listing.

Position Location:
This is a Flexible (Hybrid) position. Flexible positions require 2 days per week in a ServiceNow office location. We have offices in several locations, including San Francisco, CA; Pleasanton, CA; Santa Clara, CA; San Diego, CA
Please Note: This position will include supporting our US Regulated Markets.
“This position requires passing a ServiceNow background screening, USFedPASS (US Federal Personnel Authorization Screening Standards). This includes a credit check, criminal/misdemeanor check and taking a drug test. Any employment is contingent upon passing the screening. Due to Federal requirements, only US citizens, US naturalized citizens or US Permanent Residents, holding a green card, will be considered.
Team Overview
The Data Platform group builds highly scalable, high‑performance platform capabilities for data‑in‑motion and backend storage systems. Our customers operate at massive scale, pushing the boundaries of data volume, throughput, and concurrency. We are looking for a seasoned IC5 Senior Staff Engineer with deep expertise in distributed systems, data ingestion pipelines, and Data Lake architectures to drive next‑generation platform innovation.
Role Summary
As an IC5 Senior Staff Engineer, you will architect and deliver large‑scale distributed platform components, lead complex technical initiatives, and define engineering best practices. You will bring strong leadership, hands-on engineering depth, and the ability to design and operate reliable, scalable, and high‑performance data systems.
What you get to do in this role:
Architect, design, and build high‑performance distributed systems and platform components.
Build distributed systems data ingestion solutions with strong emphasis on scalability, quality, and operational excellence.
Design software that is easy to use, extend, and customize for customer‑specific environments.
Deliver high‑quality, clean, modular, and reusable code while enforcing engineering best practices (code reviews, unit testing, automation, design reviews).
Build foundational libraries, frameworks, and tools focused on modularity, extensibility, configurability, and maintainability.
Collaborate across engineering teams to refine requirements and deliver end‑to‑end solutions.
Provide technical leadership for projects with significant complexity and risk.
Research, evaluate, and adopt new technologies that enhance platform capabilities.
Troubleshoot and diagnose complex production issues across distributed systems.
To be successful in this role you have:
Experience leveraging or critically thinking about how to integrate AI into engineering work — whether using AI-powered coding and operational tooling, automating workflows, or reasoning about how AI changes the way software and infrastructure are built.
10+ years of software development experience with a Bachelor's degree; OR 8+ years with a Master's degree; OR 6+ years with a PhD OR equivalent work experience.
Core Distributed Systems Expertise
Strong fundamentals in distributed systems architecture, design patterns, and algorithms.
Deep programming expertise in Java, including JVM internals, memory models, and garbage collection.
Proven experience in JVM performance tuning, profiling, and diagnosing performance bottlenecks.
Strong understanding of concurrency, networking, sockets, OS internals, and performance optimization.
Hands-on experience building and operating large‑scale distributed systems.
Experience with relational databases such as Oracle, MySQL, or PostgreSQL.
Specific Distributed Systems Expertise
Experience with large‑scale deployments of Kafka, or similar streaming platforms.
Deep knowledge of stream processing, topic design, partitioning, replication, and HA strategies.
Experience working within DevOps environments for operationalizing distributed platforms.
Demonstrated experience architecting and delivering full‑stack Data Lake solutions.
Strong expertise in designing and operating data ingestion pipelines using:
Apache Iceberg (tables, catalogs, schema evolution, metadata management)
Apache Spark (batch & streaming jobs, optimization, partitioning)
Expertise in data formats such as Parquet, ORC, and Avro, along with compaction and governance strategies.
Ability to build scalable, fault‑tolerant ingestion and transformation workflows.
Experience integrating Data Lakes with analytics engines, query services, or ML platforms.
For positions in this location, we offer a base pay of $181,200 - $317,100, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies, and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs. Compensation is based on the geographic location in which the role is located and is subject to change based on work location.

Employment type
Full-time

Work arrangement
Hybrid

Get JobBeeper Mobile App

Never miss a job opening! Get instant job alerts on your phone.

Subscribers see fresh openings within minutes. Download the JobBeeper App on Google Play to get real-time push notifications and apply before anyone else.

⚡ Instant Push Alerts 🎯 Tailored Filters 🚀 Direct Employer Links
GET IT ON Google Play

More openings worth a look

Recently tracked roles with full details and direct application links.

6 roles
Good roles move before most people even see them. Tell JobBeeper what you want and get fresh matches delivered in minutes.
Start your free trial →
⚡ Get fresh job alerts 📱 Get App