Live opening · Posted 18 days ago
The key details from the original listing.
Live timing from JobBeeper.
Description supplied by the original job listing.
Responsibilities:
Platform Reliability and Operations: Ensure availability, stability, observability, and scalability of the data platform. Own production issue resolution, RCA, and continuous improvements.
Architecture and Feature Development: Lead design and delivery of platform features. Make informed choices across data architectures (e. g., batch vs. streaming, Delta vs. Iceberg), orchestration tools (Airflow, Argo), and scalability patterns.
Performance and Cost Efficiency: Implement best practices for partitioning, indexing, and resource optimization. Drive cost efficiency through FinOps-aligned design and observability.
Platform Thinking and Governance: Treat the platform as a product balanced on usability, governance, and adoption. Define and track KPIs for usage, performance, and cost.
Code Excellence and Engineering Discipline: Write modular, testable, and maintainable code. Build CI/CD pipelines and structured logging, and enable observability and debugging by design.
Collaboration and Leadership: Collaborate across teams, own stakeholder communication, drive sprint execution, and contribute to documentation. Mentor engineers and influence best practices.
Requirements:
Experience and Skills: 7-10 years in platform/data engineering. Proficient in Python, Shell, Kubernetes, CI/CD, Terraform, observability tools, and Linux-based systems.
Cloud and Data Ecosystem: Hands-on with Azure/GCP/AWS, modern orchestration tools, data formats (Parquet, Delta, and Iceberg), and compute engines (Databricks, Clickhouse, and Trino).
System Design and Optimization: Design scalable, fault-tolerant systems with efficient storage, caching, and cost control. Experience with model serving frameworks is a plus.
Governance and Reliability: Apply data access policies, SLA/SLO tracking, and schema evolution best practices. Enable monitoring, auditing, and incident management.
Leadership and Ownership: Take initiative, prioritize business impact, mentor team members, and drive accountability in delivery and technical decision-making.
Experience
6-10 yrs
Recently tracked roles with full details and direct application links.