Databricks Technical Lead

G MASS are seeking an experienced Databricks Technical Lead to support the development and ownership of strategic data platforms and cloud-based applications within a financial services environment.
The role will focus on defining technical direction and architecture across Databricks and the wider AWS estate, ensuring scalable and secure development practices, and overseeing delivery through the full software development lifecycle. The successful candidate will work closely with Development, Business Analysis, QA, Application Support, IT Security, and Enterprise Architecture teams to deliver robust and high-performing solutions across complex banking and financial systems.
Responsibilities:
Lead the development and enhancement of strategic banking data platforms and applications across Databricks and AWS cloud environments
Design, build, and optimise large-scale data pipelines using Spark / PySpark, Delta Lake, and Databricks Workflows
Own data governance and access control within the Databricks environment, including Unity Catalog design and implementation
Manage cloud infrastructure deployments using Terraform and Infrastructure as Code best practices
Maintain technical documentation and internal knowledge resources
Provide technical leadership through mentoring, code reviews, and best practice guidance
Support architectural design with a focus on scalability, performance, cost efficiency, and reliability
Drive CI/CD improvements across cloud and on-premise environments
Promote clean coding standards, automated testing, and effective use of AI-assisted development tools
Requirements
Enterprise SDLC experience
Financial services experience, including banking exposure
Strong hands-on Databricks experience, including Spark / PySpark, Delta Lake, Databricks SQL, and Workflows, with proficiency in Python and / or Scala
Experience of Unity Catalog and data governance within a regulated environment
Strong AWS experience (EC2, Lambda, ECS, RDS, S3, IAM)
Hands-on Terraform / Infrastructure as Code experience
CI/CD experience using Jenkins
Degree in Computer Science or related discipline (or equivalent experience)
IBM MQ or similar messaging systems
Benefits
Length: Permanent
Location: Cork, Dublin, or Amsterdam

Work arrangement
No