Senior Data Engineer

Role Overview
The engineer will be working within an established Microsoft Fabric data platform, supporting the delivery of a large number of data transformation workflows.
The platform is already built - the focus is on high-quality, fast execution of flow-specific development within an existing architecture.
This role suits mid-level engineers who are hands-on, productive, and able to work independently as part of a wider team.
Core Technical Requirements (Must-Have)
PySpark – essential, with strong hands-on development experience
Microsoft Fabric and/or Databricks – hands-on, production experience
Notebook-based development using Fabric, Synapse, or Databricks
Strong data pipeline development experience across ETL / ELT workflows
Experience working with Medallion architecture (Bronze / Silver / Gold)
Real-time / streaming data processing experience – experience building or supporting streaming pipelines is highly desirable
Strong understanding of data transformation, processing, and optimisation
Good coding practices, including readability, structure, maintainability, and performance
Strong Azure ecosystem experience preferred
Strong technical aptitude and ability to quickly understand and work within complex data platforms and existing architectures
Experience & Profile
2–5 years’ experience in data engineering/data platform development
Strongly hands-on and technically proficient, with a focus on development rather than architecture
Demonstrable experience working with PySpark and real-time/streaming data
Experience in trading/financial markets/trading platforms would be highly desirable
Able to work independently on defined user stories and deliver production-quality code
Comfortable working as part of a collaborative delivery team
Strong problem-solving and debugging skills
Scope of Work
Deliver PySpark-based development against defined requirements
Work within an existing Fabric-based architecture
Amend and extend existing pipelines (not building from scratch)
Support optimisation, fixes, and enhancements
Contribute to data transformation logic for multiple data flows
Support export of data to downstream systems
Ways of Working
Highly collaborative and interactive role
Regular engagement with internal stakeholders (technical and business)
Strong communication skills required
Working full-time in UK hours

Work arrangement
No