Senior Data Engineer

We are DIGIPAL, a software delivery agency specialising in building high-performing product design and software development teams for clients across Europe and North America. We work with a wide range of organisations from ambitious startups to multinational corporations. We have a unique career opportunity for you to work on building exciting digital products for international clients. Yet, remaining flexible in a remote-only environment and getting a top-tier compensation package.
WHO ARE WE LOOKING FOR:
We are looking for a Senior Data Engineer with strong hands-on experience in Azure, Databricks, Apache Spark, Python, and SQL to design, develop, and maintain scalable data solutions across the Azure Data Platform ecosystem.
WHAT YOU WILL DO:
Design, develop, and maintain scalable data solutions across Azure Databricks, Azure Synapse Analytics, and Azure Data Lake environments.
Build, maintain, and optimize ETL/ELT pipelines for ingesting, transforming, and serving data from multiple business domains.
Develop data processing solutions using Python, SQL, and Apache Spark.
Implement and maintain Databricks workflows, Delta Live Tables (DLT), metadata-driven frameworks, and data orchestration processes.
Support data platform migration and modernization initiatives, including Unity Catalog adoption, platform upgrades, and architectural improvements.
Apply Lakehouse architecture principles to build reliable, scalable, and maintainable data solutions.
Ensure data quality, consistency, reliability, security, and performance across data pipelines and platform components.
Optimize data processing workloads, pipeline execution, and storage structures to improve performance and reduce infrastructure costs.
Contribute to CI/CD implementation and deployment automation using Azure DevOps and related tools.
Support infrastructure automation, monitoring, logging, and operational best practices.
Troubleshoot production incidents, conduct root cause analysis, and implement long-term corrective actions.
Collaborate with Data Architects, platform engineers, analysts, and business stakeholders to translate business requirements into technical solutions.
Participate in solution design and architecture reviews, ensuring alignment with enterprise data architecture, governance standards, and Lakehouse principles.
Support reporting, analytics, and AI/ML initiatives by providing reliable, high-quality data foundations.
Promote engineering best practices, contribute to knowledge sharing, and support the technical development of team members.
WHAT WE EXPECT FROM YOU:
Strong professional experience in Data Engineering, building and maintaining production-grade data platforms and pipelines.
Hands-on experience with Azure Databricks, Apache Spark, Python, and SQL.
Proven experience designing, implementing, and optimizing ETL/ELT processes.
Experience working with the Azure data ecosystem, including Azure Data Factory, Azure Data Lake, and Azure Synapse Analytics.
Practical experience with Delta Live Tables (DLT) and Databricks workflows.
Understanding of Unity Catalog, including data governance, access control, and metadata management.
Solid understanding of Lakehouse architecture and modern data platform design principles.
Experience with CI/CD practices and deployment automation, preferably using Azure DevOps.
Familiarity with infrastructure automation, monitoring, logging, and production support.
Experience improving data pipeline performance, reliability, scalability, and cost efficiency.
Understanding of data quality, data governance, security, compliance, and operational excellence.
Familiarity with Power BI and its integration with data platforms is beneficial.
Experience with Azure Data Explorer is an advantage.
Strong analytical, troubleshooting, and problem-solving skills.
Ability to work independently, take ownership of technical initiatives, and drive tasks through to completion.
Proactive approach to identifying risks, resolving blockers, and proposing practical improvements.
English proficiency at B2 level or higher.
OUR OFFER
Remote work setup
B2B Contract
Attractive compensation package
Opportunities for professional growth and development
Collaborate with top minds from around the globe
Build world-class digital products for European and US markets

Work arrangement
Yes