Data Engineer – Distributed Data Platforms | Spark | Python | Kafka | NiFi | Real-Time Streaming | Big Data Architecture

Senior Specialist - Data Engineering
7-11 years
Job description:
Python Spark Python
We are seeking an experienced Data Engineer to join our team in Denmark and contribute to the design development and optimization of largescale data platforms The ideal candidate should have strong expertise in Big Data technologies real time data processing distributed computing and modern data engineering practices The role requires working closely with business stakeholders solution architects data scientists and engineering teams to build scalable and high performance data solutions
Key Responsibilities
Design develop and maintain enterprise scale data ingestion and processing pipelines
Develop batch and streaming solutions using Hadoop Spark Kafka and NiFi
Build scalable ETLELT frameworks to process structured semi structured and unstructured data
Design and implement real time data streaming solutions using Kafka and Spark Streaming
Develop data integration workflows using Apache NiFi
Optimize data processing jobs for performance scalability and reliability
Collaborate with Data Architects and Data Modelers to implement data models and platform architecture
Implement data quality reconciliation monitoring and governance frameworks
Troubleshoot production issues and perform root cause analysis
Ensure adherence to security compliance and data governance standards
Participate in code reviews architectural discussions and technical design activities
Skills:
Mandatory Skills : Apache Spark, Python for DATA, SparkSQL

Work arrangement
Hybrid