Enterprise Data Engineer

Enterprise Data Engineer
Location: Pune / Hyderabad
Experience: 5–7 Years
Open Positions: 1
Notice Period: 15 Days
Role Overview:
The Enterprise Data Engineer will be part of the Global Cybersecurity Data Acquisition and Engineering team, responsible for data acquisition, onboarding and engineering of security data into the cyber data lake and analytics platform.
The role involves designing and implementing reliable, scalable and performant data ingestion pipelines to support security analytics and cybersecurity use cases.
Key Responsibilities:
Design, develop and maintain data ingestion pipelines for cybersecurity data.
Work with Databricks, Azure Data Factory, PySpark, NiFi, Kafka and Fluentd.
Develop scalable and reliable data pipelines for large datasets.
Support data acquisition, onboarding, transformation and normalization.
Drive automation and optimization of data engineering pipelines.
Support real-time analytics and streaming data processing.
Collaborate with Cybersecurity, Infrastructure and IT teams to develop data solutions.
Contribute to new detection and analytics use cases.
Support automation, orchestration and platform improvements.
Work with cloud infrastructure and Azure platform services.
Provide technical guidance and support to other engineering team members.
Contribute to continuous improvement of cybersecurity data platforms.
Required Skills:
Azure Data Factory
Databricks
PySpark
Cloud-based data pipelines
Data ingestion, transport and transformation
Azure cloud services
Linux / RHEL / Ubuntu
Kafka / Azure Event Hubs
Spark Streaming
Data engineering automation and optimization
Good to Have:
NiFi / Fluentd
Terraform, Chef or Ansible
Azure Functions
SIEM / SOAR technologies
Cybersecurity data engineering experience
Azure / Databricks certifications

Work arrangement
No