Diversity Opportunities

About Position:
We are seeking an experienced Azure Data Engineer to design, develop, and support modern cloud-based data platforms and analytics solutions. The ideal candidate will possess strong expertise in Azure Cloud, Databricks, PySpark, Python, Kafka, and SQL, with hands-on experience building scalable, high-performance data pipelines and real-time data processing frameworks.
Role: Azure Data Engineer
Location: Pune
Experience: Between 6 to 10 Years
Job Type: Full Time Employment
What You'll Do:
Design, develop, test, and maintain scalable data engineering solutions on Azure Cloud.
Build and optimize batch and real-time data processing pipelines using Azure Databricks and PySpark.
Develop robust ETL/ELT frameworks for processing large-scale structured and unstructured datasets.
Design and implement real-time streaming solutions using Kafka.
Create reusable data ingestion, transformation, and orchestration components.
Develop and optimize advanced SQL-based data processing and analytics workflows.
Collaborate with architects and business stakeholders to translate requirements into scalable technical solutions.
Perform code reviews, unit testing, integration testing, and production validation activities.
Troubleshoot and resolve production issues while ensuring platform stability and performance.
Implement data quality, validation, governance, and monitoring frameworks.
Contribute to CI/CD implementation and deployment automation processes.
Create and maintain technical documentation, design artifacts, and operational procedures.
Participate in Agile ceremonies and continuous improvement initiatives.
Ensure adherence to security, compliance, and cloud engineering best practices.
Expertise You'll Bring:
Bachelor's degree in Computer Science, Information Technology, Engineering, Mathematics, or a related discipline.
6-10 years of experience in Data Engineering, Big Data, or Cloud Data Platform development.
Strong hands-on expertise with Microsoft Azure Cloud services.
Extensive experience with Azure Databricks and Apache Spark.
Advanced PySpark development experience for large-scale data transformation and processing.
Strong Python programming skills for data engineering and automation.
Hands-on experience with Apache Kafka and real-time event streaming architectures.
Advanced SQL development, query optimization, and performance tuning skills.
Experience building enterprise-scale ETL/ELT pipelines and data integration solutions.
Strong knowledge of Data Warehousing, Data Lakes, and Lakehouse architectures.
Experience working with structured, semi-structured, and streaming data sources.
Understanding of distributed computing and scalable data processing frameworks.
Experience implementing CI/CD practices and DevOps principles.
Knowledge of data governance, data quality, security, and compliance frameworks.
Familiarity with Git and version control systems.
Strong troubleshooting, analytical, and problem-solving skills.
Excellent communication and collaboration abilities.
Benefits:
Competitive salary and benefits package
Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
Opportunity to work with cutting-edge technologies
Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
Annual health check-ups
Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Values-Driven, People-Centric & Inclusive Work Environment:
Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
We support hybrid work and flexible hours to fit diverse lifestyles.
Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment.
Let's unleash your full potential at Persistent - persistent.com/careers
"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."

Work arrangement
No