Azure Data Engineer

TCS Hiring for Azure Data Engineer (multiple locations)
Experience Range: - 06 To 08 Years
JOB DESCRIPTION
Must-Have Skills:
Relevant experience in PySpark and Azure Synapse Analytics/Azure Databricks.
Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources.
Good experience in SQL or native SQL query languages.
Strong experience in implementing Synapse Analytics/Databricks notebooks using Python/PySpark.
Good experience in Azure Data Factory, ADLS, Storage Services, Serverless architecture, and Azure Functions.
Advanced working knowledge in building robust data pipelines using ADF.
Experience in building processes supporting data transformation, data structures, metadata, dependency, and workload management.
Exposure to basic issues in working within a Cloud (Azure) environment.
Advanced working SQL knowledge and experience working with relational/non-relational databases and queries.
Exposure to Jira and Confluence required.
Experience working in an Agile project management environment.
A successful history of manipulating, processing, and extracting value from large, disconnected datasets.
Build data pipeline infrastructure for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, cloud-based relational or non-relational databases, and/or scripting languages such as Perl/Python.
Identify, design, and implement internal process improvements, including automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability.
Good-to-Have Skills:
Experience in SSIS/ETL transformation processes.
Exposure to any cloud-based Data Warehouse.
Experience in Azure DevOps and CI/CD deployments.
DP-203 certification.
Minimum Qualification
15 years of Full Time Education

Work arrangement
No