Azure Data Engineer

About The Company
Tata Consultancy Services (TCS) is a global leader in IT services, consulting, and business solutions. With a rich history spanning over five decades, TCS has established itself as a trusted partner for organizations worldwide, delivering innovative technology solutions that drive digital transformation. Headquartered in Mumbai, India, TCS operates in over 46 countries, serving a diverse range of industries including banking and financial services, healthcare, manufacturing, retail, and more. The company is committed to fostering a culture of excellence, innovation, and sustainability, empowering clients to achieve their business objectives through cutting-edge technology and expert consulting services.
About The Role
We are seeking a highly skilled Data Engineer with extensive experience in designing, developing, and deploying scalable data pipelines using advanced Azure data services. The ideal candidate will have a strong background in big data processing, ETL/ELT solutions, and data architecture, with hands-on expertise in tools like Azure Data Factory, Databricks, Synapse Analytics, and Delta Lake. This role involves working closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to deliver high-quality, reliable data solutions that support strategic decision-making and operational excellence. The position offers an excellent opportunity to work in a dynamic environment, leveraging the latest cloud technologies to solve complex data challenges and contribute to TCS’s digital transformation initiatives.
Qualifications
Overall professional experience of 6 to 12 years in data engineering, data architecture, or related fields.
Proficiency in Azure Data Factory, Databricks, Synapse Analytics, and Delta Lake development with hands-on coding experience.
Strong expertise in Python, PySpark, and SQL for large-scale data processing and analytics.
Experience in designing and optimizing data pipelines for performance and scalability.
Ability to write complex SQL queries and optimize them for efficiency.
Good understanding of data governance, security, and compliance best practices.
Experience working within Agile methodologies and DevOps culture.
Excellent problem-solving skills and the ability to troubleshoot and resolve data pipeline issues effectively.
Strong collaboration skills to work effectively with cross-functional teams and stakeholders.
Responsibilities
Design, develop, and implement scalable data pipelines using Databricks (PySpark, Spark SQL), Azure Synapse, Azure Data Factory, and other Azure data services.
Develop and maintain ETL/ELT processes to ingest, transform, and load data from diverse sources into data lakes and data warehouses.
Optimize data pipelines for performance, reliability, and scalability, ensuring efficient data processing.
Write and optimize complex SQL queries for data extraction, transformation, and reporting purposes.
Utilize PySpark for large-scale data processing, analytics, and machine learning workflows.
Implement data partitioning, bucketing, z-ordering, liquid clustering, and indexing strategies to enhance data retrieval efficiency.
Integrate structured, semi-structured, and unstructured data from multiple sources, including APIs, streaming data, and batch sources.
Collaborate with data scientists, analysts, and business stakeholders to gather requirements and deliver tailored data solutions.
Implement data governance practices to ensure data quality, security, and compliance across all data pipelines.
Monitor, troubleshoot, and optimize data pipelines to maintain data accuracy, consistency, and availability.
Work closely with DevOps teams to deploy, monitor, and manage data pipelines in production environments.
Document data workflows, architecture, and processes for knowledge sharing and future reference.
Stay updated with the latest industry trends and technological advancements in data engineering and cloud computing.
Benefits
Tata Consultancy Services offers a comprehensive benefits package designed to support the well-being and professional growth of its employees. This includes competitive salary packages, health insurance, retirement plans, and paid time off. Employees also have access to ongoing training and development programs to enhance their skills and career progression. TCS promotes a collaborative and inclusive work environment that encourages innovation, diversity, and work-life balance. Additionally, employees are provided with opportunities to work on cutting-edge projects with global clients, fostering a stimulating and rewarding professional experience.
Equal Opportunity
Tata Consultancy Services is an equal opportunity employer. We are committed to creating an inclusive environment for all employees and candidates, regardless of race, gender, age, religion, nationality, sexual orientation, disability, or any other characteristic protected by law. We believe diversity drives innovation and excellence, and we strive to ensure all individuals have equal access to employment opportunities and career development within our organization.

Work arrangement
No