Big Data Engineer

Senior Engineer role in Knowledge Engineering focused on designing, building, and leading significant workstreams for enterprise-scale Knowledge Graph, semantic layer, ontology, and AI knowledge solutions on Amazon Web Services (AWS). In this role, you will lead a substantial knowledge engineering scope within a large program, translate real-world business problems into scalable AI and KG solutions, guide technical direction, and contribute to thought leadership, reusable assets, and delivery standards. The role must bring relevant industry experience across domains such as BFSI, healthcare, retail, telecom, manufacturing, energy, public sector, or life sciences, applying semantic AI, knowledge graphs, LLM grounding, data pipelines, and cloud-native engineering patterns to deliver measurable client value.
Responsibilities:
Engineer AWS-based knowledge engineering solutions using services such as Amazon Neptune, S3 Glue, Lambda, EMR, Redshift, Athena, OpenSearch, Bedrock, SageMaker, IAM, Step Functions, APIs, and monitoring/security services.
Build graph ingestion pipelines, semantic data products, vector integrations, LLM grounding layers, APIs, and governed access patterns on AWS while improving performance, reliability, scalability, and cost efficiency.
Lead the build of Knowledge Graph solutions that transform client data architecture within a large program scope.
Direct the design, development, and implementation of AI, semantic layer, ontology, taxonomy, schema, graph modelling, and knowledge curation solutions, ensuring all components work together seamlessly.
Work with project leaders, delivery leads, client stakeholders, architects, data engineers, AI engineers, product teams, and domain SMEs to create standout graph-powered data and AI offerings.
Develop strong client relationships, earn trust as a key advisor, and explain the business value of semantic layer, ontology, and knowledge graph solutions.
Make the business case for the recommended semantic layer solution and contribute meaningfully to sales, pre-sales, estimation, proposal inputs, and solution shaping activities.
Provide thought leadership on technology trends, innovation opportunities, limitations, risks, delivery concerns, and practical adoption of knowledge graphs, semantic AI, LLM grounding, RAG, and agentic systems.
Design, evaluate, and maintain ontologies, schemas, standards, and reusable engineering patterns, while guiding teams on data model quality and implementation methods.
Lead a team or workstream within a larger program, mentor engineers, review design/code/configuration, and guide adoption of new methodologies, model building techniques, and algorithms.
Collaborate across business and technical teams to drive end-to-end delivery for the assigned scope and demonstrate value to business and technology stakeholders.
Requirements:
Bachelor's degree or equivalent in Computer Science, Information Technology, Engineering, Mathematics, Data Science, or a related field.
Minimum 3 years of experience with Knowledge Graph technologies such as RDF, SPARQL, LPG, SHACL, OWL, graph query languages, schema design, ontology management, and KG curation.
Minimum 3 years of experience in schema design, ontology management, semantic modelling, taxonomy management, metadata management, and knowledge graph curation.
Minimum 3 years of experience designing and developing Knowledge Graph solutions and graph-based ML models across functional and technical workstreams.
Minimum 2 years of experience implementing end-to-end data pipelines for AI applications, especially LLM-enabled or enterprise knowledge applications, with hands-on design and configuration.
Minimum 4 years of experience with relational databases, object stores, graph databases such as Stardog, Neo4j, Amazon Neptune or equivalent, and vector databases.
Minimum 2 years of experience leading a team or workstream within a larger program.
Experience collaborating with engineering, research, product, domain, client-facing, and cross-functional teams across multiple time zones.
Hands-on experience building AWS-based knowledge engineering solutions with Amazon Neptune, S3 Glue, Lambda, EMR, Redshift, Athena, OpenSearch, Bedrock, SageMaker, IAM, Step Functions, and cloud-native APIs/monitoring services.
Strong Python experience with frameworks and tools such as TensorFlow, PyTorch, PySpark, SQL, SPARQL, SHACL, Apache Airflow, Apache NiFi, and ETL/ELT pipeline tooling.
Practical knowledge of NLP and search techniques including entity extraction, entity resolution, semantic search, prompt engineering, LLM grounding, and enterprise-scale LLM applications.
Ability to design and implement scalable graph ingestion, ontology/schema pipelines, semantic layers, vector search/retrieval patterns, RAG pipelines, and governed knowledge services.
Strong collaboration, technical leadership, delivery ownership, documentation, and stakeholder communication skills.
Good to Have Skills:
2+ years of hands-on experience with cloud platforms, with AWS specialisation and exposure to Azure or GCP in multi-cloud environments.
AWS certifications such as Solutions Architect, Data Engineer, Machine Learning/AI Speciality, or related credentials.
Industry experience in BFSI, healthcare, retail, telecom, manufacturing, energy, public sector, or life sciences, including domain ontologies, data models, compliance needs, and knowledge-driven use cases.
External client-facing consulting experience, proposal support, solution shaping, or pre-sales exposure.
Advanced degree or PhD in Computer Science, Computer Engineering, Mathematics, Electrical Engineering, Data Science, or a related discipline; broad exposure to diverse ML techniques and agentic systems.
15 years of full-time education.

Experience
5-9 yrs