Gen AI Developer

Position Description
Company Profile:
Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at cgi.com.
Job Title: Software Engineer
Position: Gen AI
Experience: 4-8 yrs
Category: Software Development/ Engineering
Shift: General
Main location: Gurugram
Employment Type: Full Time
Education Qualification: Bachelor’s degree in computer science or related field or higher with minimum 3 years of relevant experience.
Position Description:
LangGraph + AWS Bedrock (Claude) agents running on FastAPI, Postgres (checkpoints, memory, conversation history), deployed on Kubernetes (OpenShift + EKS)
Azure AD/OIDC auth, OPA-based authorization, agent routing, and the ChatOps Hub UI (React/TypeScript)
Policy-enforced Kubernetes operations agent
FastMCP-based tool aggregation layer connecting agents to ServiceNow, Atlassian/Confluence, RAG, and internal team tools
Langfuse — self-hosted LLM observability/tracing
Supporting infra: HashiCorp Vault (secrets), Jenkins (CI/CD), Kustomize overlays (dev/lab/prod)
Your future duties and responsibilities
What You'll Do
Daily health & usage review — check agent health endpoints, MCP server status, token usage dashboards, and user feedback queues across AI platforms, Incident Response, Agent Kubectl-AI, and the Gateway; flag anomalies early.
Incident response & RCA — triage errors, slow responses, and availability issues; use logs, OpenTelemetry/Langfuse traces, and Kubernetes tooling (kubectl/oc, pod logs, HPA/resource metrics) to find root cause and remediate; document outcomes.
Token/cost optimization — monitor Bedrock token consumption per agent/tool, identify high-cost call patterns (e.g., oversized tool results, redundant context), and propose or implement fixes (prompt trimming, tool-result summarization, model tier adjustments, offloading heavy LLM calls to lighter-weight agents/tools).
Backlog delivery — implement enhancement-level tickets from the CTO AI backlog: new/adjusted MCP tools, agent config changes, prompt updates, dashboard/report tweaks, minor UI fixes in the ChatOps Hub.
Monitoring & alerting — help build out and mature alerting (health checks, error-rate thresholds, token-usage thresholds, MCP server availability) using existing observability stack (Langfuse, OpenTelemetry, Kubernetes-native metrics).
Feedback loop management — review end-user feedback submitted through the platform; resolve directly when possible, or route to the right team/agent owner with context.
Operational hygiene — keep runbooks, on-call notes, and known-issue documentation current; contribute to release/rollback procedures for dev → lab → prod promotion via Jenkins/Kustomize.
Must-Have Skills
3+ years professional software engineering or SRE/DevOps experience
Strong Python (FastAPI or similar async web framework) — able to read and safely modify a production codebase
Working knowledge of Kubernetes (kubectl, deployments, ConfigMaps/Secrets, logs, basic troubleshooting) — ideally OpenShift and/or EKS
Comfortable with CI/CD pipelines (Jenkins preferred) and Git-based workflows (this org uses Bitbucket Server, not GitHub)
Experience debugging production incidents: reading logs/traces, forming hypotheses, verifying fixes
Familiarity with LLM-based systems — prompts, tool/function calling, token usage/cost concepts (hands-on experience with LangChain/LangGraph, Bedrock, OpenAI, or similar is a strong plus)
Basic SQL (Postgres) for querying conversation/audit/usage tables
Clear, concise written communication for incident notes, runbooks, and backlog ticket updates
Required Qualifications To Be Successful In This Role
Nice to Have
Experience with LangGraph or another agent-orchestration framework
Experience with MCP (Model Context Protocol) or building/consuming tool servers
Familiarity with OPA (Open Policy Agent), JWT/OIDC auth flows, or Azure AD integration
Exposure to HashiCorp Vault for secret management
Frontend experience (React/TypeScript) to make small ChatOps UI fixes
Experience operating in a regulated financial-services or similarly compliance-heavy environment
Familiarity with observability tools such as Langfuse, Grafana, or OpenTelemetry pipelines
Exposure to service registry/discovery patterns (service meshes, API gateways, package/artifact registries) — directly transferable to upcoming MCP registry and agent control-plane integration work
CGI is an equal opportunity employer. In addition, CGI is committed to providing accommodation for people with disabilities in accordance with provincial legislation. Please let us know if you require reasonable accommodation due to a disability during any aspect of the recruitment process and we will work with you to address your needs.
Together, as owners, let’s turn meaningful insights into action.
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.
Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.
Come join our team—one of the largest IT and business consulting services firms in the world.

Work arrangement
No