Backend Developer (LLM)

🚨 We’re Hiring: Backend Developer (LLM)
📍 Location: REMOTE
📝 Employment Type: Full-time
Role Summary
You’ll own backend architecture from scratch: building a billing-grade gateway, orchestrating agents, and deploying production-ready AI services. Expect full ownership, working closely with frontier research teams, balancing speed with correctness.
🔎 Key Responsibilities
Build a unified, OpenAI-compatible API across multiple providers.
Ensure routing reliability: load balancing, failover, cost/latency-aware traffic.
Implement precise billing/metering with token accounting and usage ledgers.
Develop org controls: API keys, quotas, RBAC, rate limiting.
Optimize streaming, proxying, caching, and performance.
Integrate agent/tool traffic into the gateway with observability and controls.
📌 Requirements
Strong backend engineering skills: infra, deploy, CI/CD, monitoring.
Experience with LLM APIs, inference proxies, token accounting, and gateways.
Proven track record building production backend services handling real traffic (APIs, auth, data modeling, monitoring).
Experience with payments, billing, metering, or usage-based systems (idempotency, reconciliation, accuracy).
Datastore skills: PostgreSQL, Redis, queues, schema design for usage/billing data.
Strong in at least one of TypeScript or Python; familiarity with Docker/Kubernetes.
Knowledge of OAuth/OIDC, RBAC, tenant isolation, and secure secrets handling.
Comfort with high-throughput proxying, gateways, and streaming performance.
MCP and tool-calling knowledge; contributions to open agent tooling a plus.
Open-minded, pragmatic, comfortable with ambiguity and full ownership.
Good English communication.
If you're ready to take the next step in your career, please comment or DM for more information
📩 Email: gony.huynh@talentjdi.com
📞 Zalo: 0776635766

Work arrangement
Yes