Public listing

AI Infra存储架构师-成都/上海

Tencent Chengdu, China
  • Experience> 3 years of working experience
  • ListedPosting date unavailable
  • SourceOwn

Role overview

About the role

Description supplied by the original job listing.

1.负责推理系统分级存储架构建设:设计并实现 KVCache 在 HBM / DRAM / SSD / 分布式持久化存储各层级间的放置、流动与淘汰策略,平衡命中率、延迟与成本;
2.负责类 分布式持久化存储系统设计与研发,支撑 KVCache 卸载回灌、模型权重与 Checkpoint 读写等场景,做到高吞吐、低长尾延迟、可水平扩展;
3.负责分布式 KVCache 池化存储的元数据高可用能力建设,保障可用性 SLO;
4.优化端到端 I/O 路径,结合 RDMA、NVMe SSD、GPUDirect、零拷贝等技术降低 H2D/D2H 传输开销,并与 vLLM / SGLang 等推理框架协同落地 KVCache offload 与预取;
5.保障线上数据可靠性与稳定性,跟进存算分离等前沿方向。

Experience
> 3 years of working experience

Job alerts

Get notified about new openings

Set your preferences and JobBeeper will send matching roles as it finds them.

Create free account
Log in to apply