Public listing
AI Infra系统研发工程师-成都/上海
Tencent
Chengdu, China
- Experience> 3 years of working experience
- ListedPosting date unavailable
- SourceOwn
Role overview
About the role
Only a short excerpt is available here.
The full responsibilities and requirements may be missing. Sign in to open the original listing and confirm the details before applying.
1.大规模分布式kvcache系统建设： 主导并规划分布式kcache系统建设，保障kvcache命中率处于业界领先水平，kvcache调度灵活性和弹性扩缩容；
2.异构算力各个厂商硬件卡平台的H2D D2H kvcache传输性能优化，减少kvcache损耗，优化推理框架在高kvcache命中率下的性能；
3.优化推理方面底层通信库性能优化，包括kvcache传输效率，卡间通信效率；
4.跨机房PD通信性能优化，探索PD异构在不同机房的解决方案；
5.GPU机密计算等前沿方向的调研和落地，推理安全安全方面的方案设计和落地工作。
Experience
> 3 years of working experience
Job alerts
Get notified about new openings
Set your preferences and JobBeeper will send matching roles as it finds them.