Tencent HPC-Ops: SOTA Performance for LLM Inference
Tencent releases HPC-Ops, a production-grade high-performance operator library for LLM inference, delivering up to 2.22x speedup on NVIDIA H20 GPUs.