AIPandailyabout 1 hour ago
Ant Group Open-Sources Humming Inference Kernels
1 min read
Ant Group and the vLLM community open-source Humming, a just-in-time compiled GEMM kernel library for quantized large language model inference. The project is released under Apache 2.0 from Ant Group's inclusionAI organization and mirrored under the vLLM project.
Level
Hype check
Tap to vote and see what everyone thinks.
