Patel observes VLLM and SGLANG framework developers compete publicly on Twitter using InferenceX as a leaderboard.
“VLLM and SGLANG love competing with each other. They used to post on Twitter all the time about how they had beat the other one in certain some kind of performance”
Patel says VLLM and SGLANG now use Inference X as their competition leaderboard instead of Twitter posts.
“They used to post on Twitter all the time about how they had beat the other one in certain some kind of performance and now they use Inference X all the time.”