Pinned Loading

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 16.3k 2.4k

2. lm-sys/FastChat lm-sys/FastChat Public

   An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

   Python 38.9k 4.7k

3. alpa-projects/alpa alpa-projects/alpa Public archive

   Training and serving large-scale neural networks with auto parallelization.

   Python 3.1k 353

4. apache/tvm apache/tvm Public

   Open deep learning compiler stack for cpu, gpu and specialized accelerators

   Python 12.5k 3.6k

5. FMInference/FlexLLMGen FMInference/FlexLLMGen Public archive

   Running large language models on a single GPU for throughput-oriented scenarios.

   Python 9.3k 582

6. awesome-tensor-compilers awesome-tensor-compilers Public

   A list of awesome compiler projects and papers for tensor computation and deep learning.

   2.6k 314