Popular repositories Loading

1. Megatron-LM-wbl Megatron-LM-wbl Public

   Forked from dalgarak/Megatron-LM

   wbl-etri LM base

   Python 1

2. DeepSpeed DeepSpeed Public

   Forked from deepspeedai/DeepSpeed

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python

3. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python

4. bitsandbytes bitsandbytes Public

   Forked from bitsandbytes-foundation/bitsandbytes

   Accessible large language models via k-bit quantization for PyTorch.

   Python

5. accelerate accelerate Public

   Forked from huggingface/accelerate

   🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

   Python

6. Liger-Kernel Liger-Kernel Public

   Forked from linkedin/Liger-Kernel

   Efficient Triton Kernels for LLM Training

   Python