Popular repositories Loading

1. face_recognition_distribute_pallel face_recognition_distribute_pallel Public

   train insight face model in distribute data pallel and model pallel

   Python 2 1

2. transformers transformers Public

   Forked from huggingface/transformers

   🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.

   Python

3. pytorch pytorch Public

   Forked from pytorch/pytorch

   Tensors and Dynamic neural networks in Python with strong GPU acceleration

   C++

4. Megatron-LM Megatron-LM Public

   Forked from NVIDIA/Megatron-LM

   Ongoing research training transformer language models at scale, including: BERT & GPT-2

   Python

5. DeepSpeed DeepSpeed Public

   Forked from deepspeedai/DeepSpeed

   DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

   Python

6. nccl nccl Public

   Forked from NVIDIA/nccl

   Optimized primitives for collective multi-GPU communication

   C++