xrsrke

Follow

🎯

building foundational knowledge

Phuc Nguyen xrsrke

🎯

building foundational knowledge

Follow

distributed training @NousResearch. ex @huggingface

326 followers · 356 following

Paris, France
08:47 (UTC +01:00)
https://phucnguyen.dev
@xariusrke

Achievements

Achievements

xrsrke/README.md

Hi there 👋

currently distributed training @ nous research. ex-nanotron @ huggingface. DMs open

https://phucnguyen.dev.

DMs open

Best way to reach me is discord: neuralink, twitter/@xariusrke

Pinned Loading

huggingface/nanotron huggingface/nanotron Public

Minimalistic large language model 3D-parallelism training

Python 2.6k 290
pipegoose pipegoose Public

Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*

Python 87 19
instructGOOSE instructGOOSE Public

Implementation of Reinforcement Learning from Human Feedback (RLHF)

Jupyter Notebook 174 21
toolformer toolformer Public

Implementation of Toolformer: Language Models Can Teach Themselves to Use Tools

Jupyter Notebook 144 15
reinforcement-learning reinforcement-learning Public

Jupyter Notebook 10 1