Commits

History for

Commits on Jan 22, 2022

Add codespell to pre-commit checks (#1717)
aphedges
authored

Commits on Jan 19, 2022

MoE inference + PR-MoE model support (#1705)

authored

Commits on Jan 10, 2022

fix the half-precision version of rotary_pos_emb kernel (#1683)
RezaYazdaniAminabadi
authored

Commits on Jan 8, 2022

GPT-J inference support (#1670)

RezaYazdaniAminabadi
and
jeffra
authored

Commits on Jan 5, 2022

support CPU Adam and Adagrad on Windows with SDK 10.0.22000 (#1634)

authored

Commits on Dec 15, 2021

Fix cpu-adam AVX performance (#1637)
RezaYazdaniAminabadi
authored

Commits on Dec 1, 2021

Transformer kernel/fix layer norm (#1587)

RezaYazdaniAminabadi
and
tjruwase
authored

Commits on Nov 29, 2021

force set lf instead of crlf (https://github.com/pre-commit/pre-commit-hooks#mixed-line-ending) (#1598)
jeffra
authored

Commits on Nov 9, 2021

CPU-Adam: Fix compile Issue (#1537)
RezaYazdaniAminabadi
authored

Commits on Nov 1, 2021

Bfloat16 zero2 (#1398)

raamjad
and
tjruwase
authored

Commits on Oct 31, 2021

Transformer kernel - fix unit test (#1503)

RezaYazdaniAminabadi
and
jeffra
authored

Commits on Oct 29, 2021

Fixing the transformer APIs to return tuple as the output (if needed) (#1491)
RezaYazdaniAminabadi
authored

Commits on Oct 26, 2021

Add cpu adagrad (#1358)

authored

Commits on Oct 6, 2021

Fix the workspace allocation for the transformer kernel (#1397)
RezaYazdaniAminabadi
authored

Commits on Oct 2, 2021

Fix many typos (#1423)

aphedges
and
tjruwase
authored

Commits on Aug 17, 2021

DeepSpeed MoE (#1310)

authored

Commits on Jul 28, 2021

Fix cudaErrorInvalidConfiguration in attn_softmax() for large seq_length*heads values (#1239)

authored

Commits on Jul 20, 2021

Fixing inference api for FP32 and non-masking GPT-based models (#1204)
RezaYazdaniAminabadi
authored

Commits on Jul 15, 2021

enable async io op on powerpc architectures (#1224)

adammoody
and
tjruwase
authored

Commits on Jul 12, 2021

enable cpu adam op on powerpc architectures (#1213)

authored

Commits on Jun 28, 2021

clean up logging (#1190)

stas00
and
jeffra
authored

Commits on Jun 8, 2021

Add local attention for GPT-Neo model architecture (#1114)

RezaYazdaniAminabadi
and
jeffra
authored

Commits on May 24, 2021

Quantization + inference release (#1091)

authored

Commits on May 10, 2021

Auto-tuning aio parameters (#1059)
tjruwase
authored

Commits on May 5, 2021

Align optimizer swap buffer sizes (#1036)
tjruwase
authored

Commits on Apr 30, 2021

Validate env; remove write size from logs (#1013)
tjruwase
authored

Commits on Apr 23, 2021

Minor usability tweaks/fixes (#1001)
tjruwase
authored

Commits on Apr 22, 2021

Add nvme unit/perf tests (#993)
tjruwase
authored

Commits on Apr 19, 2021

ZeRO-Infinity (#976)

authored

Commits on Apr 8, 2021

Supporting different hidden dimensions for transformer kernels-v2 (#934)

RezaYazdaniAminabadi
and
jeffra
authored

Commits on Apr 7, 2021

fix cpu_adam memory leak on deepspeed re-use in the same process (#896)

authored

Commits on Mar 3, 2021

Fixing gelu_checkpointing memory issue (#812)
RezaYazdaniAminabadi
authored

Commits on Feb 28, 2021

issue with the implementation of column_sum_reduce (#804)

zmxdream
and
RezaYazdaniAminabadi
authored

Commits on Feb 24, 2021

Fix the bias-add and add the layer-norm-eps parameter (#791)
RezaYazdaniAminabadi
authored

Commits on Feb 18, 2021

CPU-Adam fix for scalar mode (#735)

RezaYazdaniAminabadi
and
jeffra
authored