Search results

Grouped Bias/Dbias Kernel Support After Grouped GEMM

Status: Open.

#2766 In NVIDIA/TransformerEngine;

· vthumbe1503 opened on Mar 16, 2026

[Question] Expected behavior for blockwise FP8? Hybrid E4M3/E5M2 format & eval metrics outperforming BF16

Status: Open.

#2754 In NVIDIA/TransformerEngine;

· Mnb66 opened on Mar 11, 2026

Cross node CP communication latency much higher in 8K H800 HGX cluster

bugSomething isn't workingSomething isn't working

Status: Open.

#2742 In NVIDIA/TransformerEngine;

· jianxiongzhang opened on Mar 6, 2026

Dequantization support for the grouped tensor - NVFP4

Status: Open.

#2726 In NVIDIA/TransformerEngine;

· ptrendx opened on Mar 2, 2026

Dequantization support for the grouped tensor - MXFP8

Status: Open.

#2725 In NVIDIA/TransformerEngine;

· ptrendx opened on Mar 2, 2026

_create_transpose tensor accumulating during FSDP2 with quantized_model_init

bugSomething isn't workingSomething isn't working

Status: Open.

#2717 In NVIDIA/TransformerEngine;

· pstjohn opened on Feb 27, 2026

Enable Router custom call from JAX

Status: Open.

#2710 In NVIDIA/TransformerEngine;

· tdophung opened on Feb 26, 2026

Performance bottleneck in TransformerLayer and Attention when using attention mask

bugSomething isn't workingSomething isn't working

Status: Open.

#2703 In NVIDIA/TransformerEngine;

· yang-cx opened on Feb 25, 2026

[JAX] Optimize materialized attn mask to consume O(N) memory instead of O(N*N)

attention

jax

Status: Open.

Task

#2700 In NVIDIA/TransformerEngine;

· KshitijLakhani opened on Feb 23, 2026

[JAX] Expose sigmoid GLU activation type

jax

Priority = P1

Status: Open.

Enhancement

#2687 In NVIDIA/TransformerEngine;

· jberchtold-nvidia opened on Feb 17, 2026

te.autocast() and fully_shard doesn't de-allocate quantized weights until the backwards pass

bugSomething isn't workingSomething isn't working

Status: Open.

#2681 In NVIDIA/TransformerEngine;

· pstjohn opened on Feb 13, 2026

[Inquiry] Support status and roadmap for MXFP8 on SM120 (Blackwell)

enhancementNew feature or requestNew feature or request

Status: Open.

#2668 In NVIDIA/TransformerEngine;

· Mnb66 opened on Feb 10, 2026