A toolkit for processing speech data and creating speech datasets

CUDA Core Compute Libraries

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

NeMo Retriever Library is a scalable, performance-oriented document content and metadata extraction microservice. NeMo Retriever extraction uses specialized NVIDIA NIM microservices to find, contextualize, and extract text, tables, charts and images that you can use in downstream generative applications.

Ongoing research training transformer models at scale

Ubuntu kernels which are optimized for NVIDIA server systems

cuTile is a programming model for writing parallel kernels for NVIDIA GPUs

OpenShell is the safe, private runtime for autonomous AI agents.

The NVIDIA® Tools Extension SDK (NVTX) is a C-based Application Programming Interface (API) for annotating events, code ranges, and resources in your applications.