Embed and highlight and preview markdown in any language which support line-comment or block-comment for vscode.

DSPy: The framework for programming—not prompting—language models

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

Python client library for Modal

Convert PDF to markdown + JSON quickly with high accuracy

Tensors and Dynamic neural networks in Python with strong GPU acceleration

A python library to define and validate data types in Docling.

Get your documents ready for gen AI

Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines

Python client for Qdrant vector search engine

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

1️⃣🐝🏎️ The One Billion Row Challenge -- A fun exploration of how quickly 1B rows from a text file can be aggregated with Java

Object mapping, and more, for Redis and Python

LlamaIndex (GPT Index) is a data framework for your LLM applications

A curated list of awesome developer-first tools products.

A lightweight framework for building AI-powered software that's reliable, scalable, and easy to trust

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.