Run the RWKV model locally in browser on your GPU. This demo is built upon the web-rwkv inference engine.

Check the live demo!

. ├── assets # static files ├── node_modules ├── src # ts code for web ├── index.html # web entry point └── web-rwkv-realweb # rust code └── src

To install wasm-pack, use

cd web-rwkv-wasm cargo install wasm-pack

We use pnpm to manage the node packages. To install the project dependencies, use:

pnpm install

To run the development server, use:

pnpm run dev

To build wasm package only, use:

pnpm run wasm:build

To build the project, use:

pnpm run build pnpm run preview

You can find the available models on cryscan's huggingface page. The model files name should end in .st.