Efficient and robust implementation of seq-to-seq automatic piano transcription.

Requires Python 3.11

git clone https://github.com/EleutherAI/aria-amt.git cd aria-amt pip install -e . 

Download the preliminary model weights:

Piano (v1)

wget "https://huggingface.co/datasets/loubb/aria-midi/resolve/main/piano-medium-double-1.0.safetensors?download=true" 

You can download mp3s from youtube using yt-dlp:

yt-dlp --audio-format mp3 --extract-audio --no-playlist --audio-quality 0 <youtube-link> -o <save-path> 

You can then transcribe using the cli:

aria-amt transcribe \ medium-double \ <path-to-checkpoint> \ -load_path <path-to-audio> \ -save_dir <path-to-save-dir> \ -bs 1 \ -compile 

If you want to do batch transcription, use the -load_dir flag and adjust -bs accordingly. Compiling and may take some time, but provides a significant speedup. Quantizing (-q8 flag) further speeds up inference when the -compile flag is also used.

NOTE: Int8 quantization is only supported on GPUs that support BF16.