- Run VOCA and synthesize a character animation given an speech signal. VOCA outputs a set meshes with .obj extension which must to be imported.
- Import the output meshes of VOCA and generate from them a single animated mesh.
For more details please see the scientific publication of the VOCA framework here.
The original VOCA framework repository can be found here here.
- The add-on works with \Blender v2.92.0 (python 3.7) and requires some dependencies that can be installed directly from the preferences panel.
- Download the latest release.
- Import the downloaded .zip archive in Blender (Edit > Preferences > Add-ons > Install) and enable the add-on.
- Install the dependencies by clicking the dedicated button
- The add-on options are accessible in the 3D View side panel named "VOCA"
- (optional) If you want to uninstall the addon, you can also uninstall the dependencies from the preferences panel.
- Expand the 'Run VOCA Model' panel.
- Select the right path for the mesh template (.ply) to animate, the audio file with the speech signal and the desired output directory.
- Hit 'Run' and wait the end of the process.
- Expand the 'Import Mesh' panel.
- Select the path to the audio file and the output directory.
- Hit 'Import' and wait.
- Hide/unhide non-VOCA meshes.
- Remove all meshes from the scene.
- Remove all non-VOCA meshes from the scene.
- Edit sequences (flame parameters: head, pose, blink)
voca-blender/ ├─ voca-addon/ │ ├─ audio/ │ │ ├─ sentence20.wav │ │ └─ test_sentence.wav │ ├─ flame/ │ │ └─ generic_model.pkl │ ├─ model/ │ │ └─ gstep.model.* │ ├─ smpl_webuser/ │ │ ├─ lbs.py │ │ ├─ posemapper.py │ │ ├─ serialization.py │ │ └─ verts.py │ ├─ template/ │ │ └─ FLAME_sample.ply │ ├─ utils/ │ | ├─ ctypesloader.py │ │ ├─ audio_handler.py │ │ ├─ edit_sequences.py │ │ └─ inference.py │ ├─ operators.py │ ├─ panels.py │ └─ __init__.py ├─ install-dependencies.command ├─ install-dependencies.sh ├─ LICENSE └─ README.md - Conti Edoardo @edoardo-conti
- Federici Lorenzo @lorenzo-federici
- Melnic Andrian @andrian-melnic
- Computer Graphics e Multimedia Class - Professor Primo Zingaretti







