• About
• Project Topology
• Installation and Usage
• Authors
• Acknowledgments

• Run VOCA and synthesize a character animation given an speech signal. VOCA outputs a set meshes with .obj extension which must to be imported.
• Import the output meshes of VOCA and generate from them a single animated mesh.

For more details please see the scientific publication of the VOCA framework here.

The original VOCA framework repository can be found here here.

1. The add-on works with \Blender v2.92.0 (python 3.7) and requires some dependencies that can be installed directly from the preferences panel.
2. Download the latest release.
3. Import the downloaded .zip archive in Blender (Edit > Preferences > Add-ons > Install) and enable the add-on.
4. Install the dependencies by clicking the dedicated button
5. The add-on options are accessible in the 3D View side panel named "VOCA"
6. (optional) If you want to uninstall the addon, you can also uninstall the dependencies from the preferences panel.

1. Expand the 'Run VOCA Model' panel.
2. Select the right path for the mesh template (.ply) to animate, the audio file with the speech signal and the desired output directory.
3. Hit 'Run' and wait the end of the process.

1. Expand the 'Import Mesh' panel.
2. Select the path to the audio file and the output directory.
3. Hit 'Import' and wait.

• Hide/unhide non-VOCA meshes.
• Remove all meshes from the scene.
• Remove all non-VOCA meshes from the scene.
• Edit sequences (flame parameters: head, pose, blink)

voca-blender/
├─ voca-addon/
│  ├─ audio/
│  │  ├─ sentence20.wav
│  │  └─ test_sentence.wav
│  ├─ flame/
│  │  └─ generic_model.pkl
│  ├─ model/
│  │  └─ gstep.model.*
│  ├─ smpl_webuser/
│  │  ├─ lbs.py
│  │  ├─ posemapper.py
│  │  ├─ serialization.py
│  │  └─ verts.py
│  ├─ template/
│  │  └─ FLAME_sample.ply
│  ├─ utils/
│  |  ├─ ctypesloader.py
│  │  ├─ audio_handler.py
│  │  ├─ edit_sequences.py
│  │  └─ inference.py
│  ├─ operators.py
│  ├─ panels.py
│  └─ __init__.py
├─ install-dependencies.command
├─ install-dependencies.sh
├─ LICENSE
└─ README.md

• Conti Edoardo @edoardo-conti
• Federici Lorenzo @lorenzo-federici
• Melnic Andrian @andrian-melnic

• Computer Graphics e Multimedia Class - Professor Primo Zingaretti