Facial motion capture with webcam for VTuber in unity/unreal.
python
cd python_vtbfacap pip install -r requirements.txt HIDE_FACE=false python -m vtbfacap unity --> see unity_package/README.md
- obtain landmarks (mediapipe python)
- convert landmarks to blendshape data (2D) [WIP]
- convert landmarks to blendshape data (3D)
- calibration
- unity package (2D) [WIP]
- unity package (3D)
- (optional) unreal package (2D)
- unreal package (3D)
- save data sequence for replay
https://github.com/google/mediapipe
https://github.com/Kazuhito00/iris-detection-using-py-mediapipe