I am currently working on the free and open-source VTuber software Brioche Puppet.

As a rendering engineer, the rendering is implemented by me. But the third-party libraries BulletPhysics and MeidaPipe are used for ragdoll physics and motion capture.

Brioche ANARI

• Rasterization
  • PBR (Lambert + Trowbridge Reitz)
  • Toon Shading (Celluloid Face Shadow Map (Midsagittal Plane SDF) + Three Base Color + Rim Light)
  • SSS (Skin Material | Subsurface Scattering)
  • LTC (Area Lighting | Linearly Transformed Cosine)
  • SH (Environment Lighting | Spherical Harmonics)
  • VCT (Global Illumination | Voxel Cone Tracing)
• Ray Tracing
  • ReSITR (Reservoir-Based Spatiotemporal Importance Resampling)
  • SVGF (Denoiser | Spatiotemporal Variance Guided Filtering)
  • SSS (Skin Material | Subsurface Scattering)
  • SHaRC (Spatially Hashed Radiance Cache)
• Nerual Rendering
  • NS (Nerual Shading)
  • NeRF (Neural Radiance Fields)
  • NRC (Neural Radiance Cache)

Brioche PAL

• Backend
  • Direct3D12
  • Vulkan
  • Metal

Brioche Asset Import

• Scene
  • Mesh
    • MMD (PMX)
    • glTF (glTF, glB, VRM)
  • Animation
    • MMD (VMD)
    • glTF (glTF, glB, VRMA)
• Image
  • Albedo Image
    • WebP
    • PNG
    • JPEG
    • TIFF
    • TGA
    • BMP
    • PNM
  • Illuminant Image
    • OpenEXR
    • Radiance HDR

Brioche Motion

• Motion Capture
  • Video Capture (Backend OpenCV)
  • Motion Detector (Backend MeidaPipe)
• Animation
  • IK (Inverse Kinematics)
    • Reaching IK (Target Position)
      • Two Joints IK
      • Three Joints IK
      • CCD (Cyclic Coordinate Descent) IK
      • FABRIK (Forward And Backward Reaching Inverse Kinematics)
      • Biped Foot IK
      • Quadruped Foot IK
    • Aim IK (Target Rotation)
      • Look At IK
  • Skeleton Mapper
    • Ragdoll Mapping
    • Animation Retargeting Mapping
  • Ragdoll
    • Ragdoll Kinematics Controller
    • Ragdoll Motors Controller

Brioche Physics

• Backend
  • Bullet Physics
  • Jolt Physics
• Rigid Body
  • Shape
    • Sphere
    • Box
    • Capsule
  • Motion
    • Fixed
    • Keyframe
    • Dynamic
• Constraint
  • Fixed
  • Ball and Socket
  • Hinge
  • Prismatic
  • Ragdoll
  • 6DOF