Tracking & mouth
Webcam tracking
Open Tracking ▸ Webcam and switch on Track me with the webcam. The avatar's head, face, arms and fingers follow yours. Tracking runs on your computer and nothing is sent anywhere.
- Recalibrate: look straight at the camera and press Recalibrate (or Ctrl+R). Do this whenever the avatar looks off to the side when you aren't.
- Hands and fingers and Arms and shoulders can be switched off separately. Arms track best with your elbows in view.
- Camera: pick which webcam to use. It is shared through PipeWire, so OBS can show the same webcam at the same time.
- Head direction: if turning, nodding or tilting your head moves the avatar the wrong way, flip that one.
The meters show how often the camera finds your face, hands and body. Good, even light on your face helps more than anything else.
Face tracking from a headset or another app
Tracking ▸ Headset shows what's connected.
- Pico 4 Pro, Quest Pro and other face-tracking headsets: run
oscavmgron this PC. It sends face tracking to the app on port 9000 by itself. - VSeeFace, XR Animator and other apps that send VMC: point them at this PC, port 39539.
The ports can be changed under Advanced, which also shows the live expression values for testing.
Motion and physics
Tracking ▸ Motion:
- Mirror makes the avatar move like your reflection.
- Smoothing evens out jitter. Too much makes the avatar feel slow.
- Physics moves hair, ears, tails and clothes. Lower Amount if they wobble too much; Stiffness and Bounce change how they swing. Reset physics goes back to normal.
Lip sync
Open Tracking ▸ Lip sync, pick your microphone and switch on Move the mouth when I talk. The mouth follows the vowels you say, so it uses the avatar's viseme shapes, not only open and shut.
- If the mouth moves while you're quiet (keyboard, fan), raise Ignore below.
- If it barely moves, add Mic boost.
The meter under the switch shows your level in dB and the vowel it heard.