# Overview

<figure><img src="/files/pVCgijtdHprLOWCahJWH" alt=""><figcaption></figcaption></figure>

### The Ultimate Facial Tracking Solution

Quality and speed drive high-end production. Unify your entire pipeline—from real-time tracking and synced recording to seamless engine integration—in one powerful solution.

<figure><img src="/files/7xoxerOdKYqvioITd9qM" alt="" width="563"><figcaption></figcaption></figure>

## For an expression of consistent quality

Create facial expressions of consistent quality more easily and conveniently with Yanus Face.

<figure><img src="/files/X4Y2fESMC8JAlf7iNaIs" alt="" width="563"><figcaption></figcaption></figure>

## Live facial motion capture, recording, calibration and streaming software

<figure><img src="/files/JiJ9KhVEF24V14vSoZjA" alt=""><figcaption></figcaption></figure>

## Automatically calculate and apply facial motion capture data in Maya and support quick editing

<div align="left"><figure><img src="/files/so42yD4MWQ29vj4Kxpis" alt=""><figcaption></figcaption></figure></div>


# Welcome

"Why? Does the facial quality not come out well?"

## The difficulty of facial motion capture

​"The most difficult part of motion capture is face capture. High-level technology and sophisticated algorithms are required to accurately capture various expressions and movements of the face. Because the face has many changes in expression and movement at various angles, this “Accurately tracking and capturing this is an even more difficult challenge. This is a critical part of improving user experience and expressiveness, and is one of the areas in need of more research and technology development.”

## YANUS STUDIO is ready.

"Yanus Studio is a company that can effectively solve difficult face capture problems through advanced technology and innovative algorithms. YANUS STUDIO facial motion capture technology not only accurately tracks and captures various facial expressions and movements at angles, but also captures the user's facial expressions. "We can help you elevate your experience and enhance your expressive power. Through continuous research and innovation, Yanus Studio's experts overcome the challenges of facial capture and deliver top-notch results."

## For everyone to produce facials of consistent quality.

Yanus STUDIO is a facial motion capture solutions provider comprised of experts with over 20 years of experience. Our facial motion capture hardware can generate infinite motions and apply personalized styles to the generated motions. It's also designed to make creative production easier and faster, providing peace of mind to anyone working in 3D animation and game development.


# YanusLIVE PRO

Real-time multi-camera facial tracking, recording, playback, and streaming for Windows.

YANUS LIVE PRO is a Windows application for real-time facial performance capture.

Run up to four camera slots in parallel. Each slot holds its source, profile, calibration, tracking state, and settings.

The tracking pipeline uses NVIDIA Maxine AR and outputs 53 ARKit blendshape channels. Record synchronized facial data, WAV audio, and H.264 video. Stream facial motion through LiveLink or OSC.

### Start here

Use this sequence for a routine capture:

1. Choose a one-to-four-camera layout and select a slot.
2. Select **Camera**, choose a device, then select **Connect**.
3. Verify tracking and run QuickN or ROM when required.
4. In **LIVE** mode, press `Space` to start and stop recording.
5. Load the take in Session Browser, then press `Q` for **EDIT** review.
6. Enable LiveLink or OSC when an external destination is required.

Before recording, confirm that required slots show **Connected** and **Ready to record**. Do not record while a slot shows **Degraded**.

{% hint style="info" %}
`Space` starts or stops recording in **LIVE** mode. In **EDIT** mode, it controls synchronized playback.
{% endhint %}

### Core capabilities

* **Multi-camera capture** — Assign, configure, calibrate, and reconnect up to four independent camera slots.
* **Tracking and calibration** — Track face, landmarks, head motion, and expressions. Use QuickN, ROM, or FixONE calibration.
* **Recording and review** — Save synchronized takes and inspect them with frame-accurate EDIT playback.
* **Production streaming** — Send facial animation to Unreal Engine through LiveLink or to OSC consumers such as Blender.

### Documentation guide

* [Installation](/yanuslive-pro/installation) — Prepare the workstation, GPU, drivers, and firewall.
* [UI PANES](/yanuslive-pro/ui-panes) — Find camera, session, streaming, and filter controls.
* [SETTINGS](/yanuslive-pro/settings) — Configure camera, tracking, recording, audio, streaming, and layout behavior.
* [MENU / WINDOWS](/yanuslive-pro/menu-windows) — Control menus, pane visibility, layouts, and device refresh.
* [FUNCTION GUIDE](/yanuslive-pro/function-guide) — Follow capture, playback, streaming, and troubleshooting workflows.
* [Summary of Features](/yanuslive-pro/summary-of-features) — Review product capabilities and supported workflows.


# Installation

Install, launch, and prepare YanusLIVE Pro.

This section covers installation, first launch, and setup.

* [System Requirements](/yanuslive-pro/installation/system-requirements)
* [Installing from Release Package](broken://spaces/aCVNsar8ZEfoLG1XkC2o/pages/YxBMwiTxdvVP5el0Zuv1)
* [First Launch](/yanuslive-pro/installation/first-launch)
* [GPU and Driver Setup](/yanuslive-pro/installation/gpu-and-driver-setup)
* [Firewall Setup](/yanuslive-pro/installation/firewall-setup)
* [Development Build](broken://spaces/aCVNsar8ZEfoLG1XkC2o/pages/NdYg8Ydi6RrxuG8a7UdR)


# System Requirements

YanusLIVE Pro runs on Windows and relies on NVIDIA GPU acceleration.

### Minimum requirements

| Component              | Requirement                         |
| ---------------------- | ----------------------------------- |
| Operating system       | Windows 10 or Windows 11, 64-bit    |
| GPU                    | NVIDIA GPU                          |
| NVIDIA driver          | R520 or newer                       |
| GPU compute capability | 7.5 or higher recommended           |
| Storage location       | User-writable folder                |
| Display                | Standard desktop display            |
| Camera                 | USB or supported video input device |

### Recommended requirements

| Component | Recommendation              |
| --------- | --------------------------- |
| GPU       | NVIDIA RTX series           |
| Driver    | Latest stable NVIDIA driver |
| CPU       | Modern multi-core CPU       |
| Memory    | 16 GB or more               |
| Storage   | SSD                         |
| Camera    | Stable high-FPS camera      |

### Notes

Systems without a supported NVIDIA GPU may not run the tracking pipeline.


# First Launch

The first launch can take longer than later launches.

The application may need to initialize runtime components and build GPU-related cache files.

### First launch checklist

* Confirm that the application folder is fully extracted.
* Confirm that the assets folder is present.
* Confirm that model files are present.
* Confirm that the NVIDIA GPU is active.
* Confirm that the NVIDIA driver is installed.
* Allow firewall access if prompted.
* Wait for first-time initialization to finish.

### SmartScreen notice

Windows SmartScreen may warn on internal or unsigned builds.

Only run the application if the package comes from a trusted source.


# GPU and Driver Setup

YanusLIVE Pro requires a compatible NVIDIA GPU and driver.

GPU compatibility is critical for real-time tracking and model execution.

### Requirements

* NVIDIA driver R520 or newer
* GPU compute capability 7.5 or higher
* Correct model bundle included with the application
* High-performance NVIDIA GPU selected on hybrid laptops

### Laptop users

On dual-GPU laptops, force YanusLIVE Pro to use the high-performance NVIDIA GPU in Windows Graphics Settings or NVIDIA Control Panel.

### Troubleshooting

* Update the NVIDIA driver.
* Confirm that the system has a supported NVIDIA GPU.
* Check whether model files are included.
* Review the runtime log.
* Avoid running on the integrated GPU.


# Firewall Setup

Firewall settings matter when YanusLIVE Pro sends or receives real-time data.

### Default ports

| Function         | Direction | Port      |
| ---------------- | --------- | --------- |
| LiveLink Send    | Outbound  | UDP 11111 |
| LiveLink Receive | Inbound   | UDP 11112 |

### Setup steps

1. Open Windows Security.
2. Go to **Firewall & network protection**.
3. Allow YanusLIVE Pro through the firewall.
4. Confirm that the receiving application uses the same port.
5. Confirm that both applications are on the same network when they run on different machines.

### Notes

If streaming works locally but not across machines, check the router, subnet, firewall, and target IP address.


# MENU / WINDOWS

Menus and workspace layout controls in YanusLIVE Pro.

Use this section to control menus, camera layouts, panes, and device discovery.

Use **Reset Layout** to restore the workspace. Use **Reset Settings** only to restore deployment defaults.

<figure><img src="/files/fkVmH4cl9gzWCaOKqnXS" alt=""><figcaption></figcaption></figure>

* [Hamburger Menu](/yanuslive-pro/menu-windows/hamburger-menu)


# Hamburger Menu

Main control menu for application-wide actions in YanusLIVE Pro.

The hamburger menu in the top-left corner is the main control menu in YanusLIVE Pro.

It gives quick access to app-wide actions:

* File control
* Camera view visibility
* Panel visibility
* Layout selection
* Device refresh
* License information

The menu has five sections:

* File
* View
* Layout
* Device
* Help

### File

#### Exit

Closes the application.

Expected behavior:

* Shuts down the app
* Releases connected cameras or devices
* Stops active streaming or recording safely when needed

### View

The **View** menu controls visible camera views and panels.

#### Show All Cameras

Shows all available camera views.

Expected camera views:

* Camera 0
* Camera 1
* Camera 2
* Camera 3

#### Hide All Cameras

Hides all camera views in the workspace.

This action does not always disconnect cameras. It usually changes panel visibility only.

#### Camera 0 to Camera 3

Each item toggles one camera panel.

If a camera item shows a yellow dot, that camera is visible.

Example:

```
Camera 0 ●
```

#### Property

Toggles the **Property** panel.

Use this panel for detailed settings and status for the selected camera, tracking state, device state, or session.

A yellow dot means the panel is visible.

#### Streaming

Toggles the **Streaming** panel.

Use this panel for LiveLink, network streaming, external connections, or real-time output control.

A yellow dot means the panel is visible.

#### Filter Tuning

Toggles the **Filter Tuning** panel.

This panel controls tracking signal filtering, including:

* SDK filtering
* Landmark smoothing
* OneEuro or Butterworth filters
* Mouth latency, deadband, and pose smoothing

A yellow dot means the panel is visible.

#### Global Control

Toggles the **Global Control** panel.

This panel is expected to control app-wide operations, including:

* Start or stop all cameras
* Start or stop recording
* Start or stop streaming
* Check global tracking and system status

A yellow dot means the panel is visible.

#### Session Browser

Toggles the **Session Browser** panel.

Use this panel to browse, select, and manage recorded sessions.

A yellow dot means the panel is visible.

### Layout

The **Layout** menu controls how many camera views appear in the workspace.

#### 1 Camera

Shows one camera view.

Use this layout when focusing on a single source.

#### 2 Cameras

Shows two camera views.

Use this layout to compare angles, such as front and side views.

#### 3 Cameras

Shows three camera views at once.

#### 4 Cameras

Shows four camera views.

Use this layout for full multi-camera monitoring.

#### Reset Layout

Restores the default workspace layout.

Use this when:

* Panels are misplaced
* Camera views are hidden
* The workspace becomes hard to manage
* You want the default screen setup back

### Device

#### Refresh Devices

Rescans connected capture devices.

Expected behavior:

* Detects newly connected cameras
* Updates the camera list
* Recovers disconnected devices
* Refreshes USB or video input status

Use this when a connected camera does not appear in the app.

### Help

#### License

Opens license information.

Expected contents:

* License status
* Activation details
* Permission state
* Version or license key details

### Yellow dot indicator

A yellow dot on the right side of a menu item means that item is active or visible.

In the captured example, these items are active:

* Camera 0
* Property
* Streaming
* Filter Tuning
* Global Control
* Session Browser

This means the workspace currently shows **Camera 0** and the main control panels.

### Summary

The hamburger menu is the global UI and device control menu in YanusLIVE Pro.

Its main roles are:

* Exit the application
* Show or hide camera panels
* Show or hide tool panels
* Switch layout presets
* Reset the workspace layout
* Refresh connected devices
* Open license information

From a development perspective, this menu acts as a central controller for:

* Docking panels
* Camera views
* Layout presets
* Device refresh
* Global application commands


# UI PANES

Overview of the main interface panels in YanusLIVE Pro.

<figure><img src="/files/WCh1eQ5imdYx5DKkCYOK" alt=""><figcaption></figcaption></figure>

Use these panels during capture, review, filter tuning, and streaming.

The selected camera slot controls per-camera source, profile, calibration, and hardware settings.

* [Camera Source Panel](/yanuslive-pro/ui-panes/camera-source-panel)
* [Face / 3D View Panel](/yanuslive-pro/ui-panes/face-3d-view-panel)
* [Recording Panel](/yanuslive-pro/ui-panes/recording-panel)
* [Session Panel](/yanuslive-pro/ui-panes/session-panel)
* [Playback Panel](broken://spaces/aCVNsar8ZEfoLG1XkC2o/pages/tOe2yumRLvV3lHDQaBHU)
* [Property (Blendshape panel)](/yanuslive-pro/ui-panes/property-blendshape-panel)
* [Filter Tuning Panel](/yanuslive-pro/ui-panes/filter-tuning-panel)
* [Streaming Panel](/yanuslive-pro/ui-panes/streaming-panel)


# Camera Source Panel

The Camera Source Panel configures one camera slot at a time.

<figure><img src="/files/EAXkpuLjxQ7SXCReqDx8" alt="" width="296"><figcaption></figcaption></figure>

Each physical device can belong to only one slot.

### Connect a live camera

1. Select a camera slot and set **Source Mode** to **Camera**.
2. Select a physical device and select **Connect**.
3. Wait for **Connected** status.
4. Set **Rotation** when the head-mounted view is not upright.
5. Choose the matching **Camera Profile**.

For Headcam profiles, start with **1280x960 @ 60fps MJPG (Recommended)**.

Use **Configure Device...** only for connected-camera hardware properties.

### Profiles and source modes

Use **Camera** for live capture. Use **File** for stored video.

Supported profiles include **Existing Default Camera**, **Rokoko Headcam**, **BUNSHIN Headcam**, **Generic UVC Headcam**, and **BUNSHIN SDI (DeckLink)**.

For BUNSHIN SDI, resolution and frame rate follow the incoming signal.

### Connection states

* **Connected** — The slot is ready for tracking and recording.
* **Connecting...** or **Reconnecting...** — Wait for the connection to complete.
* **Degraded** — Stabilize the connection before recording.
* **Device not found** or **Disconnected** — Refresh devices, reselect the device, and reconnect.

### Calibration

Use **QuickN** to capture a neutral expression. Use **ROM** for full range-of-motion calibration.

Use **FixONE** to recalibrate one expression after QuickN or ROM establishes a neutral.


# Face / 3D View Panel

The Face / 3D View Panel shows real-time tracking results as a 3D view.

Use it to confirm that face pose, landmarks, and expressions are interpreted correctly.

<figure><img src="/files/T8adDQ23IzZF9mk4716b" alt="" width="375"><figcaption></figcaption></figure>

### What you can do

* View the tracked face in 3D.
* Check facial motion in real time.
* Confirm that the face model loads correctly.
* Inspect expression response visually.
* Detect unstable pose or missing face detection.

### Typical workflow

1. Start a camera stream in the Camera Source Panel.
2. Open the Face / 3D View Panel.
3. Confirm that the 3D face appears.
4. Move naturally and check whether the model follows.
5. Test jaw, smile, blink, and brow motion.
6. Adjust tracking or camera settings if output is unstable.

### Notes

If the 3D face does not appear, check that the required model files are included.

Unsupported GPU setups can also block face view initialization.


# Recording Panel

The Recording Panel controls session capture in YanusLIVE Pro.

A take can include facial tracking CSV data, WAV audio, H.264 video, and a session manifest.

<figure><img src="/files/QhVcUZpA7p4F12NCyBui" alt=""><figcaption></figcaption></figure>

### Record a take

1. Confirm required slots show **Connected** and **Ready to record**.
2. In **LIVE** mode, select **Record** or press `Space`.
3. Monitor the **REC** indicator and elapsed time.
4. Select **Record** again or press `Space` to stop.
5. Load the take from Session Browser for EDIT review.

### Monitor recording health

Review current FPS, capture time, Maxine processing time, record time, and slow-write count.

Record time is flagged **WARN** above 10 ms and **SLOW** above 15 ms.

{% hint style="warning" %}
Do not begin a critical take when any required slot shows **Degraded**.
{% endhint %}


# Property (Blendshape panel)

The Property panel shows the selected slot's blendshape values and controls.

Use it to tune expression response and reduce unwanted jitter.

<figure><img src="/files/AgXLndpf2WQ5s8ltGqUB" alt=""><figcaption></figcaption></figure>

### Use the panel

Use it to verify face and expression response before recording or streaming.

Use **QuickN** to capture a neutral reference. Use **ROM** for full expression calibration.

Use **FixONE** to recalibrate one expression after a valid neutral exists.

### Related tuning

Use [Filter Tuning Panel](/yanuslive-pro/ui-panes/filter-tuning-panel) for response, stability, SDK smoothing, and filter resets.

Calibration requires active tracking. It is unavailable while **Skip Tracking** is active.


# Session Panel

The Session Panel manages recorded facial-capture sessions in YanusLIVE Pro.

It scans the selected recordings folder and lists the sessions it finds.

<figure><img src="/files/DKpxE6urkgAXHmOkCLQo" alt="" width="375"><figcaption></figcaption></figure>

```
C:\Users\Yanus4\Documents\MultiExpression\recordings
```

Example session folders:

```
MultiFaces
Smin
KHong
```

### What the list shows

Each row shows session name, duration, frame rate, V/A/B indicators, validation status, and the **Current** marker.

### Status indicators

`V A B` identifies the recorded assets in the session:

```
V = Video files exist
A = Audio files exist
B = Blendshape or animation data exists
```

`Current` marks the active session.

### Buttons

* **Open Folder** opens the recordings folder in Windows Explorer.
* **Change Folder...** changes the base folder used for session discovery.
* **Refresh** rescans the folder.
* **Load Selected** loads the selected take.
* Double-click a session to load it immediately.

The session list is cached.

Press **Refresh** after external file changes.

Right-click a session to rename its folder or move it to the Windows Recycle Bin.

### Review a take

Load the session, then press `Q` to enter **EDIT** mode.

Use `Left` and `Right` to step one frame. Use `Shift` with either key to step ten frames.


# Streaming Panel

The Streaming Panel manages LiveLink output.

<figure><img src="/files/GTbYD366FECbWSMh4cmM" alt=""><figcaption></figcaption></figure>

### Configure LiveLink

Set the target destination, verify resolution, then enable LiveLink.

Confirm sending and target status before a performance.

LiveLink uses UDP `11112` by default.


# Filter Tuning Panel

The Filter Tuning Panel balances expression response and motion stability.

<figure><img src="/files/yRPLhYzAvXpxph80Hnxg" alt=""><figcaption></figcaption></figure>

### Primary operator controls

* **Mouth Response** increases mouth speed at higher values.
* **Mouth Stability** increases deadband at higher values.
* **Jaw Response** increases jaw landmark speed at higher values.

### Built-in smoothing

Control NVIDIA SDK temporal smoothing for **Face Position**, **Face Landmarks**, **Head Motion**, **Facial Expressions**, and **Eye Gaze**.

Disabling **Facial Expressions** smoothing gives the fastest mouth response. Check stability before capture.

### Advanced filters and resets

Advanced App Filters include OneEuro, Butterworth, predictive interpolation, landmark smoothing, distance adaptation, jaw and mouth compensation, and LiveLink tuning.

Use **Bypass App Filters (Raw)** to compare raw and filtered output.

Use **Flush Filter State** to clear temporal history without changing parameters.

Use the slot and filter reset controls to restore known defaults.

{% hint style="info" %}
Change advanced filters only in a controlled tuning session.
{% endhint %}


# SETTINGS

Configuration options for YanusLIVE Pro.

Configure the selected camera slot, tracking response, recording, streaming, and workspace behavior here.

Start with the default settings. Change advanced filters only during controlled tuning.

* [Camera Settings](/yanuslive-pro/settings/camera-settings)
* [Tracking Settings](/yanuslive-pro/settings/tracking-settings)
* [Recording Settings](/yanuslive-pro/settings/recording-settings)
* [Streaming Settings](/yanuslive-pro/settings/streaming-settings)
* [Audio Settings](/yanuslive-pro/settings/audio-settings)
* [Layout Settings](/yanuslive-pro/settings/layout-settings)


# Camera Settings

Camera Settings control how YanusLIVE Pro detects, opens, and processes camera inputs.

These settings matter for stable real-time tracking.

### Camera source setup

1. Select the camera slot and set **Source Mode** to **Camera**.
2. Select a device, then select **Connect**.
3. Set **Rotation** and the matching **Camera Profile**.
4. Confirm **Connected** before tracking or recording.

One physical device can belong to only one camera slot.

### Profiles and formats

Use **Existing Default Camera** for the default path. Use a Headcam profile for Rokoko, BUNSHIN, or generic UVC hardware.

For Headcam profiles, start with **1280x960 @ 60fps MJPG (Recommended)**.

Available Headcam backends are **Auto**, **Media Foundation**, and **DirectShow**. Available formats are **Auto**, **MJPG**, and **YUY2**.

For **BUNSHIN SDI (DeckLink)**, the incoming SDI source determines resolution and frame rate.

### Rotation and hardware

Set **None (0 deg)** for normal landscape orientation. Use **90 deg CW**, **90 deg CCW**, or **180 deg** when required.

Select **Configure Device...** only while the camera is connected.


# Tracking Settings

Tracking Settings control response, stability, smoothing, and calibration for the selected slot.

### Primary controls

* **Mouth Response** increases mouth speed at higher values.
* **Mouth Stability** adds deadband at higher values.
* **Jaw Response** increases jaw landmark speed at higher values.

### SDK smoothing

Enable smoothing by feature: **Face Position**, **Face Landmarks**, **Head Motion**, **Facial Expressions**, and **Eye Gaze**.

Disable **Facial Expressions** smoothing for the fastest mouth response. Confirm that resulting motion remains stable.

### Calibration

Use **QuickN** for a neutral reference. Use **ROM** for full expression range calibration.

Use **FixONE** only after QuickN or ROM establishes a shared neutral. Calibration requires active tracking and is unavailable with **Skip Tracking** enabled.


# Recording Settings

Recording Settings define where takes are stored and how their assets are reviewed.

### Recorded take contents

A take can contain facial tracking CSV data, WAV audio, H.264 video, and a session manifest.

Session Browser shows **V**, **A**, and **B** when video, audio, and blendshape data exist.

### Recording health

Monitor FPS, capture time, Maxine processing time, record time, and slow-write count during capture.

Record time reports **WARN** above 10 ms and **SLOW** above 15 ms.


# Streaming Settings

Streaming Settings control real-time facial data output and facility integrations.

### Outputs

* **LiveLink** sends facial animation to Unreal Engine over UDP port `11112`.

### Verify the destination

Confirm the target address, protocol, port, enabled state, and packet activity before a performance.


# Audio Settings

Audio Settings control local microphone input and audio monitoring.

Use audio for recording and input-level monitoring.

### Common options

* Microphone device selection
* Input level monitoring
* Audio recording enable or disable
* Sample rate
* Channel mode

### Recommended usage

Check microphone input before recording.


# Layout Settings

Layout Settings control camera layouts and supporting-pane visibility.

### Camera layouts

Select layouts for **1**, **2**, **3**, or **4 Cameras**. Press `1`–`4` for the same presets when no text field is active.

Use **View** or the Top Bar to show or hide camera windows, Property, Streaming, Filter Tuning, Global Control, and Session Browser.

### Recover the workspace

Use **Reset Layout** or **Reset Panes** when panes move or close unexpectedly.

Use **Reset Settings** only when persisted configuration must return to deployment defaults.


# FUNCTION GUIDE

Practical guides for core YanusLIVE Pro workflows.

Follow these procedures for capture, calibration, review, external streaming, and recovery.

* [Basic Workflow](/yanuslive-pro/function-guide/basic-workflow)
* [Real-Time Face Tracking](/yanuslive-pro/function-guide/real-time-face-tracking)
* [Recording and Playback](/yanuslive-pro/function-guide/recording-and-playback)
* [LiveLink Streaming](/yanuslive-pro/function-guide/livelink-streaming)
* [Troubleshooting Workflow](/yanuslive-pro/function-guide/troubleshooting-workflow)


# Basic Workflow

This page explains the standard workflow from startup to live tracking, recording, or streaming.

### Workflow

1. Choose a one-to-four-camera layout and select a slot.
2. Set **Source Mode** to **Camera**, select a device, and select **Connect**.
3. Confirm orientation and tracking. Run QuickN or ROM when required.
4. In **LIVE** mode, press `Space` to start and stop the take.
5. Load the take in Session Browser and press `Q` for **EDIT** review.
6. Enable LiveLink or OSC when an external destination is required.

### Recommended first test

* Confirm **Connected** and **Ready to record**.
* Confirm the face is upright and tracking responds as expected.
* Do not record if a required slot is **Degraded**.


# Real-Time Face Tracking

Real-time face tracking is the core function of YanusLIVE Pro.

The application detects the face, estimates landmarks, tracks head pose, and converts motion into animation-friendly data.

### Good tracking conditions

* Keep the face clearly visible.
* Use stable lighting.
* Keep the camera steady.
* Avoid heavy occlusion.
* Stay within the expected tracking distance.

### Common tracking issues

| Issue                | Possible cause                                            |
| -------------------- | --------------------------------------------------------- |
| Face not detected    | Camera inactive, face outside the frame, or poor lighting |
| Jittery motion       | Low light, camera noise, or low smoothing                 |
| Delayed response     | Too much smoothing                                        |
| Incorrect expression | Camera angle, occlusion, or poor calibration              |
| Tracking reset       | Face lost or confidence too low                           |

### Best practice

Always confirm tracking quality visually before recording or streaming.


# Recording and Playback

Recording and Playback let you capture facial performance data and review it later.

### Recording workflow

1. Confirm required live slots show **Connected** and **Ready to record**.
2. In **LIVE** mode, select **Record** or press `Space`.
3. Monitor the **REC** indicator and elapsed time.
4. Select **Record** again or press `Space` to stop.
5. Open Session Browser and load the take.

### Playback workflow

1. Press `Q` to enter **EDIT** mode.
2. Press `Space` to play or pause synchronized playback.
3. Use `Left` or `Right` to step one frame.
4. Use `Shift` with either key to step ten frames.
5. Set play-range points with `I` and `O`.

### Recommended checks

* Confirm V, A, and B indicators match the expected take contents.
* Check face motion, expression response, audio, and video alignment.
* Confirm the session loads without validation issues.


# LiveLink Streaming

YANUS LIVE PRO streams facial animation through LiveLink.

### LiveLink workflow

1. Open the Streaming Panel and configure the target network destination.
2. Confirm that the target is resolved.
3. Enable LiveLink and confirm sending status.
4. Verify motion in Unreal Engine.

LiveLink uses UDP port `11112` by default.

### Troubleshooting

* Check destination host, protocol, and port.
* Confirm the streaming panel reports activity.
* Check the firewall and receiving application.


# Troubleshooting Workflow

This page provides a basic order for troubleshooting common problems.

### Recommended troubleshooting order

1. Check whether the application starts correctly.
2. Check whether the camera is detected.
3. Check whether the face is visible in the camera frame.
4. Check whether the 3D face view is active.
5. Check whether model files are present.
6. Check GPU and driver compatibility.
7. Check recording output files.
8. Check network ports for streaming.
9. Check application logs.

### Important logs

| Log                  | Description                  |
| -------------------- | ---------------------------- |
| Runtime log          | Current session runtime log  |
| Previous session log | Previous session runtime log |

### Support checklist

When you report an issue, include:

* Application version
* Windows version
* GPU model
* NVIDIA driver version
* Camera model
* Steps to reproduce
* Runtime log and previous session log
* Screenshots or recordings if available


# Production Workflow Manual

End-to-end workflow for YanusLIVE PRO facial capture sessions.

YanusLIVE PRO supports real-time facial capture for head-mounted and multi-camera production. Use this workflow to prepare, capture, validate, deliver, and archive each session.

### Production sequence

1. Prepare the workstation.
2. Connect cameras and microphones.
3. Configure camera slots.
4. Position the head-mounted camera (HMC).
5. Verify tracking and run neutral calibration.
6. Connect Unreal Engine and tune filters.
7. Record and validate a test.
8. Record the production take.
9. Select and deliver the final track.
10. Archive the complete session.

### 1. Prepare the system

#### Recommended hardware

* Windows 10 or Windows 11, 64-bit
* NVIDIA RTX GPU with Compute Capability 7.5 or later
* NVIDIA R520 driver or later
* SSD storage for video and session recording
* Sufficient USB bandwidth for every camera
* A supported UVC or head-mounted camera
* One or more microphones

#### Capture environment

Use stable, even facial lighting. Avoid strong backlighting and eye reflections. Secure every camera mount. Use wired networking for remote Unreal Engine streaming.

{% hint style="warning" %}
High-resolution cameras use significant USB bandwidth. Do not connect all cameras through one unpowered hub.
{% endhint %}

#### Launch checks

Launch YanusLIVE PRO before opening the Unreal Engine project. On startup, verify GPU and driver compatibility, runtime libraries, Maxine models, cameras, microphones, and configuration.

The first launch on a GPU may build a TensorRT cache. Later launches use this cache.

Do not start production when tracking initialization fails.

### 2. Configure cameras and microphones

Each camera slot uses an independent camera and tracking pipeline.

| Slot     | Recommended role               |
| -------- | ------------------------------ |
| Camera 0 | Primary front-facing HMC       |
| Camera 1 | Left-side or backup camera     |
| Camera 2 | Right-side or backup camera    |
| Camera 3 | Reference or diagnostic camera |

#### HMC starting settings

Start supported UVC HMCs with these settings:

* Resolution: `1280 × 960`
* Frame rate: `60 fps`
* Format: `MJPG`
* Preferred backend: Media Foundation
* Fallback backend: DirectShow

Use `1024 × 768 @ 60 fps`, `1600 × 1200 @ 60 fps`, or `1280 × 960 @ 30 fps` when required.

#### Connect a camera

1. Connect the camera.
2. Open the **Camera Source Panel**.
3. Select the target camera slot and device.
4. Choose the camera profile, resolution, and frame rate.
5. Start the camera and confirm its live preview.
6. Verify the actual resolution and frame rate.

{% hint style="info" %}
The active camera mode may differ from the requested mode. Always verify the actual mode after opening the camera.
{% endhint %}

If a camera is missing, refresh devices, reconnect it, try another USB port, or restart YanusLIVE PRO. For black frames, change between Media Foundation and DirectShow. Close other applications using the device.

If frame rate is low, use MJPG, reduce resolution, and distribute cameras across USB controllers.

#### Configure microphones

Associate each camera with its microphone. Select a primary microphone for the main playback track.

1. Open the audio input panel.
2. Select each camera's mapped microphone.
3. Select the primary microphone.
4. Speak at normal performance volume.
5. Confirm active, non-clipping input levels.
6. Record a short audio test.

Additional mappings may record camera-specific WAV files.

### 3. Position and verify the HMC

Position the HMC about 15 cm from the performer's face. Frame both eyes, eyebrows, mouth, chin, jawline, and both sides of the face.

Avoid cropped eyebrows or chin, mouth obstruction, edge distortion, and changing camera distance. Illuminate both face sides. Keep lip boundaries visible. Lock exposure and white balance after establishing correct values.

#### Verify tracking

Confirm stable face detection, landmarks, pose, blink detection, mouth and jaw response, and acceptable latency. Then have the performer complete this test:

1. Hold neutral, then blink both eyes and each eye separately.
2. Raise eyebrows, smile, open the mouth, pucker, and puff cheeks.
3. Turn the head, then look up and down.

Do not calibrate until tracking is stable.

### 4. Run neutral calibration

Neutral calibration removes each performer's natural resting offsets. It prevents apparent open mouths, partial blinks, or smiles at rest.

Ask the performer to look forward with a relaxed jaw, naturally closed lips, relaxed brows, naturally open eyes, and no movement.

1. Select the camera slot.
2. Confirm the neutral pose.
3. Start **Neutral Calibration**.
4. Maintain the pose until calibration completes.
5. Verify the corrected output.
6. Repeat for other slots when needed.

Calibration typically captures about 60 neutral frames. In neutral, jaw open, smile, frown, blink, brow raise, mouth stretch, and cheek values should be near zero.

Recalibrate after a performer, camera position, camera distance, lighting, or camera profile change.

{% hint style="warning" %}
Do not calibrate while the performer speaks, smiles, blinks, or adjusts the HMC.
{% endhint %}

### 5. Connect Unreal Engine

YanusLIVE PRO streams through a Live Link-compatible workflow.

1. Open the Unreal Engine project.
2. Enable the required Live Link plugins.
3. Open the **Live Link** window.
4. Prepare the MetaHuman or ARKit-compatible character.
5. Enable streaming in YanusLIVE PRO.
6. Enter the destination IP address and port.
7. Start transmission and confirm the YanusLIVE subject.
8. Assign the subject and verify character response.

For separate workstations, use wired Ethernet on the same network. Allow both applications through Windows Firewall. Avoid Wi-Fi when latency matters.

Compare the performer, YanusLIVE PRO preview, and Unreal character. Verify neutral alignment, blinks, jaw range, smile symmetry, brows, lips, head rotation, and latency.

### 6. Tune tracking and filters

Stronger filtering improves stability but can increase latency. Weaker filtering improves responsiveness but can increase jitter.

For noisy animation, increase landmark or blendshape smoothing. Improve lighting, camera stability, and frame rate. Keep the face away from image edges.

For slow animation, reduce blendshape and pose smoothing. Use a responsive preset. Check for stacked filters, low camera frame rate, and network buffering.

If the mouth opens during head tilt, tune dynamic compensation for head pitch, jaw opening, mouth closing, and camera distance. Evaluate tuning while the performer speaks and moves naturally.

### 7. Test and record

#### Run a pre-capture test

Record a 10–20 second test with neutral expression, normal and fast speech, blinks, smiles, mouth opening, head rotation, pitch, and strong expressions.

Review video frame rate, audio, detection stability, blendshape response, latency, jaw confidence, jitter, hold rate, duplicate frames, and audio-video synchronization. Correct issues before production.

#### Record a take

1. Confirm active cameras and microphones.
2. Confirm Unreal Engine receives the stream.
3. Confirm calibration and free storage space.
4. Start recording and record a spoken or visual slate.
5. Hold neutral for one second before and after the performance.
6. Stop recording and wait for files to finalize.
7. Review the session immediately.

{% hint style="warning" %}
Do not disconnect cameras or microphones during recording.
{% endhint %}

### 8. Validate the session

A session directory may contain the following files:

```
recordings/
└── session_YYYYMMDD_HHMMSS/
    ├── animation_frames.csv
    ├── session.json
    ├── cam0.mp4
    ├── cam0.wav
    ├── cam0.csv
    └── cam0.metrics.csv
```

`animation_frames.csv` is the master facial animation track. `session.json` stores session metadata. `camN.mp4` provides source video. `camN.wav` provides mapped audio. `camN.csv` provides per-camera animation. `camN.metrics.csv` provides quality metrics.

Verify that the manifest, master CSV, primary WAV, camera CSVs, and metrics files exist. Confirm the WAV duration exceeds zero. Open each MP4. Confirm the session is not marked aborted.

Play the session in YanusLIVE PRO. Verify video, audio, animation, duration, synchronization, expression quality, and head pose. Review for frozen motion, spikes, excessive jaw jitter, unstable eyes, long holds, duplicate frames, drops, incorrect neutral pose, and latency.

### 9. Select the final track

Use `animation_frames.csv` when the master result is stable and fast delivery matters. Use `camN.csv` when one camera produces better eyes, mouth, or stability.

For every candidate camera, review source video, animation, and metrics. Compare jaw confidence, eye and mouth tracking, latency, and jitter. Advanced processing can combine channels from multiple camera tracks.

### 10. Deliver animation

#### Unreal Engine

Deliver the selected CSV, matching WAV, reference MP4 when needed, and `session.json`. Confirm sequence frame rate, CSV timecode, animation start frame, ARKit mapping, reference alignment, and final audio synchronization.

#### Maya and Blender

Deliver an ARKit-compatible CSV, matching WAV and MP4, plus session frame rate and timecode. Import the CSV into the facial rig scene. Set the frame rate. Align the first animation frame. Compare with the reference before curve cleanup and export.

### 11. Archive the complete session

Keep the master track, manifest, all camera videos, all WAV files, per-camera CSVs, metrics, calibration files, production notes, and performer and take identifiers.

Complete archives support reprocessing, camera comparison, curve rebuilds, diagnostics, quality reports, datasets, and reference reuse.

Use this naming pattern:

```
PROJECT_PERFORMER_SCENE_TAKE_DATE
```

Example:

```
ProjectA_Performer01_Scene012_Take003_20260722
```

### Production checklist

#### Before the session

* [ ] Verify GPU, driver, storage, cameras, microphones, and network.
* [ ] Confirm YanusLIVE PRO launches without compatibility errors.
* [ ] Prepare the Unreal Engine project.

#### Before recording

* [ ] Verify actual camera resolution and frame rate.
* [ ] Confirm stable framing, exposure, lighting, and HMC mounting.
* [ ] Complete and verify neutral calibration.
* [ ] Confirm audio mappings, primary microphone, and levels.
* [ ] Review a successful test recording.

#### After each take

* [ ] Confirm recording finalized normally.
* [ ] Verify files, audio duration, animation frames, and playable video.
* [ ] Review synchronization and performance quality.
* [ ] Approve the take or mark it for retake.

#### Before delivery

* [ ] Select the final animation track and matching media.
* [ ] Confirm frame rate, timecode, and DCC or Unreal import.
* [ ] Archive the complete original session.

### Troubleshooting

#### Tracking is unstable

Check lighting, focus, exposure, framing, HMC movement, frame rate, smoothing, and USB bandwidth.

#### Character is not neutral

Repeat calibration with a relaxed performer. Confirm the correct camera slot and character-side offsets.

#### Expressions are weak or noisy

Reduce excessive smoothing for weak output. Increase smoothing for noise. Check exposure, HMC vibration, tracking loss, and rig mapping.

#### Unreal Engine receives no data

Confirm destination IP, streaming status, firewall access, Live Link source, network, and port availability.

#### Audio has zero duration

Confirm microphone activity, camera mapping, primary microphone selection, and recording finalization. Record a new test.

#### Video frame rate is low

Use MJPG, reduce resolution or camera count, use separate USB controllers, and close other camera applications.


# Autodesk MotionBuilder Plugin

Preview, record, analyze, and bake YanusLIVE PRO facial data in MotionBuilder with YanusLink.

## YanusLink for Autodesk MotionBuilder

YanusLink is a MotionBuilder device plug-in that receives facial animation data from YanusLIVE PRO.

It separates live preview from final curve generation. Preserve source data, review or recover recordings, then safely bake to a new animation layer.

```
YanusLIVE PRO → Live UDP streaming → MotionBuilder preview
→ Raw .ylfs spool → Analysis → Animation-layer bake
```

### Supported versions and features

Autodesk MotionBuilder `2025` and `2026` are supported.

YanusLink supports:

* Live Link Face v6 UDP reception and real-time facial preview
* Multiple cameras and subjects, ARKit blendshapes, and head and eye rotation
* Raw `.ylfs` spool recording, offline analysis, and repeat baking
* New animation-layer baking with rollback after failure or cancellation
* Automatic baking, interrupted-recording recovery, and diagnostic bundles

### Data channels

YanusLink receives up to 61 channels.

| Channel group      |  Count | Description                        |
| ------------------ | -----: | ---------------------------------- |
| ARKit BlendShapes  |     52 | Standard ARKit facial channels     |
| Head Rotation      |      3 | Yaw, Pitch, Roll                   |
| Left Eye Rotation  |      3 | Yaw, Pitch, Roll                   |
| Right Eye Rotation |      3 | Yaw, Pitch, Roll                   |
| **Total**          | **61** | Full Live Link Face v6 channel set |

Blendshape values usually range from `0.0–1.0`. Rotation values use radians.

The production binding profile uses 48 facial channels. It excludes these optional right-eye look channels:

```
eyeLookDownRight
eyeLookInRight
eyeLookOutRight
eyeLookUpRight
```

Excluded channels are reported as optional exclusions, not missing bindings.

### Installation

Save the current MotionBuilder scene. Close MotionBuilder and `mobupy.exe`. Then run the YanusLink installer.

The plug-in installs as a per-user MotionBuilder module.

```
%USERPROFILE%\Documents\MB\Modules\MotionTechnologies.YanusLink\
```

The installed structure is:

```
MotionTechnologies.YanusLink\
├── MotionTechnologies.YanusLink.mod
├── 2025\plugins\LiveLinkFaceDevice.dll
└── 2026\plugins\LiveLinkFaceDevice.dll
```

The module descriptor loads the plug-in matching the running MotionBuilder version.

#### Confirm the installation

1. Start MotionBuilder.
2. Open **Asset Browser** or **Devices**.
3. Find the YanusLink device.
4. Add `LinkYanus` to the current scene.

The plug-in loaded successfully when the YanusLink icon appears.

### Configure the live connection

#### Add the device

1. Open **Asset Browser**.
2. Navigate to **Devices**.
3. Drag `LinkYanus` into the scene.
4. Open the device properties.

The device has **Live** and **Offline Bake** tabs. Use **Live** for networking, subjects, preview, and binding. Use **Offline Bake** for recording analysis, baking, recovery, and diagnostics.

#### Stream from YanusLIVE PRO

Enable Live Link output in YanusLIVE PRO. Use a unique device ID and subject name for each camera.

```
Camera_1
Camera_2
Camera_3
Camera_4
```

YanusLIVE PRO sends the device ID, subject name, source frame number, sub-frame, source frame rate, and facial values.

#### Configure the Live tab

Enter the YanusLIVE PRO UDP port in **Port**. Select the incoming subject in **Subject**.

Create one YanusLink device for each independently controlled character.

```
LinkYanus 1 → Camera_1 → Character A
LinkYanus 2 → Camera_2 → Character B
LinkYanus 3 → Camera_3 → Character C
```

**Clamp** limits facial values to `0.0–1.0`. **Scale** adjusts overall facial strength. A typical starting value is `100`. **Rotation Scale** independently adjusts head and eye rotation.

#### Go online

1. Enable the device.
2. Set the device to **Online**.
3. Enable **Live** evaluation.
4. Confirm that the packet count increases.
5. Confirm the displayed subject matches the source.
6. Confirm stable receive FPS.

Before recording, check packet count, receive FPS, subject, last-packet time, dropped-frame statistics, and binding status.

#### Handle tracking loss

When packet reception stops, use one of these stale-data policies:

| Mode      | Behavior                                      |
| --------- | --------------------------------------------- |
| **Hold**  | Keeps the last facial pose.                   |
| **Reset** | Immediately returns every channel to neutral. |
| **Decay** | Smoothly fades the current pose to neutral.   |

Use **Decay** for production. Start with `Stale Timeout: 300 ms` and `Decay Duration: 200 ms`.

### Character binding

Before **Auto Bind**, load the target character and verify its animatable facial properties and ARKit-compatible shapes. Select the target model in YanusLink.

**Auto Bind** inspects the target facial properties, finds supported channels, configures a Relation Constraint, and connects device outputs to character shapes.

```
YanusLink Device → Relation Constraint → Character Shape Properties → Live Preview
```

Test blinks, jaw movement, lips, and head rotation. Review connected, missing, and excluded channels in the binding summary.

### Recording

YanusLink uses MotionBuilder Transport recording controls. The plug-in has no separate production record button.

```
Start MotionBuilder Record → Write source frames to a .ylfs spool → Stop Record → Finalize spool
```

#### Prepare to record

Before recording, confirm:

1. YanusLink is **Online** and live preview works.
2. The correct subject, target character, and binding are selected.
3. The correct Take and start time are selected.
4. Sufficient disk space is available.

The Take, subject, target model, local start time, and recording ID remain fixed during the session.

#### Record and locate files

1. Press **Record** in MotionBuilder Transport.
2. Start playback or capture.
3. Perform facial motion in YanusLIVE PRO.
4. Stop recording from Transport.

Source frames are written to a `.ylfs` spool file.

```
%USERPROFILE%\Documents\MB\2025\Recordings\
%USERPROFILE%\Documents\MB\2026\Recordings\
```

Example filename:

```
20260722_142530_Take001_Camera_1_g0001.ylfs
```

The spool preserves source frames and frame numbers. It detects dropped source frames and supports repeat baking with different settings.

#### Reconstruct the timeline

YanusLIVE PRO sends source inference frame numbers, not UDP packet counters. For example, `100, 101, 102, 108, 109` indicates missing or skipped source frames.

YanusLink anchors the first received frame to the local recording start time. It then reconstructs the timeline from source time.

$$
\text{Source Time} = (\text{frame number} + \text{sub-frame}) \times \frac{\text{frame rate denominator}}{\text{frame rate numerator}}
$$

This preserves the true recording duration when source frames are missing.

### Offline analysis and baking

#### Select and analyze a recording

After recording, open **Offline Bake** and select the latest recording or browse to a `.ylfs` file. Confirm the active Take, target character, binding, and spool before analysis.

**Analyze** validates spool integrity, frame count and duration, source frame rate, frame gaps, target model, binding, active Take, existing key ranges, and bake settings.

| State                     | Meaning                                         |
| ------------------------- | ----------------------------------------------- |
| **Ready**                 | The recording can be baked.                     |
| **Warning**               | Baking can continue, but review is recommended. |
| **Blocked**               | A required condition is not met.                |
| **Analysis Stale**        | The scene or settings changed after analysis.   |
| **Target Missing**        | The target character model is unavailable.      |
| **Binding Missing**       | Required facial properties are disconnected.    |
| **Existing-Key Conflict** | Existing animation prevents this operation.     |

Analysis identifies the spool, options, target, Take, binding, and existing curve state. Analyze again after changing the target, Take, binding, bake mode, or existing curves.

#### Bake modes

| Mode            | Use                                                   |
| --------------- | ----------------------------------------------------- |
| **Full**        | Creates a key for every valid source sample.          |
| **Fixed Rate**  | Resamples data at the selected FPS.                   |
| **Threshold**   | Creates keys only after changes exceed the threshold. |
| **Error Bound** | Reduces curves within the selected maximum error.     |

Use **Error Bound** for general production. It preserves facial quality while reducing redundant keys.

#### Bake to a new animation layer

The release workflow always creates a new MotionBuilder animation layer. This separates new facial animation from existing scene animation and protects existing data.

1. Select the spool, target, bake mode, and backend.
2. Click **Analyze** and review warnings.
3. Resolve blocking issues.
4. Click **Bake**.
5. Review the new animation layer.

```
Read spool → Reconstruct source timeline → Plan and reduce curves
→ New-layer transaction → Write FCurves → Validate → Commit or roll back
```

If baking fails or is cancelled, YanusLink removes partial curves and the new layer. Existing scene animation and the source `.ylfs` file remain intact.

**Snapshot Bake** preserves the visible animation before applying new facial curves. Use it when existing animation outside the selected range must remain unchanged.

### Automatic baking and recovery

#### Automatically bake after recording

Enable **Auto Bake After Record** in **Advanced**. After spool finalization, YanusLink analyzes the recording and bakes it to a new layer with Error Bound mode.

Automatic baking stops when a target or binding is missing, keys conflict, a spool is incomplete, disk space is low, another device is baking, the Take changes, or analysis becomes stale. Review the warning in **Offline Bake** and continue manually.

#### Recover interrupted recordings

An unexpected exit can leave an incomplete spool with a `.part` extension. Do not use it through the normal bake path.

1. Open **Recovery** in **Offline Bake**.
2. Click **Refresh**.
3. Select a recovery candidate.
4. Click **Recover Selected Recording**.
5. Select the recovered spool.
6. Run **Analyze** and review every warning.
7. Start a manual bake.

### Diagnostics

For troubleshooting, open **Diagnostics** in **Offline Bake** and click **Create Diagnostic Bundle**. Use **Open Diagnostics Folder** when needed.

```
%USERPROFILE%\Documents\MB\2025\Diagnostics\
%USERPROFILE%\Documents\MB\2026\Diagnostics\
```

The diagnostic bundle can include the plug-in version, DLL path, port, subject, target, online status, last packet, recording and bake state, disk status, and recovery candidates.

### Recommended workflow

```
Install YanusLink → Add LinkYanus → Configure port and subject → Select target
→ Auto Bind → Enable Online and Live → Verify preview
→ MotionBuilder Record → Stop Record → Offline Bake
→ Select spool → Analyze → Bake to new layer → Review and save
```

Start with these recommended settings:

```
Stale Mode: Decay
Stale Timeout: 300 ms
Decay Duration: 200 ms
Facial Scale: 100
Bake Mode: Error Bound
Bake Destination: New Animation Layer
Legacy Packets: Off
```

Use a unique subject for each camera. Do not change the subject or target during recording. Keep `.ylfs` files until final animation approval.

### Troubleshooting

#### Device does not appear

Close MotionBuilder completely. Verify the installation folder and the DLL for the target version. Restart MotionBuilder and open **Asset Browser**. Reinstall YanusLink if needed.

#### No packets are received

Check YanusLIVE PRO streaming, the UDP port, selected subject, Windows Firewall, and network interface. Confirm that packet count increases, last-packet time updates, and receive FPS is above zero.

#### Data arrives but the character does not move

Verify the target model and Auto Bind result. Enable the Relation Constraint and **Live** evaluation. Test with a known channel such as `jawOpen`.

#### Analyze is blocked

Check for a missing target or binding, incorrect Take, incomplete spool, existing-key conflict, or stale analysis. Resolve the issue, then run **Analyze** again.

#### Bake fails

Review the result message and confirm rollback completed. Confirm MotionBuilder is not recording. Verify that the spool is finalized, then analyze again. Create a diagnostic bundle if the issue persists.

#### Animation has too many keys

Use **Fixed Rate**, **Threshold**, or **Error Bound**. For production, adjust the maximum error in **Error Bound**. Use **Full** only when every sample is required.

#### Facial motion freezes after tracking loss

The stale policy may be **Hold**. Select **Decay** for a smooth return to neutral, or **Reset** for an immediate return.


# Summary of Features

High-level overview of YanusLIVE Pro capabilities and status.

This section summarizes YanusLIVE Pro at a glance.

* [Product Overview](/yanuslive-pro/summary-of-features/product-overview)
* [Key Features](/yanuslive-pro/summary-of-features/key-features)
* [Supported Workflows](/yanuslive-pro/summary-of-features/supported-workflows)
* [Current Implementation Status](/yanuslive-pro/summary-of-features/current-implementation-status)


# Product Overview

YanusLIVE Pro is a Windows-based real-time facial expression tracking and visualization application.

It is designed for live preview, recording, playback, and external animation data streaming.

### Main use cases

* Real-time facial expression tracking
* 3D facial motion preview
* Facial performance recording
* Session playback and validation
* LiveLink integration


# Key Features

### Feature summary

| Feature                 | Description                                                     |
| ----------------------- | --------------------------------------------------------------- |
| Real-Time Face Tracking | Tracks face, pose, landmarks, and expressions in real time.     |
| Multi-Camera Pipeline   | Supports multiple camera inputs for flexible capture workflows. |
| 3D Face Visualization   | Displays tracked motion on a 3D face model.                     |
| Blendshape Mapping      | Converts tracking data into animation-friendly channels.        |
| Recording               | Saves session data for later review.                            |
| Playback                | Replays recorded sessions for validation.                       |
| LiveLink Streaming      | Sends facial animation data to LiveLink-compatible tools.       |
| Diagnostics             | Provides logs and checks for troubleshooting.                   |


# Supported Workflows

### Live tracking workflow

Track a performer's facial motion in real time and preview the result in the 3D face view.

### Recording workflow

Capture facial tracking data, metadata, audio, and video for later review.

### Playback workflow

Load recorded sessions and inspect facial motion frame by frame.

### Streaming workflow

Send facial animation data to external tools using  LiveLink.


# Current Implementation Status

### Completed core areas

* Camera input and tracking pipeline
* Real-time facial landmark and expression tracking
* 3D face visualization
* Recording and metadata pipeline
* Playback and session review
* LiveLink output
* Modular UI panel structure

### Remaining areas

* Final clean-machine deployment validation
* Additional package verification
* Expanded user-facing documentation
* More troubleshooting examples
* More workflow-specific presets


# YanusLIVE


# UI PANES

An introduction  to the Interface

## Overview

The YanusLIVE UI consists of five main panes: **Record Device**, **Actor**, **Character**, **Values**, and **Actor Profile**. The Actor pane acts as the primary and central workspace. Users can show or hide each pane, enabling flexible layout customization based on different usage scenarios.

{% hint style="info" %}
The Record Device pane title changes dynamically with the selected device.
{% endhint %}

For details on each pane’s composition, please see the link below. This section covers the adjustment of the overall UI layout.

* Device Pane

  * [OBS Studio](/yanuslive/ui-panes/device-pane/obs-studio)
  * [HyperDeck](/yanuslive/ui-panes/device-pane/hyperdeck)

  Connection and recording options with trigger, including video play added to the list
* [Actor Pane](/yanuslive/ui-panes/actor-pane)

  Video Capture mode selection and display settings, with key function controls
* [Character Pane](/yanuslive/ui-panes/character-pane)

  Monitoring the streaming data applied to the Character
* [Values Pane](/yanuslive/ui-panes/values-pane)

  Monitoring data, including Neutral, Retarget, and Max options
* [Actor Profile Pane](/yanuslive/ui-panes/actor-profile-pane)

  Retargeting settings for Scale and Offset And managing Actor Profile settings files.

<figure><img src="/files/Q7Rqd5a2hcMebUEfApfS" alt=""><figcaption><p>Pane Structure of YanusLIVE</p></figcaption></figure>

## Display Options

The Pane Splitter Handle and Pane View Icons allow you to show or hide panes based on their functions.

#### Visibility Icons

<figure><img src="/files/txM3fVkZqfS4BTyFvt6s" alt="" width="563"><figcaption><p>Icons of the View Pane</p></figcaption></figure>

1. View Device (OBS Studio / HyperDeck)
2. View Character
3. View Values
4. View Actor Profile

<figure><img src="/files/46BeNtYvuYeucRfHXbyn" alt=""><figcaption><p>View Pane Icon Demo</p></figcaption></figure>

#### Splitter Handles

In the Pane Structure above, the solid lines represent Splitter Handles that adjust the spacing between panes. They appear when the mouse hovers over the area.

<figure><img src="/files/1aSqwnIey8qzdUXGrcOV" alt=""><figcaption><p>Splitter Handles Demo</p></figcaption></figure>


# Device Pane

## Overview

The Pane title is set to either OBS Studio or HyperDeck depending on the selected device.

### OBS Studio

<figure><img src="/files/QfUk1HKrD2gaTpmwuSUg" alt="" width="563"><figcaption><p>Device Pane > Overview > OBS Studio</p></figcaption></figure>

### HyperDeck

<figure><img src="/files/J3jSyfYzwijQRXhkhVYs" alt="" width="563"><figcaption><p>Device Pane > Overview > HyperDeck</p></figcaption></figure>


# OBS Studio

## Overview

<figure><img src="/files/UxnpJbdf5L84EQKCCo4f" alt="" width="563"><figcaption><p>Device Pane > OBS Studio > Overview</p></figcaption></figure>

## Device Selection

* **Device :**  OBS Studio \[localhost]
* **Connect / Disconnect** (Button with Indicator)
  * When the button shows **Connect**, clicking it will attempt to establish a connection.
  * Once connected successfully, the button text changes to **Disconnect** and lights up in yellow.
  * Clicking **Disconnect** will terminate the connection.

## Options for Recording

* **Slate** :  The name of the recording file.
* **Take** :  Defaults to 1 and automatically appends the take number to the Slate name. The take number increments automatically with each new take.
* **Record Option**
  * **Take suffix** :  Appending the take number as a suffix to the file name.
  * **Actor suffix** :  Under Settings: Network > Commo**n**, the **actor ID(Text)** is appended as a suffix to the file name.
* **Trigger Option**
  * **Receiver** :  When enabled, the system begins listening based on the configuration in **Settings: Network > Remote Trigger Receiver**.
  * **Sender** :  Upon recording start, a trigger command is transmitted through the port specified in **Settings: Network > Remote Trigger Sender**.

## Local Tab

* **Folder Path :**  The currently configured path.
* **Refresh** Button : The file list is refreshed accordingly.
* **File List**
  * Double-clicking a video file will start playback immediately.
  * If a CSV file is double-clicked, the corresponding video file in the same folder will be played along with the CSV data, if it exists.

### **Mode** Change

* **Live** :  Mode for using the video from OBS Studio’s Virtual Camera as the input. (Actor mode : USB Camera, Capture device : OBS VirtualCamera)
* **Play** :  Mode for playing video files stored in a local directory. (Actor mode : Video File)

### Control Buttons

* **Record**: Start recording
* **Stop**: Stop recording
* **Pause / Resume** : Pause / Resume recording


# HyperDeck

## Overview

<figure><img src="/files/REq13jSG5g21wsHakBCy" alt=""><figcaption><p>Device Pane > HyperDeck > Overview</p></figcaption></figure>

## Device Selection

* **Device :**  {Name} \[IP Address]\
  The selection list displays HyperDeck devices by their configured Name and IP Address under Settings, whereas OBS Studio devices are shown separately.
* **Connect / Disconnect** (Button with Indicator)
  * When the button shows **Connect**, clicking it will attempt to establish a connection.
  * Once connected successfully, the button text changes to **Disconnect** and lights up in yellow.
  * Clicking **Disconnect** will terminate the connection.

## Options for Recording

* **Slate** :  The name of the recording file.
* **Take** :  Defaults to 1 and automatically appends the take number to the Slate name. The take number increments automatically with each new take.
* **Record Option**
  * **Named Clip** :  Uses the Slate and Take inputs; if unchecked, the HyperDeck default naming rules are used.
  * **Actor suffix** :  Under Settings: Network > Commo**n**, the **actor ID(Text)** is appended as a suffix to the file name.
* Trigger Option
  * **Receiver** :  When enabled, the system begins listening based on the configuration in **Settings: Network > Remote Trigger Receiver**.
  * **Sender** :  Upon recording start, a trigger command is transmitted through the port specified in **Settings: Network > Remote Trigger Sender**.

## HyperDeck Tab

* **SD card** Selection

  Two slots are provided and become disabled during Play or Record operations.
* **Refresh** Button : The file list is refreshed accordingly.
* **Clip List** (Files in SD card)
  * When the system is stopped, changing the selection updates the Actor Display to show the first frame of the selected clip.
  * During playback, the currently playing clip changes immediately upon selection.
  * Double-clicking a clip while stopped initiates playback at normal speed (1x) with looping enabled.
* **Copy** **to Local** Button
  * Transfers the selected file to a local directory via the FTP protocol.

{% hint style="info" %}
When copying multiple files, we recommend using FileZilla, a free FTP client.
{% endhint %}

### **Mode** Change

* **Live** :  A mode that enables real-time video input from YanusCAM and other sources via HyperDeck, with an option to record.
* **Play** :  A function to play videos stored on  the SD card.

### Control Buttons

* **Record**: Start recording
* **Stop**: Stop recording or playback
* **Play**: Start playback
* **Previous**: Play previous clip
* **Next**: Play next clip

## Local Tab

* **Folder Path :**  The currently configured path.
* **Refresh** Button : The file list is refreshed accordingly.
* **File List**
  * Double-clicking a video file will start playback immediately.
  * If a CSV file is double-clicked, the corresponding video file in the same folder will be played along with the CSV data, if it exists.
* **Copy to HyperDeck** :  Transfers the selected file to the SD card using the FTP protocol.


# Actor Pane

## Overview

<div align="center"><figure><img src="/files/C9z1AKWCl7WfY4kP4Qhz" alt=""><figcaption><p>Actor Pane > Overview</p></figcaption></figure></div>

## Actor mode Selection

<div align="left"><figure><img src="/files/26sjspdshzFqvCorUf8e" alt="" width="317"><figcaption><p>Actor Pane > Actor mode Selection</p></figcaption></figure></div>

1. **Yanus CAM**
2. **USB Camera** :  Capture device
3. **Video File** :  File Path, Open Button

Please refer to [Settings: Actor](/yanuslive/settings/settings-actor) for settings related to each mode.

## View Option and Function Icons

<div align="left"><figure><img src="/files/sZBGTvOQRAczcR94Iwds" alt="" width="428"><figcaption></figcaption></figure></div>

1. **Rotate Left** 90 Degrees
2. **Rotate Right** 90 Degrees
3. **View Facemesh**
4. **Neutral Calibration**
5. View HyperDeck/OBS Studio Pane
6. View Character Pane
7. **Connect Streaming**

## Actor mode Start/Pause Button

This interface uses four button icons and colors to indicate the current status.

![](https://lh7-rt.googleusercontent.com/slidesz/AGV_vUfke8WYYu_M4Y5mO8ClpRplmbw7qDNt4w93WeL6-PmCu7QqNDv2SisrGyWJOmra-fzlmQeLlPf1HCCEr9mlNVjq6cU3_aHn5ajKmFS8ph3l_yQsLzp1i5EakNGLfNZMm0laH13Grg=s2048?key=Has_RQHHjKwPYIIt88xeDw)     **Disabled** :  Video capture settings are **unavailable**.

![](https://lh7-rt.googleusercontent.com/slidesz/AGV_vUfVfQeN2CDu-s3evf4I6QPZbbLh3oo2wSgGSpukwBAdnr6NuIaQa4pHZuVYb522N8iXCfpCNiy_hnmFBerYj04sGMiP5mExGDynY-sreh2xSOBdOt7CCeaavO1QIMq_r9jocEk3QQ=s2048?key=Has_RQHHjKwPYIIt88xeDw)     **Ready** :  Click to **Activate** video capture.

![](https://lh7-rt.googleusercontent.com/slidesz/AGV_vUdTUcvjCowG7fT9UFDticT9K9p059HM9eKONhx0ztC6Kpd27s5LLZT2xhUais8ol3B-NE3rsjUtfBPotL8OVt_cqkKKkvLmeT99LLMJkTV2q0Apj_yqRBAbVxrcHSq9_bXb5NZhhw=s2048?key=Has_RQHHjKwPYIIt88xeDw)     **Running** :  Click to **Pause**

![](https://lh7-rt.googleusercontent.com/slidesz/AGV_vUeVIwt16pZHmRpgTqMc5Wf9BHajBNczdevTP8LjhCiAvzmEFLFP68v5huR0l5RXb4Dquf_77NIYUimsJYmf-1k1IN04vdiM-1wrnxtGsWOOHUyerB0tbUfXbsLuatEj_QwRGZe4eA=s2048?key=Has_RQHHjKwPYIIt88xeDw)     **Paused** :  Click to **Resume**

## Actor mode Stop Button

![](https://lh7-rt.googleusercontent.com/slidesz/AGV_vUcmzDWzP73cuL3d-OPPvL_-inICnhhi8dxQNsKUMTMt7gN9TyVXjz4pmzGzmJdCmZCe3_0-W1oTa2u32SjSy54N9v50twq5aUH2rcuU2QFGmKt31VH_xETdWH-81TOysgeTY0C1KA=s2048?key=Has_RQHHjKwPYIIt88xeDw)    **Stop** :  **Deactivate** video capture.

Please refer to the demo below for detailed information on Actor Mode settings and the Start/Pause, and Stop buttons

{% hint style="info" %}
A convenience feature enables automatic execution without needing to click the Actor Mode Start/Pause button:

* Double-clicking a video file in the Local files list in the Device Pane automatically launches Video File mode.
* When connecting to a device in the Ready state, the corresponding mode will automatically start upon successful connection.
  {% endhint %}

<details>

<summary>Demo - Actor mode Start/Stop with Device Connection</summary>

<figure><img src="/files/SgLni7Kd8N0SgeZ0bn9w" alt=""><figcaption><p>Demo - Actor mode Start/Stop with Device Connection</p></figcaption></figure>

</details>


# Character Pane

## Overview

<div align="left"><figure><img src="/files/VqL1elKXjvTXv5DKtWTr" alt=""><figcaption><p>Character Pane > Overview</p></figcaption></figure></div>

&#x20;By default, no Character is displayed when YanusLIVE starts. Unreal Engine or Unity Package applications can be launched and closed via buttons, and operate by importing their output into the Character display window.

## Character mode control

* **Character mode** :  In [**Settings: Character**](/yanuslive/settings/settings-character), the predefined list appears as a dropdown (combo box) for selection.&#x20;
* **Start** **/ Stop** Button :  Starts and stops the Character application.

{% hint style="info" %}
Startup may take a few seconds. On the first run after installation, security prompts might block importing and open a separate window. If this happens, please stop and start the application again.
{% endhint %}

{% hint style="info" %}
Changing Character mode while a Character app is running closes the current app and starts a new one. This may cause slight delays depending on your PC.\
To manage resources, Actor mode stops during this process and restarts automatically once the new app is ready.
{% endhint %}

## Pixel Streaming mode

&#x20;The Character mode supports Unreal Engine’s Pixel Streaming. In this case, start the Pixel Streaming Server in the Unreal Engine project before starting the application.


# Values Pane

## Overview

<figure><img src="/files/4ZXOfij3UTQcXwILMWAg" alt=""><figcaption><p>Values Pane > Overview</p></figcaption></figure>

## **BlendShape Values Indicator**

* **Indicator mode** :  **Live**

  Displays **the current values** of each BlendShape as horizontal bars alongside their numeric values, allowing real-time monitoring of facial expressions
* **Indicator mode** :  **Max**

  Displays **the maximum recorded values** of each BlendShape from the moment this option is selected, helping to identify peak expressions or movements.

## Disable Icon Buttons

By default, the icon button is active and highlighted in yellow.\
Clicking the button deactivates it, meaning the data will no longer be applied.

* **Disable Neutral Calibration**

  Neutral Calibration values are excluded from calculations.
* **Disable Retargeting**

  Actor Profile adjustments (Scale and Offset) are not applied in calculations.

{% hint style="info" %}
The formula is simply :  **Value = (Measurement - Neutral - Offset) × Scale.**&#x20;

When disabled, the Neutral and Offset values default to 0, and the Scale value defaults to 1.

Disabling both Neutral Calibration and Actor Profile adjustments allows you to see the raw measurement data. When Retargeting is off, toggling Neutral Calibration on and off helps you estimate the Neutral Calibration value directly.
{% endhint %}

## Values Tooltip

Hovering over a BlendShape indicator shows a tooltip with its value and its pair’s value simultaneously.&#x20;

Clicking the indicator pins the tooltip, allowing you to conveniently view both values even when moving the mouse away.&#x20;

Clicking the same BlendShape again will unpin the tooltip.

* **Pin Tooltip**&#x20;

  If the values’ scrollbar moves, causing the pinned tooltip to shift position, the “Pin Tooltip” option can be unchecked to release the tooltip.

## Event Information

Key user inputs (e.g., clicking Apply in Settings) and external events (e.g., receiving a Record Trigger) are recorded in a simplified log displaying the most recent three entries.


# Actor Profile Pane

## Overview

<figure><img src="/files/SIyKrtZ1gPedCfe4yTAX" alt=""><figcaption><p>Actor Profile Pane > Overview</p></figcaption></figure>

## Actor Profile Slider

* **Slider mode** :  **Scale**

  Adjusts the blendShape value by multiplying it.

  The range is from 0 to 2, with a default value of 1.0. The midpoint is indicated when the slider shows no green section. To set the range for Scale values above 2, open the Actor Profile Editor window.
* **Slider mode** :  **Offset**

  Adjusts the blendShape's Neutral Calibration by adding an offset.

  The Offset range is fixed between -1.0 and 1.0, with a default value of 0.
* **Sync Left/Right**

  This option synchronizes symmetrical BlendShapes (left and right) to move together with the same value when adjusting the slider. It is enabled by default and can be disabled for fine-tuning asymmetrical adjustments.
* **Slider Handle / Slider Tooltip**
  * When hovering the mouse, items linked by Sync Left/Right are highlighted in the same color before clicking.
  * When adjusting the slider, the value is shown in a large font within the tooltip. You can change the font size in [Settings: Experimental > Font Size](/yanuslive/settings/settings-experimental#font-size).
  * **Double-click** the slider handle to open the **Actor Profile Editor**.

## Actor Profile Editor

* **Open Actor Profile Editor** Button
  * Open the Actor Profile Editor Window. If a slider was recently adjusted, the corresponding BlendShape will be selected automatically.
  * You can open multiple Actor Profile Editor windows.&#x20;

{% hint style="info" %}
Windows are numbered sequentially in the window title using #No according to the order they are opened.

The icon turns yellow to indicate activation when at least one window is open, and reverts to a disabled state when all windows are closed.
{% endhint %}

* **Actor Profile Editor Window**
  * **BlendShape Selection** :  Dropdown ComboBox
  * **Value** :  The current measured value.
  * **Scale** :  The scale factor used for retargeting.
  * **Scale Range** :  The allowable range for the scale slider.
  * **Offset** :  The offset value used for retargeting.
  * **Single step** :  The amount the value changes with each click of the increment button.

## Actor Profile File

* Open Actor Profile File Button
  * Opens YanusLive Actor Profile files (.json or .yap) through the file dialog.
  * The file includes data for Neutral Calibration, Scale, Scale Range, and Offset.

{% hint style="info" %}
When starting to capture a new actor, it is recommended to open and use the default\_actor\_profile.json file. Performing a new Neutral Calibration and saving on a previously used file will overwrite it. By initializing both Scale and Offset once before saving, the Actor Profile settings will remain consistent. However, if the Scale Range has been modified, you may need to manually update it in the Actor Profile Editor.
{% endhint %}

## Actor Profile Setup Buttons

* **Apply**

  This toggle button controls the application of slider value changes. When activated, it lights up yellow; press again to deactivate.
* **Init**&#x20;

  Resets Scale to 1.0 and Offset to 0.0. Only the selected Slider Mode will be reset, while the Neutral Calibration result remains unchanged.
* **Reload**

  Reloads the Scale or Offset settings for the currently selected Slider Mode from the actor profile file.\
  This action discards any unsaved changes and restores the previously saved values.
* **Save As**

  Saves the Actor Profile File with a new name. The file dialog opens at the current loaded path and filename by default. If you are saving the **default\_actor\_profile.json** file, it is recommended to choose a different name.

{% hint style="info" %}
The default\_actor\_profile.json file can be found in the `{user}/YanusLIVE/version_1_6_4` folder, which is created based on the software version.\
It is also located in the program installation directory at `C:\ProgramFiles\YanusSTUDIO\YanusLIVE_v1.6.4\bin\config`\
If you delete the `version_1_6_4`folder and restart the program, the default files will be automatically restored.
{% endhint %}


# SETTINGS

An introduction to Settings window

## Overview

Various execution modes, options, and connection settings are configured through the Settings window.

{% hint style="info" %}
In particular, when using a USB Camera input other than the Yanus CAM, you must first configure the settings in the Settings window before starting capture by pressing the Actor mode start button.
{% endhint %}

Please see the following pages for descriptions of the settings on each tab

* [Settings: Network](/yanuslive/settings/settings-network)

  Communication settings such as IP and Port
* [Settings: Actor](/yanuslive/settings/settings-actor)

  Settings for each Actor mode (video input options)
* [Settings: Filter](/yanuslive/settings/settings-filter)

  Basic preset selection and advanced filter detailed settings
* [Settings: Experimental](/yanuslive/settings/settings-experimental)

  Settings to enable or disable additional processing along with other configurations.
* [Settings: Character](/yanuslive/settings/settings-character)

  Unreal Engine and Unity package import settings in the Character window
* [Settings: Graph](/yanuslive/settings/settings-graph)

  Configuration to open graphs from CSV data files

## Open Settings Window

Open the Settings window from the File > Settings menu or by clicking the gear icon in the Character window.

<figure><img src="/files/MJ3OOJvYF1ykfiuVLqPb" alt=""><figcaption><p>Settings menu and icon</p></figcaption></figure>

## Settings tabs

The Settings window is divided into tabs including Network, Actor, Filter, Experimental, Character, and Graph, with common buttons located at the bottom.

<figure><img src="/files/MTJ9avIv2E0rzHymW598" alt=""><figcaption><p>Settings tabs and bottom buttons</p></figcaption></figure>

* **Default**

  Reset the settings of the current tab to their default values.
* **OK**

  Save changes if any, and close the window.
* **Cancel**

  Discard changes and close the window.
* **Apply**

  Save and apply changes while the window remains open.  The button is enabled if there are unsaved changes.

## Subsections for each tab

{% tabs %}
{% tab title="Network" %}
Communication settings such as IP and Port

* HyperDeck
* OBS Studio
* Character
* Live Streaming
* Remote Trigger Receiver
* Remote Trigger Sender
* Common
  {% endtab %}

{% tab title="Actor" %}
Settings for each Actor mode (video input options)

* Yanus CAM
* USB Camera
* Video File
* Common
  {% endtab %}

{% tab title="Filter" %}
Basic preset selection and advanced filter detailed settings

* Preset
* Live Filter
* Live Secondary Filter
* Post CSV Filter
* Post CSV Secondary Filter
* CSV Export Filter
  {% endtab %}

{% tab title="Exprimental" %}
Settings to enable or disable additional processing along with other configurations.

* CSV Data File Play
* Neutral Calibration
* Emotional Improvement
* Sync Eye Movements
* Head Rotation
* Font Size
  {% endtab %}

{% tab title="Charcter" %}
Unreal Engine and Unity package import settings in the Character window

* Display Configuration
* Character Slots (1 \~ 5)
* Pixel Streaming Mode
  {% endtab %}

{% tab title="Graph" %}
Configuration to open graphs from CSV data files

* Graph Configuration
* Data Slots (1\~5)
  {% endtab %}
  {% endtabs %}


# Settings: Network

The Network tab lets you configure core communication parameters such as IP addresses, port numbers and protocols for connectivity between devices or programs

## HyperDeck, OBS Studio

Connection setup for remote control of recording.

<figure><img src="/files/nKtHzvqTggbusCKj8tXq" alt="" width="563"><figcaption><p>Settings: Network > HyperDeck, OBS Studio</p></figcaption></figure>

### HyperDeck

Connect to BlackMagic Design's HyperDeck Studio HD Mini model, SDI to USB video converter and recorde**r**

* **IP Address** :  Set it to the same IP address shown in the device's Setup > Network menu after the device is connected to the network.
* **Port Number** :  It is not possible to set the port to a fixed value of `9993`&#x20;
* **Device Name** :  Name displayed in the Device entry under Pane Device
  * e.g., `hd01 [192.168.1.100]`

{% hint style="info" %}
Refer to the [HyperDeck Connection](/yanuslive/function-guide/hyperdeck-guide) for connection instructions.
{% endhint %}

### OBS Studio

Establishing WebSocket control link between locally-run OBS Studio programs.&#x20;

Refer to Tools > WebSocket Server settings in the OBS Studio program. The 'Enable WebSocket server' option must be checked for the connection to be allowed.

* **IP Address** : Fixed IP assignment to `127.0.0.1` is not allowed.
* **Port Number** : The default port is `4455`, but it can be changed simultaneously within OBS Studio.
* **Password** : If 'Enable Authentication' is not enabled in OBS Studio settings, no additional value input is required.

{% hint style="info" %}
Refer to the [OBS Studio Connection](/yanuslive/function-guide/obs-studio-guide) for connection instructions.
{% endhint %}

## Character

Default streaming configuration to localhost when running in Actor Mode.

<figure><img src="/files/6FpDKrIj1Y4i9L8CDAIE" alt="" width="563"><figcaption><p>Settings: Network > Character</p></figcaption></figure>

* **IP Address** :  The address is fixed to `127.0.0.1` and cannot be changed.
* **Port Number** :  It can be changed, but a program restart is required for it to take effect.
* **Subject Name** :  The Character Example included with Livelink uses 'Yanus\_LIVE\_00' as its fixed subject name.

{% hint style="info" %}
When attempting to receive LiveLink simultaneously from an Unreal Engine or Unity project on the same PC running the YanusLIVE Character, it is recommended to change the project's port number.\
If the Character is not running, the connection will be available without changing the port.\
The default port number (11111) can be modified in the Unreal Engine project settings (Plugins > Apple ARKit, which uses a compatible protocol).
{% endhint %}

## Live Streaming

Data streaming output is managed as a list of items in a table.\
If multiple items have 'USE' checked, they will be output simultaneously when the Connect Streaming icon button is toggled in the Actor Plane

<figure><img src="/files/aih0v4bBEgsR7pcee4js" alt="" width="563"><figcaption><p>Settings: Actor > Live Streaming</p></figcaption></figure>

Three sample items are provided by default, and you can add or remove items using the + and – buttons. To open the edit window, select an item and double-click it.

<figure><img src="/files/YTz9Z8anUjfe7aduiDps" alt="" width="363"><figcaption><p>Window: Edit Live Streaming</p></figcaption></figure>

* **Use** :  The checkbox can also be toggled directly from the table.
* **Name** :  This applies to fields such as Subject Name or item name.
* **Protocol** :  \[ Unreal Engine, Unity, MoA, Warudo ]
  * Each entry is categorized as either LiveLink or VMC.
* **Cast Type** :  \[ Unicast, Multicast, Broadcast ]
  * When selected, a guide for IP configuration is shown
* **IP Address / Port Number** :  UDP communication settings

## Remote Trigger

When either the Receiver or Sender option is checked in the Trigger section of the Device Pane, this indicates predefined settings for each port and the XML-formatted protocol.\
This configuration is designed to operate when remote recording connections such as OBS Studio or HyperDeck are already set up.

<figure><img src="/files/TgSfvPo4zaeqX4lZ3qzm" alt="" width="563"><figcaption><p>Settings: Network > Remote Trigger, Common</p></figcaption></figure>

### Remote Trigger Receiver

YanusLIVE receives a Record Trigger from another device (typically a body motion capture system) to video recording.

* **Mode** :  \[ YanusLIVE, XEROmotion, Xsens, OptiTrack, MoA ]
* **Port Number** :  When the mode is changed, the default port number for the corresponding device is automatically filled in. This port setting can be modified along with the configuration on the external device.

### Remote Trigger Sender

This mode is designed for cases where only facial capture is performed while multiple instances of YanusLIVE are running on the same network.&#x20;

* **Mode** : \[ YanusLIVE ]
* **Port Number** :  The default port is set to `5003`, and it can be changed.

{% hint style="info" %}
Please avoid using ports `5001` and `5002`, as they are reserved for internal use.
{% endhint %}

It allows Record to be triggered from YanusLIVE using a protocol format that is nearly identical to the standard.

### Common

global option that applies regardless of the recording device or trigger settings.

* **Record Actor ID** :   When the "**Actor suffix**" option is checked under Record options, a suffix is added to the saved video file name. This can be used to distinguish file names by Actor when operating multiple YanusLIVE instances simultaneously.


# Settings: Actor

The Actor tab allows configuration of video capture settings for three input sources: Yanus CAM, USB Camera, and Video File.

## Yanus CAM

A dedicated mode for integrating **Yanus CAM Pro** with **HyperDeck** devices. When a USB camera is detected with the name '**Blackmagic Design**' in Windows, the mode is automatically enabled.

<figure><img src="/files/NdXvbE9gypBqvYoeOK7g" alt="" width="563"><figcaption><p>Settings: Actor > Yanus CAM</p></figcaption></figure>

&#x20;The camera in **Yanus CAM Pro** is configured to **60Hz at 720P (1280x720)**. However, **the video output through the USB cable** is upscaled and transmitted in **HD format at 60Hz 1920x1080.** When recording to the HyperDeck’s **SD card** via a **record** command, the video is saved in **720P** resolution.

* **Backend**&#x20;

{% hint style="info" %}
The USB backend is a multimedia framework that handles video capture and can be configured to use either **Microsoft Media Foundation (MSMF)** or **DirectShow (DSHOW)**.

MSMF generally offers better performance and lower latency than DSHOW on newer versions of Windows. However, some USB cameras may not function properly with MSMF. Depending on the camera model, PC specifications, or Windows environment, one backend may deliver higher FPS performance than the other.
{% endhint %}

{% hint style="info" %}
By default, **Yanus CAM** uses **Media Foundation**, while **USB Camera** uses **DirectShow**.\
For **OBS Virtual Camera**, it only appears in the capture device list when using **DirectShow** mode.
{% endhint %}

* **Resize Percent** :  Resize percentage before processing captured frames.
  * A 45% scale of the 1920x1080 input resolution from Yanus CAM Pro results in 864x486.
  * The default Resize Percent is set to optimize real-time performance without noticeably degrading facial capture quality.

## USB Camera

&#x20;This mode allows you to select a capture device from the list of USB cameras detected by Windows to receive video input. When recording is required, we recommend connecting your camera through OBS Studio and selecting OBS Virtual Camera as the input source.

<figure><img src="/files/odMGG2vSJq4QJbU0RhPQ" alt="" width="563"><figcaption><p>Settings: Actor > USB Camera</p></figcaption></figure>

&#x20;USB cameras must be configured with compatible frame rate and resolution settings before being used directly in YanusLIVE.

* **Frame Rate** :  \[ 60, 30, 59.94, 29.97 ]&#x20;

{% hint style="info" %}
The 59.94 fps and 29.97 fps options are available when configuring the camera connection. YanusLIVE internally processes these as 60 fps and 30 fps, respectively. This adjustment is intended to resolve issues where mismatched frame rate settings may prevent USB camera connections.
{% endhint %}

* **Resolution Width / Height :**  \[ 1280x720 ] Default
* **Codec** :  \[ MJPG ] Default

{% hint style="info" %}
In "Actor mode: USB Camera" the codec is explicitly specified when connecting the
&#x20;device to prevent errors that may occur with automatic settings. In most cases, it has been confirmed that the default MJPG setting is well compatible. The specific codec must be installed on your PC. It uses the FourCC (Four Character Code) format. For more details, refer to <https://fourcc.org/codecs.php>.
{% endhint %}

* **Resize Percent** :  \[ 68% ] Default
* **Set Camera Paramters** :  At the start of video capture in Actor mode, YanusLIVE attempts to set the specified frame rate and resolution. If the connected USB camera does not support them, the settings may be ignored.

{% hint style="info" %}
To avoid the inconvenience of setting FPS and resolution manually when using a direct connection, we recommend the following:

Before starting Actor mode, launch OBS Studio and configure the desired FPS and resolution.\
Then, in YanusLIVE — without starting Actor mode — click the Connect button for OBS Studio.\
YanusLIVE will retrieve the FPS and resolution settings via WebSocket communication, automatically update its configuration with those settings, and start video capture.
{% endhint %}

{% hint style="info" %}
A USB camera currently in use by OBS Studio cannot be directly connected in YanusLIVE.\
In such cases, simply disabling the preview in OBS Studio is not sufficient.\
You must locate and click the Deactivate button in OBS Studio to fully release the resource from the camera.
{% endhint %}

## Video File

The only available setting in Video File playback mode is the Resize Percent option.

<figure><img src="/files/g0nCRRdmPmZmHutAW3w1" alt="" width="563"><figcaption><p>Settings: Actor > Video File</p></figcaption></figure>

## Common

This setting is applicable to all three video input modes

<figure><img src="/files/tI1zYZsXVGA7FAJWwgX9" alt="" width="563"><figcaption><p>Settings: Actor > Common</p></figcaption></figure>

* **Actor Display Frame Rate** :  \[ 30, 60 ]
  * Sets the refresh rate for displaying frames in the Actor video.
  * For better real-time performance, a setting of 30 FPS is recommended. Data processing and streaming will continue at 60Hz when the input is 60 FPS.
* **Enable Resize Aspect** : Enable adjusting the aspect ratio independently from the input source.
* **Resize Aspect Ratio** :  \[ 16:9, 9:16, 4:3, 3:4, .... ]
  * When the aspect ratio of the input video is non-standard, the image is adjusted to the selected ratio.
  * This is typically used in cases where the camera natively captures in 4:3 but the input is received as 16:9 due to HD output standards, and needs to be converted back to 4:3.


# Settings: Filter

Basic preset selection and advanced filter detailed settings.

The filter settings in this tab are applied uniformly regardless of the Actor mode selected, as well as during the execution of Generate Facial Data and Batch Generator Window.

Parameters can be adjusted while Actor mode is running, and changes are applied immediately when the Apply button is pressed.

## Preset Selection

<figure><img src="/files/9B5nHiwi3wVie2mnhuGV" alt="" width="563"><figcaption><p>Settings: Filter > Preset</p></figcaption></figure>

* **Preset :  Stable**
  * All settings except for the Preset selection are disabled.

{% hint style="info" %}
Unlike other modes, this mode operates at a stage prior to BlendShape measurement and does not use other parameters. For standard webcams rather than specialized capture devices, manual filter adjustment may be challenging due to inherent noise. This mode is generally recommended when fast lip movement is not a critical factor.
{% endhint %}

* **Preset** :  **Responsiveness,  Balanced,  Noise Control**
  * These presets represent a trade-off between responsiveness and noise reduction, categorized as responsiveness-focused, balanced, and noise-focused.

{% hint style="info" %}
Designed primarily for typical webcams, each setting may require slight adjustments by sliding from right to left to improve responsiveness.
{% endhint %}

* **Preset : Custom\_Ex01,  Custom\_Ex02**
  * Two preset Filter slots prepared as examples of user-defined settings.

{% hint style="info" %}
Preset items can be added with new names. The six items listed above can have their parameters modified or reset to default, but they cannot be deleted
{% endhint %}

### Terminology Explanation

The terms **Live Filter, Post CSV Filter, and Secondary Filter** are explained below.\
The **Live Filter** is used for both real-time processing and CSV data file generation, while the **Post CSV** **Filter** applies only during CSV file creation. To provide flexible adjustment for BlendShapes with varying noise characteristics, both filters are divided into two separate parameters. The second parameter is referred to as the **Secondary Filter**.

## Live Filter

<figure><img src="/files/JuzWujGqxMmS7dMsSdpv" alt="" width="563"><figcaption><p>Settings: Filter > Live Filter</p></figcaption></figure>

* **Static Noise** :  Smoothing level (window size) for reducing static noise
* **Static Range** :  Noise threshold to trigger smoothing filter
* **Dynamic Noise** :  Kalman filter sensitivity settings (Q, R) for dynamic noise

{% hint style="info" %}
The Live Filter operates in two stages, utilizing a Moving Average and a Kalman Filter. The Moving Average is selectively applied based on the BlendShape’s rate of change—the difference between previous and current values. When movement is significant, only the Kalman Filter is active. For small, stationary noise components known as jitter, which fall below a defined static range, the Moving Average filter is applied. This approach ensures responsive performance while effectively suppressing jitter noise.
{% endhint %}

## Live Secondary Filter

<figure><img src="/files/2f00qYfrOHOIuTGFjSH3" alt="" width="563"><figcaption><p>Settings: Filter > Live Secondary Filter</p></figcaption></figure>

* **Use 2nd Filter** :  Enable or disable the Secondary Filter.
* **Highlight Selected BlendShapes**

  BlendShapes affected by the second filter are highlighted in yellow within the Value Pane. This helps identify BlendShapes filtered based on the Selection Keywords.
* **Selection Keywords**

  Enter BlendShape selection keywords, separated by commas, to specify which BlendShapes the Secondary Filter applies to.

## Post CSV Filter

<figure><img src="/files/QDdnvjCtBVK83xXJ2fqa" alt="" width="563"><figcaption><p>Settings: Filter > Post CSV Filter</p></figcaption></figure>

* **Cutoff Frequency** :  Cutoff frequency for smoothing filter

{% hint style="info" %}
A bidirectional Butterworth filter is applied to ensure zero delay.
{% endhint %}

## Post CSV Secondary Filter

<figure><img src="/files/8pXxh7iLxePJBxUeeNIv" alt="" width="563"><figcaption><p>Settings: Filter > Post CSV Secondary Filter</p></figcaption></figure>

## CSV Export Filter

<figure><img src="/files/FLCu9QLb44Vv6hD8t11O" alt="" width="563"><figcaption><p>Settings: Filter > CSV Export Filter</p></figcaption></figure>

* **Live** :  Generate CSV output files using the Live filter.
* **Post CSV** :  Generate CSV output files using the Post CSV filter.

When both options are enabled, two CSV files are generated simultaneously, with the suffixes "\_live" and "\_post" appended to the filenames.

{% hint style="info" %}
During real-time processing, FPS may temporarily drop depending on your PC. Data streaming continues, but saving data files simultaneously is not supported. Checking the Live option in the CSV Export Filter helps you review filter tuning results during real-time use.
{% endhint %}

## Preset Management

<figure><img src="/files/iRn29OSGfGiH0CVLkBqA" alt="" width="563"><figcaption><p>Settings: Filter > Preset Management, Top</p></figcaption></figure>

<figure><img src="/files/g1nB0P9ls6Lx8mFhnF1C" alt="" width="563"><figcaption><p>Settings: Filter > Preset Management, Bottom</p></figcaption></figure>

* **Preset name** :  Enter a name for the new preset.
* **Save** :  Save the current settings to the selected preset.
* **Add** :  Add a new preset.
* **Reload** :  Discard changes made before pressing Apply and reload the previous settings.
* **Init** :  Reset parameters to their default values.
* **Delete** :  Delete user-added presets, excluding the six default presets.


# Settings: Experimental

Settings to enable or disable additional processing along with other configurations.

Changes in this tab take effect instantly upon clicking Apply, regardless of Actor mode status.

### CSV Data File Play

This mode plays video files by loading data from a pre-generated CSV file. It is useful for verifying generated facial data or performing lightweight data transfer tests without running the full Facial Mocap process.

<figure><img src="/files/vdS7kXdrgh8jJrYoi4I9" alt="" width="563"><figcaption><p>Settings: Experimental > CSV Data File Play</p></figcaption></figure>

When playing a CSV file, the Actor screen is outlined in green for clear distinction. The Facemesh view is automatically disabled, and neutral calibration values as well as retargeting by the Actor Profile are not applied.

### Neutral Calibration

<figure><img src="/files/lYPZbSNHGOqu5I0vSanu" alt="" width="563"><figcaption><p>Settings: Experimental > Neutral Calibration</p></figcaption></figure>

* **Auto Scale Adjustment in Neutral Calibration**
  * This feature adjusts the scale range using the formula `1 / (1 - neutral_value)` when the neutral value is greater than 0.5, and automatically sets the scale to half of that range.
  * In previous versions (\~v1.6.3), this was always applied in order to compensate for the issue where changes in the corresponding blendShape appeared too subtle.
  * To prevent the side effect of noise amplification, the default setting is disabled upon installation.
* **Apply Eye Direction Neutral Value During Retarge**t
  * This option is not applied during Neutral Calibration.
  * When performing Neutral Calibration using a recorded video, it is recommended to disable this option if there are no front-facing frames.

### Emotional Improvement

An option for enhancing emotional facial expressions. The relevant blendShapes are **CheekSquint** and **NoseSneer**, and a separate pre-calibration factor has been applied in addition to the Actor Profile.

<figure><img src="/files/73gnEaq0nP0MbL0OUBNp" alt="" width="563"><figcaption><p>Settings: Experimental > Emotional Improvement</p></figcaption></figure>

### Sync Eye Movements

An option to determine whether the movements of both eyes should be synchronized or move independently. If the asymmetry between the movements of both eyes exceeds the threshold based on the selected reference eye, their movements will be synchronized.

<figure><img src="/files/XcC0qjuUIcShXz7ywzyM" alt="" width="563"><figcaption><p>Settings: Experimental > Sync Eye Movements</p></figcaption></figure>

### Head Rotation

Enable the use of Head Rotation values in LiveLink data

<figure><img src="/files/qegqICcAjqGSvhepq9VF" alt="" width="563"><figcaption><p>Settings: Experimental > Head Rotation</p></figcaption></figure>

{% hint style="info" %}
A Kalman filter is used for noise filtering, and when the Filter Preset is set to Stable, a median value of 4 might be excessive. It is recommended to increase responsiveness by sliding the control to the left and setting it to around 2.
{% endhint %}

### Font Size

An option to specify the font size of tooltips displayed in the Value and Actor Profile Editor.

<figure><img src="/files/DkIsJuDUfJs7TNnUru0i" alt="" width="563"><figcaption><p>Settings: Experimental > Font Size</p></figcaption></figure>


# Settings: Character

Unreal Engine and Unity package import settings in the Character window

## Display Configuration

<figure><img src="/files/tGoJG60bqjccEjGSGVSD" alt="" width="563"><figcaption><p>Settings: Character > Display Configuration</p></figcaption></figure>

* **Resolution Width / Height, Resize Percent**

  This is the resolution option applied when running the Character Package built in Unreal Engine or Unity. The Resize Percent is applied during execution.
* **Default Character Number**

  The default selected index in the character setting slide when the YanusLIVE starts.
* **Deactivate Actor on Startup**

  Automatically stops the Actor if it is running when a new Character is launched or when switching to a different mode.&#x20;

{% hint style="info" %}
Deactivate Actor on Startup option is recommended to enable this option on low-spec PCs to prevent potential issues during mode switching. When stopping the Actor, the previous frame that was running may remain visible on the screen.
{% endhint %}

## Character 1\~5 Slots

<figure><img src="/files/Y716JfeXZ00vuq3sMdHv" alt="" width="563"><figcaption><p>Settings: Character > Slots (1~5)</p></figcaption></figure>

* **Mode Name** :  The name displayed in character mode.
* **Execution File Path** :  Specify the path and file for execution.
* **Execution Type** :  Select the engine used to create the executable file, either Unreal Engine or Unity.

## Pixel Streaming Mode

&#x20;This feature captures the screen of an Unreal Engine project remotely. It allows including the character without building the execution package.

<figure><img src="/files/i6BMnfeJj5NuyYEgEtsn" alt="" width="563"><figcaption><p>Settings: Character > Pixel Streaming Mode</p></figcaption></figure>

* **IP Address**: The IP address of the PC running Pixel Streaming.
* **Port Number**: The default port is 80.

{% hint style="info" %}
This method may introduce more latency compared to the above approach.We also recommend using a Player Layout that displays YanusLIVE as a small overlay within the Unreal Engine project environment.
{% endhint %}


# Settings: Graph

Configuration to open graphs from CSV data files

&#x20;This feature allows you to view graphs of the generated Facial Data by each blendShape for reference.\
It supports up to 5 data sets, making it useful for comparing filter settings or different options.

## Data Input Settings for Graph Display

After configuring the settings, press the Apply button to open the graph.

<figure><img src="/files/saXR1Ohf3MvoLE8sp1Fk" alt="" width="563"><figcaption><p>Settings: Graph > Data 1~3 Input Sample</p></figcaption></figure>

{% hint style="info" %}
If there are no changes and the Apply button is disabled, it is recommended to change text elements such as the Graph Title to notify the user.
{% endhint %}

## Graph Example

<figure><img src="/files/ZL9zzE1GL0lKS1JhRzcS" alt=""><figcaption><p>Settings: Graph > Popup Graph Sample</p></figcaption></figure>

## Automatic Input via Batch Generator

Right-click on an item where the Facial Data file generation is complete, and select\
‘View Graph Settings’ from the context menu to open the ‘Select CSV Files’ window.

<figure><img src="/files/ZuvYUB0NK2ksZaT06jhe" alt=""><figcaption><p>Settings: Graph > Automatic Input via Batch Generator</p></figcaption></figure>

A list of CSV files related to the video file name will appear. Select the desired files using checkboxes,\
and press the OK button to automatically load them into Settings: Graph.


# MENU/WINDOWS

## Overview

Introduction to the menu bar items of the YanusLIVE main window and the sub windows.

### Menu

* [Menu page](/yanuslive/menu-windows/menu)

{% tabs %}
{% tab title="File" %}

* Open Video File

* Open Actor Profile File

* Save As Actor Profile File

* **Generate Facial Data File**

* **Batch Generator**

* **Settings**

* Show Settings Folder

* Show Local Folder

* Show Actor Profile Folder

* Exit
  {% endtab %}

{% tab title="View" %}

* Reset Layout

* Player Layout

* \[HyperDeck / OBS Studio]

* \[Charcter]

* \[Actor]

* \[Values]

* \[Actor Profile]

* FaceMesh

* Live Information
  {% endtab %}

{% tab title="Tools" %}

* Restart Processes

* Reboot HyperDeck

* **Filter Designer**
  {% endtab %}

{% tab title="Help" %}

* About

* Homepage

* Manual

* **License**
  {% endtab %}
  {% endtabs %}

### Windows

* [Generate Facial Data File](/yanuslive/menu-windows/generate-facial-data)
* [Batch Generator](/yanuslive/menu-windows/batch-generator)
* [Settings](/yanuslive/menu-windows/settings)
* [Filter Designer](/yanuslive/menu-windows/filter-designer)
* [License](/yanuslive/menu-windows/license)


# Menu

We present all the menu items together with the following screenshots. Explanations are provided only when necessary

## File

<div align="left"><figure><img src="/files/qg7hzsSDNd4qcbcW79Bb" alt="" width="275"><figcaption><p>Menu > File</p></figcaption></figure></div>

* **Settings** :  Also accessible via the gear icon in the Character Pane.
* **Show Settings Folder** :  the path for saving user settings.

## View

<div align="left"><figure><img src="/files/8b8ylfkSkQkUlpwcnUya" alt="" width="217"><figcaption><p>Menu > View</p></figcaption></figure></div>

* **Reset Layout** :  Reset to the initial default layout.
* **Player Layout** :  Show only the Actor Pane; hide others

## Tools

<div align="left"><figure><img src="/files/GY7mOEE7eHgQIsbyne6V" alt="" width="233"><figcaption><p>Menu > Tools</p></figcaption></figure></div>

* **Restart Processes** :  This command restarts the internal core logic. Use it as a troubleshooting step before fully closing and reopening the program when encountering abnormal behavior.
* **Reboot HyperDeck** :  An option to restart the HyperDeck, used in case of issues with the HyperDeck. This function is useful when the communication link is established, but the USB video output is malfunctioning.

## Help

<div align="left"><figure><img src="/files/UuM6tZOJZyoX99IP9CzU" alt="" width="174"><figcaption><p>Menu > Help</p></figcaption></figure></div>

* **License** :  Opens the license activation/deactivation dialog window. “When installing YanusLIVE for the first time or migrating to a new PC, you must deactivate the license on the previous machine before activating it on the new one


# Generate Facial Data

The Facial Mocap result data is saved in a CSV file format. The mode settings and options used during the conversion process adhere to the current Settings configuration.

<figure><img src="/files/mDJu3ejqXAXLbODYGdR7" alt="" width="563"><figcaption></figcaption></figure>

* **Video File**: Select the video file from which to generate data.
* **Actor Profile**: Load the Actor Profile tuning data to apply during data generation.
* **Output File**: Specify the path and file name where the converted CSV file will be saved.
* **Data Type**:
  1. **Full Process**: Generates a file with all selected options, including filters and Actor Profile applied.
  2. **Unfiltered Data**: Generates data with only the Actor Profile applied, without filters.
  3. **Raw Data**: Generates data by purely analyzing and tracking facial expressions.


# Batch Generator

This feature enables batch processing of the Generate Facial Data operation.

1. Easily group and configure diverse facial video paths with different settings, creating a well-organized task list
2. Tasks are preserved in a managed list, enabling you to add mid-process footage, resume incomplete tasks, or retry failed ones seamlessly
3. Seamlessly integrate with existing YanusLIVE features to monitor input and output before and after conversion with a single click

<figure><img src="/files/d8zqC37opp2z7xAZRF1D" alt=""><figcaption><p>Batch Generator</p></figcaption></figure>

{% hint style="info" %}
Please refer to the enlarged screenshot above for details. The task configuration is divided into three sections following the setup sequence. Upon pressing the Generate button to initiate the task, the overall progress bar appears at the bottom.
{% endhint %}

Next, please note the key points related to the interface.

## Search

Search Video Files Containing Keywords in the Selected Folder

* **Include Subdirectories** :  whether to search within subdirectories
* **Auto-Detect Rotation**:  auto detection of face rotation in video

Configure the path, keywords, and options, then click the magnifying glass icon to list search results in the Video Files section.

## Video Files & Task Options

* **Checkbox in the First Column**:  for adding the tasks
* **Selection of Multiple Rows (Highlighted in Blue)** :  to modify task options
* **Settings and Actor Profile** : Default to the current YanusLIVE settings
* **Output Folder** :  Default to the same directory as the video files

#### Generate Options

* **Modify Options per Item**: Double-click an item or use the right-click context menu to change options
  * Access the context menu by right-clicking on a single item.&#x20;
  * Double-clicking the File Name column enables direct playback of the associated video in the YanusLIVE main window.

<figure><img src="/files/9cQUSsQHw42pd0ezHcFj" alt="" width="442"><figcaption><p>Batch Generator > Video Files &#x26; Task Options > Context Menu</p></figcaption></figure>

* **Batch Modification**:  Select multiple rows and use **Options** button to apply changes to all
  * Enter only the fields to modify, then click Apply to batch update blue-highlighted files.

<figure><img src="/files/niq7dmqTWP3Woyg4SEQh" alt="" width="563"><figcaption><p>Batch Generator >  Video Files &#x26; Task Options > Generate Options</p></figcaption></figure>

Once files are selected and options configured, clicking the **Add Tasks** button adds the details to the Generate Task Queue table.&#x20;

## Generate Task Queue

The following are the function buttons.

* **Initialize** : Clear the Task queue
* **Generate** :  Executes the queued tasks.
* **Pause** :  Temporarily pause task execution
* **Stop** :  Stops all tasks (task currently being processed will be cancelled).
* **OK** :  Close Batch Generator (if tasks are running or paused, they should be stopped)

{% hint style="info" %}
Closing the window prior to initializing with the Initialize button automatically saves the Generate Task Queue configurations. Task additions can then be resumed via the Video Files & Task Options section. This management functionality enables task definitions with varying Actor Profile applications per actor and distinct Settings for each shooting unit.
{% endhint %}

<figure><img src="/files/901syESF8ygrIjGYm4pM" alt="" width="563"><figcaption><p>Batch Generator > Generate Task Queue > Context Menu</p></figcaption></figure>

Items can be managed through the context menu, accessible by right-clicking both prior to and after generation. Additionally, the generated CSV file can be launched in the YanusLIVE main window using the specified settings.


# Settings

On this page, we introduce the screen view with window size set to display all items in each tab. Detailed explanations are provided in a separate Settings category.

{% tabs %}
{% tab title="Network" %}

<figure><img src="/files/k0F3TnGwSLtXJyhsV62D" alt="" width="563"><figcaption><p>Settings > Network</p></figcaption></figure>
{% endtab %}

{% tab title="Actor" %}

<figure><img src="/files/a3z9DSnqQEoSDaxtNynR" alt="" width="563"><figcaption><p>Settings > Actor</p></figcaption></figure>
{% endtab %}

{% tab title="Filter" %}

<figure><img src="/files/3hec0QS0bSa3Q2eayQ0i" alt="" width="563"><figcaption><p>Settings > Filter</p></figcaption></figure>
{% endtab %}

{% tab title="Experimental" %}

<figure><img src="/files/ND78O39mfgldwQNFOxQA" alt="" width="563"><figcaption><p>Settings > Experimental</p></figcaption></figure>
{% endtab %}

{% tab title="Character" %}

<figure><img src="/files/A7sqnQ6s4SewTQN2vDjs" alt="" width="563"><figcaption><p>Settings > Character</p></figcaption></figure>
{% endtab %}

{% tab title="Graph" %}

<figure><img src="/files/HNEYQryOFKXOlIaGHOfV" alt="" width="563"><figcaption><p>Settings > Graph</p></figcaption></figure>
{% endtab %}
{% endtabs %}


# Filter Designer

Set the Filter Preset to a value other than Stable, and check Unfiltered when creating a Facial Data File.\
There is a feature that allows you to open the Unfiltered data file and quickly view the results of each filter setting as a graph.

## Filter Mode : Live

<figure><img src="/files/9Cqu8WEjrJ2mM7l4YVis" alt="" width="563"><figcaption><p>Filter Designer > Filter Mode : Live</p></figcaption></figure>

* **Filter Group**

  &#x20;When the window opens, the 1st setting from the current Settings is loaded as the default value.\
  You can select the 1st and 2nd Filters and use the Get / Set buttons to load or tune the Settings.

## Filter Mode : Post CSV

<figure><img src="/files/CuexGh4R60rMLgjnvVfP" alt="" width="563"><figcaption><p>Filter Designer > Filter Mode : Post CSV</p></figcaption></figure>

## Filtered Graph Example

Filter Preset :  Default Responsiveness

#### Live Filter&#x20;

<figure><img src="/files/Tdpxw2HleC6HYK6NoXRD" alt="" width="563"><figcaption></figcaption></figure>

#### Post CSV Filter

The Post CSV filter is a bidirectional Butterworth filter with no delay.

<figure><img src="/files/iZjCY32HgzbgfipQXyCn" alt="" width="563"><figcaption></figcaption></figure>

{% hint style="info" %}
A short demo\_short\_yang.mp4 video was used. For longer videos, you can trim specific segments by setting Start Time and Duration in the Graph Option.
{% endhint %}


# License

When the license is not activated, only the Actor Pane in YanusLIVE will be shown,\
and most buttons will be disabled.

To open the License window, go to Help Menu and select License.

<figure><img src="/files/V62jNI8SiiTTV83PH9Bn" alt="" width="496"><figcaption><p>Menu > Help > License</p></figcaption></figure>

Copy and paste the License Key, then click the Activate button. If the license verification is successful, the YanusLIVE layout will reset and a confirmation message will appear.

<figure><img src="/files/YMj5lYDJB34m2tgMc9cH" alt="" width="453"><figcaption><p>License Window (When Inactive)</p></figcaption></figure>

When the license is activated, only the Deactivate button will be enabled as shown below.\
Once deactivated, the view settings will change accordingly.&#x20;

<figure><img src="/files/chNttzsCGVE5GxtMO38x" alt="" width="453"><figcaption><p>License Window (When Activated)</p></figcaption></figure>

You can deactivate without entering the License Key, but to transfer the license to another PC, you must have the License Key ready.


# FUNCTION GUIDE


# OBS Studio Guide

Video input and control through OBS Studio are supported. This feature allows you to input standard USB cameras into YanusLIVE as a virtual camera in real-time

## Tutorial Video

Connect YanusCAM LITE with OBS: Simple Setup Guide

{% embed url="<https://www.youtube.com/watch?v=ECGMe3Yr6IU>" %}
OBS Studio Connection > Simple Setup Guide
{% endembed %}

## Setup Guide

### OBS Studio WebSocket Control Support

Added OBS Studio as an option in the YanusLIVE HyperDeck window's 'Device' combo box.&#x20;

When connecting to OBS Studio, the following automatic settings are applied.

* OBS Video Settings to USB Camera settings (Frame Rate, Resolution Width/Height).&#x20;
* Select USB Camera mode and OBS Virtual Camera device, then start Actor Mode.&#x20;

Note: The Start Virtual Camera button in OBS needs to be pressed manually.

### Local recording via OBS

* Set the local path to OBS Output > Recording Tab > Recording Path when connecting or when settings change.
* Set the recording filename format via OBS Advanced > Recording > Filename Formatting.

Note: When OBS Output > Output Mode is set to Advanced, recording can be paused.

### 1. YanusLIVE Settings for OBS Studio

In YanusLIVE, no special settings are required to connect with OBS Studio. The connection can be made with the default settings. OBS Studio must be installed on the same PC as YanusLIVE, and the port and password settings in OBS must match.

* IP Address
* Port Number
* Password

### 2. OBS Studio Settings for Connecting with YanusLIVE

* In the OBS menu, go to **Tools** → **"WebSocket Server Setting"**, and check **"Enable WebSocket server"**.

Note. When using "Enable Authentication," enter the same password in  "**YanusLIVE > Settings**".

<figure><img src="https://lh7-rt.googleusercontent.com/slidesz/AGV_vUdJmj_xzyE9QoUCVubfcQRRUUxnS3oHkT22nf1NaSQ1MTxSYfdlSqrPtdQdSbduaFxAlaXxoXz7Nn0W2OIpni4o9mcvEoFtBNc2g7PcrLAl72RpKBHMctJ8F6kHguekAx-yScyRm3z_asXlBRa5uAVMIaaBtWzeHi0IOa6IVWWLSLd15euXFA4=s2048?key=n03uSH3twrUlXk8y6W2ZMQ" alt="" width="375"><figcaption></figcaption></figure>

* To connect with YanusLIVE, you need to run "**Start Virtual Camera**" in OBS Studio. Then, in the Actor window of YanusLIVE, set the **Actor Mode** to **USB Camera** and choose **OBS Virtual Camera** as the **Capture Device**. Once connected, press the play button to start.

### 3. OBS Studio Setting

#### OBS Studio "Video" Setting

* In the OBS Studio menu **settings**, go to the "**Video"** section and change the "**Base Resolution"** and "**Output (Scaled) Resolution"** to **1280 x 720**. \
  (This setting can affect the performance of the PC, so it is recommended to set it to 720p resolution.)
* Also, adjust the "**Common FPS Values"** to a value between 30 or 60, according to the supported frame rate of the camera. \
  (If 60 frames are supported and the PC performance is good, select 60 frames.)

<figure><img src="/files/g2Dqn9wZwqZ8AgsudIqE" alt="" width="563"><figcaption></figcaption></figure>

#### OBS Studio "Output" Setting

* In the OBS Studio menu settings, the **"Output Mode"** in the **"Output"** section must be changed to **"Advanced"**. This will allow you to set the **"Recording Path"**, which will automatically be matched to the path set in YanusLIVE.
* Additionally, in the **Output** section, go to the **Recording** tab under **Recording Settings** and select either **MP4** or **MOV** as the recording format. Also, choose a hardware encoder such as **NVIDIA NVENC H.264** under the **Video Encoder** option.

<figure><img src="https://lh7-rt.googleusercontent.com/slidesz/AGV_vUfJSq4Lel1ba_6wQNG-Y7PGz530rljml8wkevmOsvtpJFoQTYVHUuY7d6nF8JBWsYpx80iWduU0jyRAi0zx9HJuvzHpP3XfTNZxiaCAt8oC_oqPwjt6R_SWgsd0DaOAtMd9KeVhM-s55zLWORtwkRKnJMKHmGKskcDD58JMEyOCJNQhv_eheIM=s2048?key=n03uSH3twrUlXk8y6W2ZMQ" alt="" width="563"><figcaption></figcaption></figure>

#### OBS Studio "Advanced" Setting

* In the OBS Studio menu settings under the **"Advanced"** section, the **"Filename Formatting"** for recording is automatically synchronized with the recording name option in YanusLIVE.

<figure><img src="https://lh7-rt.googleusercontent.com/slidesz/AGV_vUc8c-DCcgMXFYcFuYuAhkkVMZvLN9kxYh7tARIZkgts-oYEuOpZh8AkNLfYkOCh2xz3nWriHYw1Ur9dNRALJDM3dTM9KjFD383dJ_Vg3bVPJNUvhlDk-3ULWCBXCMyCtof7iLsyLlphj653Z3CQNR7O_O702ekX4-u34Qar6vNjVnRxEoS-Sn8=s2048?key=n03uSH3twrUlXk8y6W2ZMQ" alt="" width="563"><figcaption></figcaption></figure>

### 4. Automatically configure settings and start with a single click of the "Connect" button.

* When you select OBS Studio from the device menu and press the **Connect** button, the HyperDeck mode switches to OBS Studio mode, and the interface changes accordingly.

<figure><img src="/files/3jSPkRCdokh924WRvRFI" alt=""><figcaption></figcaption></figure>

* Double-click on the video file to switch to play mode, and use the Live option button for one-click switch to Camera mode.

<figure><img src="/files/IlnaOe0FhKsrHlSk47JB" alt=""><figcaption></figcaption></figure>

* Set the path and filename, then start recording. When paused, the indicator blinks yellow.
* The pause button during recording is enabled only if the **NVIDIA encoder** is selected under the **Video Encoder** in the **Output** settings.

<figure><img src="/files/SGPpiX0OrTXsN79pP8cl" alt=""><figcaption></figcaption></figure>


# HyperDeck Guide

This is the installation guide for using YanusCAM Pro together with HyperDeck.

## Tutorial Video&#x20;

Connecting Facial Mocap YanusLIVE & YanusCAM: Easy Guide

{% embed url="<https://www.youtube.com/watch?v=GFZYJlReJ8I>" %}
HyperDeck Connection > Easy Guide
{% endembed %}

## Setup Guide

<figure><img src="/files/MwOTd7iK53hINYQxvIAu" alt=""><figcaption><p><strong>HyperDeck Studio HD Mini by Blackmagic Design</strong></p></figcaption></figure>

[Black Magic Design Website](https://www.blackmagicdesign.com/products/hyperdeckstudio/techspecs/W-HYD-11)

1. **Connecting the PC and HyperDeck**\
   To connect the HyperDeck to a PC, you need to connect the Ethernet, USB-C, and SDI IN ports on the HyperDeck. The Ethernet can be connected directly to the PC, but a static IP must be used. Connect the USB-C (EXT DISK) port to the PC. The PC's USB port can be either USB-A or USB-C.

<figure><img src="/files/ZQkYC4HGLzTVgGd0WJWj" alt="" width="375"><figcaption></figcaption></figure>

<figure><img src="/files/XvaIphEFrWChYEVGEQ1g" alt=""><figcaption><p><strong>&#x3C;Connecting HyperDeck to the PC></strong></p></figcaption></figure>

For the SDI-IN connection, use Acsoon's Rx device and the provided SDI cable. It is recommended to use the provided cable, as using an incorrect cable may result in improper video input.

2. **Network Setting**\
   After completing the network connection, you need to configure the IP settings for both the HyperDeck and the PC. Set the IP on the HyperDeck to Static IP and assign the desired IP.

<figure><img src="/files/RqBwp1FLmTIyNpEHUQ8E" alt="" width="316"><figcaption><p>&#x3C; Static IP ></p></figcaption></figure>

<figure><img src="/files/3jN6GekOlTcDSTyCuuBi" alt="" width="316"><figcaption><p>&#x3C; <strong>IP Input ></strong></p></figcaption></figure>

3. **YanusLIVE Settings**\
   Once the IP on the HyperDeck is set to static, you must also enter the same IP into the Settings of YanusLIVE.


# Remote Trigger Guide

The remote trigger is a feature designed for use with other equipment, enabling remote commands such as recording and stopping to be sent or received over the network to control other devices.

### Remote Trigger Receiver/Sender Support

* Receiver Modes: YanusLIVE, XEROmotion, Xsens, OptiTrack.
* Sender Mode: YanusLIVE.
* Supports starting/stopping recordings in OBS Studio and HyperDeck, as well as setting filenames via Trigger.

### 1. Remote Trigger Setting

In the YanusLIVE settings menu, simply select the software to trigger from the **"Remote Trigger Receiver"** or **"Remote Trigger Sender"** options, and specify the port. Once this is done, the setup is complete.

<figure><img src="/files/8DOuijpBcC8RPDI4VkXr" alt="" width="563"><figcaption><p>Settings: Network > Remote Trigger</p></figcaption></figure>

**Remote Trigger Receiver**

* Mode
* Port Number

**Remote Trigger Sender**

* Mode
* Port Number

### 2. Trigger Mode

In the OBS Studio or HyperDeck window of YanusLIVE, check the box for **Receiver** or **Sender** in the **Trigger option** to activate the function.

<figure><img src="/files/KPPcwwmRp5KyPuuyFVEH" alt=""><figcaption><p>Check the "Receiver" Trigger option to enable UDP reception. Verify events through the log display under "Values".</p></figcaption></figure>

If the "Sender" option under Trigger is checked, pressing the Record button broadcasts an XML message type trigger to the configured port within the same network.

<figure><img src="/files/DBluNIfr2ELZQsIshAWp" alt=""><figcaption></figcaption></figure>

This is the XML message from YanusLIVE Trigger Sender. It is similar to other devices, but variables related to synchronization may be added in the future.

#### Capture Start

\<?xml version="1.0" encoding="UTF-8" standalone="no" ?>\
\<CaptureStart>>\
\<Name VALUE="record\_test\_t11" />\
\<SessionName VALUE="" />\
\<DatabasePath VALUE="D:/YanusSTUDIO/Test/1007" />\
\<TimeCode VALUE="14:48:48:05" />\
\<TimeCodeRate VALUE="60" />\
\<Notes VALUE="" />\
\</CaptureStart>

#### Capture Stop

\<?xml version="1.0" encoding="UTF-8" standalone="no" ?>\
\<CaptureStop>>\
\<Name VALUE="record\_test\_t11" />\
\<TimeCode VALUE="14:48:52:44" />\
\<Notes VALUE="" />\
\</CaptureStop>


# Installation

This section explains the YanusLIVE installation steps,\
license activation, and the sample settings included during installation.

## Installation

1. Download the YanusLIVE installation compressed file.

{% embed url="<https://www.yanusstudio.com/downloads>" %}
Downloads Page Link
{% endembed %}

2. Extract the downloaded compressed file.

&#x20;     ![](https://lh7-rt.googleusercontent.com/slidesz/AGV_vUfeYyhZxFc7sksc0UdkAJWhxEOt5ECHItHxZLQWHzp1n6XbpNeBgk22ziGJj7EiB_D3f5P6HtKQMDLWe3dfR8VRUDCcNh41FxpbcGk8IowDFMeiEhZKhlk-1nG3on8sEuGiQTy3hQ=s2048?key=Has_RQHHjKwPYIIt88xeDw)

&#x20;     ![](https://lh7-rt.googleusercontent.com/slidesz/AGV_vUcTVG7qtLsM3o3KszAfve0w5eYWUnnCQ5U8SHAtLgOtOfhKu3O4mV8w9ypCUzX5rKvAaJ-TVkugw7Zyi7M14kZSUTjHDckz8ai9rOf2lAJy-I2J2moUWp7zb5KFi3PXKhGFc8gwpQ=s2048?key=Has_RQHHjKwPYIIt88xeDw)

3. Run the setup file.

<figure><img src="/files/TKCSWx5ppRvpSuqN9Mq7" alt="" width="558"><figcaption><p>Installer program procedure</p></figcaption></figure>

> During installation, if any permission or security prompts appear, please allow or grant access to continue the process.

4. After installation is complete, a shortcut icon will be created on the desktop and in the Program Menu.

<figure><img src="https://lh7-rt.googleusercontent.com/slidesz/AGV_vUe478mAl8rm3hH7WygvOfn9-KtfbOpVqdhcEM6m763z0J-TE5lnp_CaS5LPipOHYxw083otqPOERtcE5BahdFn-ygBSAVIj7yc6mL8XPP6HBbDTJHf5qMWV-geJdbyF9mFzGEA6vA=s2048?key=Has_RQHHjKwPYIIt88xeDw" alt="" width="188"><figcaption><p>Desktop icon</p></figcaption></figure>

<figure><img src="https://lh7-rt.googleusercontent.com/slidesz/AGV_vUdTtGTmhCjBGLT849nXLSJ8fiioN_N0uOzjm0rWBuv3Vw_LB6bEriMvV1CZi8dqoDCPnLvFk9sviF4XuZKP2Sy4y77nn5gDKq41qFvzJuJTF71r4K4Ud1L67yeafc7gOdyAQXrC2Q=s2048?key=Has_RQHHjKwPYIIt88xeDw" alt="" width="375"><figcaption><p>Program Menu</p></figcaption></figure>

{% hint style="info" %}
If a previous version exists, it will be retained while the new version is installed.
{% endhint %}

## Uninstallation

1. &#x20;Run Add or Remove Programs.

&#x20;     ![](/files/uzAx2kOL1cqWbFGyO3SW)

2. Search for “Yanus” and uninstall the version you want to remove.

<figure><img src="/files/QfHTvSgTFjnQcwa3v7wT" alt="" width="534"><figcaption><p>Add or remove programs</p></figcaption></figure>

## [License Activation](/yanuslive/installation/license-activation)


# License Activation

If the license has not been activated before,this message window will appear when you start the program for the first time.

<figure><img src="/files/BA8SU5ofu0uTHUJtYfjR" alt="" width="345"><figcaption><p>License Key Popup Message</p></figcaption></figure>

To open the License window, go to Help Menu and select License.

<figure><img src="/files/Kz6teK9mT3H44DBbUgOr" alt="" width="563"><figcaption><p>YanusLIVE Layout (License Not Activated)</p></figcaption></figure>

Copy and paste the License Key, then click the Activate button.&#x20;

<figure><img src="/files/YMj5lYDJB34m2tgMc9cH" alt="" width="453"><figcaption><p>License Window</p></figcaption></figure>

If the license verification is successful, the YanusLIVE layout will reset and a confirmation message will appear.

<figure><img src="/files/HADdpAvwROVHZItvrmVU" alt="" width="239"><figcaption><p>License Activation Popup Message</p></figcaption></figure>

<figure><img src="/files/9HsWbMeTSbHQXUyn83cW" alt=""><figcaption><p>YanusLIVE Layout (Upon First Run and Activation)</p></figcaption></figure>

## [Sample Settings](/yanuslive/installation/sample-settings)


# Sample Settings

The following section describes the configuration settings for the sample files provided with the installation. These settings form the foundational elements of the program’s default setup.

### Sample Files Included for Default Demostrations

* The following files are copied to `{User}/YanusLIVE/demo` upon installation.

<figure><img src="/files/aSmH7DZZTWV0zkY1SlKZ" alt=""><figcaption></figcaption></figure>

* Sample Files

  * Unity Character package
  * ejpark (Fast facial movements, 19 seconds)
  * yang (Rapid speech, 3 seconds)

  Includes Videos, ActorProfile, and Facial Data CSV File

* Press Two Buttons to Start the Default Demo in YanusLIVE

<figure><img src="/files/KUPShH5991G1EcGt93yO" alt="" width="563"><figcaption></figcaption></figure>

1. Character Window > Start Button
   1. A security permission prompt may appear on first launch.
2. Actor Window > Start/Pause Button
   1. While playing, a pause icon is displayed.
   2. You can adjust the slider while in pause mode.

* Automatically Configured with Sample Files on First Launch

<figure><img src="/files/bMZhnrAedfOqMrgEfIYL" alt="" width="563"><figcaption></figcaption></figure>

1. Device Selection : `OBS Studio`
   1. Default Setting Changed in HyperDeck
2. Local Folder Path :  `{User}/YanusLIVE/demo`
3. Actor mode :  `Video File`
4. File Path :  `User}/YanusLIVE/demo/demo_video_ejpark.mp4`
5. Rotate Left 90 Degrees : `On`
6. View Facemesh : `On`

<figure><img src="/files/F0zvvIYhoVt4T8DNwg6D" alt="" width="347"><figcaption></figcaption></figure>

7. Menu > View, Live Information : `Checked`
8. Character mode : `Vroid`
   1. Settings > Character, Character 1

<figure><img src="/files/WGFqioIHUxi0lPtr0h3P" alt="" width="563"><figcaption></figcaption></figure>

9. Actor Profile :  `User}/YanusLIVE/demo/actor_profile_ejpark.json`

<figure><img src="/files/KUWa9xRM7ez8IOfrFWEx" alt="" width="375"><figcaption></figcaption></figure>


# Notices & Resources


# v1.6.4 Release Notes

Release Date: June 12, 2025

### Sample Files Included for Default Demostrations

* The following files are copied to `{User}/YanusLIVE/demo` upon installation.

<figure><img src="/files/aSmH7DZZTWV0zkY1SlKZ" alt=""><figcaption></figcaption></figure>

* Sample Files

  * Unity Character package
  * ejpark (Fast facial movements, 19 seconds)
  * yang (Rapid speech, 3 seconds)

  Includes Videos, ActorProfile, and Facial Data CSV File

* Press Two Buttons to Start the Default Demo in YanusLIVE

<figure><img src="/files/KUPShH5991G1EcGt93yO" alt="" width="563"><figcaption></figcaption></figure>

1. Character Window > Start Button
   1. A security permission prompt may appear on first launch.
2. Actor Window > Start/Pause Button
   1. While playing, a pause icon is displayed.
   2. You can adjust the slider while in pause mode.

* Automatically Configured with Sample Files on First Launch

<figure><img src="/files/bMZhnrAedfOqMrgEfIYL" alt="" width="563"><figcaption></figcaption></figure>

1. Device Selection : `OBS Studio`
   1. Default Setting Changed in HyperDeck
2. Local Folder Path :  `{User}/YanusLIVE/demo`
3. Actor mode :  `Video File`
4. File Path :  `User}/YanusLIVE/demo/demo_video_ejpark.mp4`
5. Rotate Left 90 Degrees : `On`
6. View Facemesh : `On`

<figure><img src="/files/F0zvvIYhoVt4T8DNwg6D" alt="" width="347"><figcaption></figcaption></figure>

7. Menu > View, Live Information : `Checked`
8. Character mode : `Vroid`
   1. Settings > Character, Character 1

<figure><img src="/files/WGFqioIHUxi0lPtr0h3P" alt="" width="563"><figcaption></figcaption></figure>

9. Actor Profile :  `User}/YanusLIVE/demo/actor_profile_ejpark.json`

<figure><img src="/files/KUWa9xRM7ez8IOfrFWEx" alt="" width="375"><figcaption></figcaption></figure>

### CSV Playback via Double-Click from the Local File List

<figure><img src="/files/l0ROhegdy8JLw95rdYop" alt="" width="563"><figcaption></figcaption></figure>

1. Double-clicking a CSV file plays the matching video in `Video File Mode with CSV Data File`.
   1. CSV files with additional tags in the filename are also matched with the corresponding video files automatically.
   2. Double-clicking the video file again plays it in the default Video File Mode.

2. When playing a CSV file, the Actor screen is outlined in green for distinction.
   1. View Facemesh is automatically disabled.
   2. Neutral Calibration values and retargeting by Actor Profile are not applied.

<figure><img src="/files/VCWzOGkQcl2Hr0bi86pn" alt="" width="563"><figcaption></figcaption></figure>

3. This feature automates the manual **CSV Data File Play** setting found in **Settings > Experimental**.
   1. If the video file and CSV file are not in the same directory or their names do not match, this setting can be used.
   2. Note that changes to the parameters in **Settings** take effect only after clicking **Apply**.
   3. When playing a video not by double-clicking in the **Local File List**, but from the **Actor window** or by using the **play/pause buttons**, the system checks the frame count of both the video and CSV file if they do not match, a warning is displayed and playback is aborted.

### Automatic Scaling Option for Neutral Calibration

The following highlights the updates in Settings > Experimental.

<figure><img src="/files/WGScKsMSpAlkyOuArE8W" alt="" width="563"><figcaption></figcaption></figure>

1. Added a new "**Neutral Calibration**" subsection
   1. "**Auto Scale Adjustment in Neutral Calibration**"
      1. This feature adjusts the scale range using the formula `1 / (1 - neutral_value)` when the neutral value is greater than 0.5, and automatically sets the scale to half of that range.
      2. In previous versions, this was always applied in order to compensate for the issue where changes in the corresponding blendShape appeared too subtle.
      3. To prevent the side effect of noise amplification, the default setting is disabled upon installation.
   2. "**Apply Eye Direction Neutral Value During Retarge**t"
      1. This option is not applied during Neutral Calibration.
      2. When performing Neutral Calibration using a recorded video, it is recommended to disable this option if there are no front-facing frames.
2. The "**Font Size**" section has been moved downward.
3. The option previously under "**Sync Eye Movement**"
   1. "Enable Neutral Cal. Eye Direction" has been renamed and moved to the new "Neutral Calibration" subsection.

### Persistent user Preferences for 'View Facemesh' and 'Live Information'

In previous versions, the settings for these two view options were not saved upon program exit. This has been implemented in the current version.


# Summary of Features

## Basic Hardware

&#x20;Using the proprietary YanusCAM Pro and BlackMagic Design's HyperDeck Studio HD Mini provides a stable recording environment and a user-friendly UI for on-site usability.

* YanusCAM Pro

  : A camera setup with 60Hz, 720P (1280x720) resolution,&#x20;

  &#x20;and wireless video transmission.
* HyperDeck

  : Functions as a recorder and SDI to USB converter,

  &#x20; supporting timecode and reference signal input.

## Additional Input Support

&#x20;YanusLIVE also supports inputs from other USB cameras and video file inputs.

## Monitoring Environment

&#x20;YanusLIVE allows real-time monitoring of both the actor's face and the targeted character side by side. It supports importing exe packages built in Unreal Engine or Unity and can also capture Unreal Engine project screens through PixelStreaming (a plug-in for Unreal Engine). This makes it easy to check and tune the final output.

## Retarget Setup

&#x20;You can calibrate the neutral face and adjust the output values of BlendShape using sliders. Calibration sets the neutral state of BlendShape values, automatically applying an offset to set all BlendShape values to 0. Retargeting adjusts scale and offset values, applying the calculation (Raw Data + Offset) \* Scale. Settings are managed in an Actor Profile saved as a JSON file.

## Data Streaming

&#x20;By default, LiveLink named "Yanus\_LIVE\_00" is transmitted to LocalHost. You can use it with Unreal Engine exe packages provided for demonstration or an Unreal Project opened on the same PC. Additionally, it supports setting and transmitting up to two more LiveLinks for full-body demonstrations and external facial monitoring environments.

## CSV Data Output

&#x20;Reads saved videos to generate data files in ARKit standard CSV format. The CSV data can be imported as animation into Maya's Yanus Retarget. It is also compatible with solutions that use ARKit standard data like Unreal Engine, Unity, and Blender.


# YanusLIVE\_Old


# 1. Interface

<figure><img src="/files/av4UX5NS3TgbqTWPOFF3" alt=""><figcaption></figcaption></figure>

### 1-1. HyperDeck

&#x20;

<figure><img src="/files/f5uAQ812qDT2Hfrvziqf" alt=""><figcaption></figcaption></figure>

This section allows control over the HyperDeck Mini from BlackMagic Design, a device for recording video and inputting HMC video into a PC. It includes options for recording, playing, and transferring recorded videos to the PC.

### 1-2. Actor

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXfUVIk5NiVRBjFev232lB92092ZaTIsaE0kEx92Csp3Q4tnZ7O3s-O8QEewmMowZ65MoV1W8yMnt5_HhmCu67wHb9wNBwGu9dILB4zbryPBS0im-yAtLQyw80rhL4jIHQp72N40-fErJUEtcIa97UfeRCVk?key=g9SNe8floSX29K5Ha8UM_Q" alt=""><figcaption></figcaption></figure>

This function allows the playback of video and live generation of facial tracking from the video. It supports pausing and searching within the video, and users can choose to play videos from YansuCAM input via HyperDeck, USB interface cameras, or MP4 video files.

### 1-3. Character

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXc32cu_CRTKUKRsvpjHJ_aqf__6Tq-pHjDsWlVcYgpj8NTb-g0mGjjTFeaEfVcCOCTmJ2NshGFSf7T7aGKd3Mq5WJJD-wsMVfjay-n-LP4FHE1nCuH7N9H9TMWGAY1HW-2brXogUMtH83Y5BlUkqJg7cMGZ?key=g9SNe8floSX29K5Ha8UM_Q" alt=""><figcaption></figcaption></figure>

This feature provides a CG facial character preview to monitor facial tracking generated in the Actor section in real-time. Users can add models beyond the default ones and stream facial data live.

### 1-4. Values

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXcz6wP8mdDDDqbyKBU7SwDkjSmG3JjyaPut8B8qTx0KqP9hcx6cWjjecdmKof3Aj9vWH340MnOq-PGYJ84TyYmwhCCyZc4RRtOKvBqlpdwwLf7CWWk2ShIvRnyCRXp9eK3Jg-LoszXCRTFMhfhggqBQ0iOq?key=g9SNe8floSX29K5Ha8UM_Q" alt="" width="375"><figcaption></figcaption></figure>

This displays the facial tracking data in real-time. Users can view the values for facial expressions in real-time, allowing for data correction and Actor Profile creation.

### 1-5. Actor Profile

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXf-t-r_yN6WqH17EzTt9bp4HdBDdiXzDfCxpMHduXwBBTT36WuHXb9_2kRs-gL7_Mr5RXH_BhoNPGDollZNPeufogflJnWBEER2Is9-MvqV_Sj8QAlg3jnd6AdjrLWdWxUSdM7Y2a80atKnpF3ZLFsTcnxq?key=g9SNe8floSX29K5Ha8UM_Q" alt="" width="375"><figcaption></figcaption></figure>

This feature provides real-time tuning of data from video footage or live input. Users can adjust facial expressions in real-time to maintain consistent expressions across different actors or enhance and modify expressions.


# 2. HyperDeck Window

### 2-1. **Device**

<div align="left"><figure><img src="/files/LZCMHgy6BWmjh0C0XtoD" alt="" width="439"><figcaption><p>&#x3C; Device ></p></figcaption></figure></div>

This function allows the connection of HyperDeck by selecting its IP address.&#x20;

To connect, enter the IP address in the Network tab under File -> Settings.

Connect: Button to connect HypderDeck

<div align="left"><figure><img src="/files/YQUCHfCdce22SGXLvhhZ" alt="" width="372"><figcaption><p>&#x3C; HyperDeck Setting ></p></figcaption></figure></div>

### 2-2. **Slate and Take**

<div align="left"><figure><img src="/files/mKYzUxNmM4t1p0UOcWdF" alt="" width="437"><figcaption></figcaption></figure></div>

* **Slate**: The name of the recording file (supports alphabets and multiple languages including Korean, Japanese, and Chinese).
* **Take**: Defaults to 1 and automatically appends the take number to the Slate name, increasing automatically with each take.

### 2-3. **Record and Play Options**

<div align="left"><figure><img src="/files/2G9s5yYSGd24IJoUtWjk" alt="" width="354"><figcaption></figcaption></figure></div>

* **Record Option**: File naming rules for recording\
  **Named Clip**: Uses the Slate and Take inputs; if unchecked, the HyperDeck default naming rules are used.\
  **Actor Suffix**: Appends the HyperDeck Actor ID Number in the format `_{a01}` to the file name.
* **Play Option**: Video playback options\
  **Loop**: Repeat playback\
  **Single Clip**: Play only a single file

### 2-4. **HyperDeck Tap / Local Tap**

<div align="left"><figure><img src="/files/pnkyzPr5MfdfUrdht0P6" alt="" width="296"><figcaption></figcaption></figure></div>

This section allows remote control of HyperDeck.&#x20;

**\[SD card slot]** : It includes options for selecting SD cards in the HyperDeck and managing video files.

Local tab: Manages video files on your HyperDeck.

<div align="left"><figure><img src="/files/4Nd1lb6z3aQ8G7Wd2QiY" alt="" width="293"><figcaption></figcaption></figure></div>

**\[ Folder Path ]** : Select and specify a local path.

<div align="left"><figure><img src="/files/ynkVM4IYkaFluZHoKO9i" alt="" width="276"><figcaption></figcaption></figure></div>

**Copy to Local**: This is a button to copy files from HyperDeck to Local. Select a file in the HyperDeck tab and click Copy to Local. The file will be copied to Local.

<div align="left"><figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXeZGLc-6087N4m9w3xSB9uSj4X1ucoYSOc8AQQNBpvinXgNluNcbx4BJ2VxwriHF9qnwxciR1QzTCv0oqak0TUsUs0PHmZYkv9uinoqVkbaC4mGdlJjRoqTJTTuUWE-xa7VOoE79CgmCiWriAh5g8FmyZHS?key=g9SNe8floSX29K5Ha8UM_Q" alt=""><figcaption></figcaption></figure></div>

**Copy to HyperDeck**: While connected to the HyperDeck, select a file from the Local tab and press the **Copy to HyperDeck** button to copy the file to the HyperDeck.

### 2-5. **Live or Play**

<div align="left"><figure><img src="/files/AIpSVcsw7nUb0D2yLHQA" alt="" width="444"><figcaption></figcaption></figure></div>

* **Live**: A mode that allows real-time video input from YanusCAM and other sources through HyperDeck, with the option to record.
* **Play**: A function for playing videos stored on the SD memory card in the HyperDeck.
* Options include Record, Stop, Play, Previous File, and Next File modes.


# 3. Actor Windows

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXdT1eb0Be2-IgvvN4zQ2jtldiDVVBDc2Jc6ERfrthr7lIzVGcjPzfW-vPPG8pRKHeckRywDEG0ZTsD5CXYgOqPTSK_-QzMpSJDxcR633SepisPN6rmILiyo3EQ7q9ZkL3FzxiOFdpkWgaqzYHHgfeMC9-0T?key=g9SNe8floSX29K5Ha8UM_Q" alt=""><figcaption><p>&#x3C; Actor Windows ></p></figcaption></figure>

### 3-1. Actor Mode, File Path

<div align="left"><figure><img src="/files/ykRNTGbHsOzu53oA2gYH" alt="" width="399"><figcaption></figcaption></figure></div>

**Actor Mode**: You can select from YanusCAM, USB Camera, or Video File.

* **YanusCAM**: Live streaming is possible through a camera connected via HyperDeck.
* **USB Camera**: You can select a USB interface camera connected to the PC, which also supports live streaming.
* **Video File**: You must select the file path directly below to play recorded videos.

### 3-2. Rotate, View Facemesh, Calibration,...

<div align="left"><figure><img src="/files/Fh9vJsO8OIHEs93iWLm1" alt="" width="203"><figcaption></figcaption></figure></div>

* ![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdQ9aXrviVXfoUPan2PUZg98U7zKlM2o7grwxKkbhpDLzwSeu4LkMIfireWskaIuPhBTyXFi61HAhxjWBA01obzSf24nIhEblrb86KgQPs9w1H8q4rz3qSrZRC46hDQ-RadRDYtRt45P1AjJGCf3mJn5gOd?key=g9SNe8floSX29K5Ha8UM_Q) Rotate the video 90 degrees to the left.
* ![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeRl7ADFYNdWBYCM4gR7Ipj8igpmlnX0bNsoh1R5uv1lew-BK2VawH95c-D3eJ5TYEU8JCLnshICtKCZ1y-SkKpyicxAhxYV-2B8WEbJIykfUbeCEChWuacZ_Ju3h9NSp65dviMOIq22XGaI14KVNzyAkYD?key=g9SNe8floSX29K5Ha8UM_Q) Rotate the video 90 degrees to the right.
* ![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeP8swLhqh1Eu6F0PKG_LXUQ9hPXcdcTzdgUowHUaE5Pd29RiNm52qDnGqVUPaC05uCAfEW6QBFcDouatsFLSxHT2S6G9w65h5p_vX4B_La0xvfpzs6QlafxJbf8w0N225zB2y_XPdPf8BGbghtGQM6PqSI?key=g9SNe8floSX29K5Ha8UM_Q) ![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfWazgBTD_qoyReA7u9tqX3G0KIfMqwHJdnEIBmrN_EeL3vUKXknpzNdQxC9EmVBTZxiM0nRnP7pVu-TF9evZV_kP9hkAaXwxxgRmX5r9To_fiCqov1wn-lgr4sXAofCh6kEEOFr1wAKS3CgbBtyRjw4TRw?key=g9SNe8floSX29K5Ha8UM_Q) Display the Facemesh icon on the video.
* ![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfX7-cdqqZJXoQtajW9FHuh3QS3fLDR_NYKkiDs39P0NuTb9HKCVY2iOv3I2r8s9DBzwIaQyo5qNT9hvK3aNLsPhjuBhiDry2kNjxEL9PwkZ7tU2Cpz1Vp5l1HivDMDbtHXnyKQKY-XN3CwqF0jxoFqdNpY?key=g9SNe8floSX29K5Ha8UM_Q) Perform Neutral Calibration by pressing a button after setting the face to a neutral expression, which calibrates the facial tracking data.

<figure><img src="/files/4d0mXHZ24038bCPN1VHj" alt="" width="230"><figcaption><p>&#x3C; FaceMesh ></p></figcaption></figure>

### 3-3. Windows Open, Close, LiveLink

<div align="left"><figure><img src="/files/oP5ISD5GNMMuO3P1aRUK" alt="" width="155"><figcaption></figcaption></figure></div>

* ![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXe9lhkIexBKElPk_F2mnTQStFNzS8WeSxgsE-wufSCh0nMAuTKVshg4e15Drl6-qia3G4tFQZRbHPiVfdBrbgVh-Or0y2HoR47_jcF2c75SSoizPosobPvD1-AkTBSLZGVcr9tvcRDVdkQqAo4zd6aJyHVr?key=g9SNe8floSX29K5Ha8UM_Q) ![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXehsI5wS29zQzxZYbPqu95lBM_w0NItMJEIN4X0tHs4hgNdYfWo_qba6DzqPgKDLViVOVFW53fc9jKQYR3Oiw866cVpGaguCAt9sEokwI_UIsl1_stKlHP3Y0tM_McIXeO99MPY8vamLiXw6y9ghBMZA-kc?key=g9SNe8floSX29K5Ha8UM_Q) Close the HyperDeck window on the left.
* ![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdORZ6J-hgfAO8yO3l7HFASTC7vQNtLXt67nGpm-QIgG3kgX-UpUm7eqPCl4czdoyYrEDsHiPwT3aAglf4f8EotXyxfPJ3jYy6c-9e_52I_npqFMT92V5Mi6Nl8yPC5SAyCM_aE4RblnoihH9Az96QJ8NGu?key=g9SNe8floSX29K5Ha8UM_Q) ![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfj8uJa_VQhSLCn9wOL0xTZ-StqGgVEftp8pPk2YjTM9RspJ0hYlWWRixxwjTOJbrJo52KkisbwiJXxD1so_aDpZv-gZqi5HzCLUbvJxNmlRdkpPTOKOsbgbz_Giu5hF5XrQMYK7OkbdayXFJXFgEcWEUY?key=g9SNe8floSX29K5Ha8UM_Q) Close the Character window on the right.
* ![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcLn4GyJtaiEWLwJ9V20e6hE5RrETyGjV3Dl2B11m49mBgzKcWTcD0iFSg2QVUW4QMGOMU8dXOc11nOzQVdx7dxFryGa3GCvoz8qcAZxliY7yjr7PQ7SpKDbBTTOG3vLzhrLIpT8-WGw4PXvwaPd8YeoOPZ?key=g9SNe8floSX29K5Ha8UM_Q) ![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcu42tQLqUGh68R7o1YGA-2eMCMeYAcjOfcUGYnmgY3PXHVzo9sEOXEgT2lmdewMel3pDF3641_QPMSIghPK2fJvVcGcPQFJbYinDFIxZOuens5R7y1JWxAkFiKxYJDvvCwLqQ2ZqWhS28bNbO-f09tsrCt?key=g9SNe8floSX29K5Ha8UM_Q) Button to connect LiveLink.

### 3-4. Actor Video Windows

<figure><img src="/files/KzsSaAW6U98s7BFgxRQJ" alt="" width="280"><figcaption></figcaption></figure>

This window displays live or recorded video data. To play the video, press the play button below. Even for live videos, you need to press the play button. Pressing the stop button will pause the video. The playback slider allows you to quickly find specific parts of the video or move through it. Below the video, information about the time and frame is displayed.

Actor mode start / pause button

![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXerPhkoeDtuJAESaAUH6-pzRjIAWdbs8NYIWXsIbGFGQy8Q1D7QDkWYlPvH7jrVPMVT5IMOqJKnDbpL2itwO2JMrjhbhjydPbnP4JCW9gqcf_63x0tAiMAHNX4MZkQk-90s6I6doQ2vluomURpXUDFHhdf3?key=g9SNe8floSX29K5Ha8UM_Q)&#x20;

![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdsmxadEWT_3GtilQ_t_2WIJXulSJYr1DwZAuSo4vTcjv0OlUu9_q5ZeYXjEhuWwLPTX_elM1INOQYLRDQYQ-h7hq5ogP2DjP7FPFs92TtazG3qBSNY3uId3jiQHBuhiO6xBQtQ7YJhhFDq3u9_6RVdTy-T?key=g9SNe8floSX29K5Ha8UM_Q)&#x20;

![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfP2zLUPKTPpa8KuqAn8aFhybUdq8SMnG-AzKmUL_I52b5C6Kzen40vDiBSEFrfg9MdLlcp83jk3-JHRZBIVyPEeRfRtcF_YeNorbND0hk5KhnD7c-QqxS9NJTIu80KIoq45DFjKjboIprdIGrTlTTR_JLU?key=g9SNe8floSX29K5Ha8UM_Q)

![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcVAiUsPa-iVFp7BpbkypujMQcBF4mcWEPcDio4ePFZ6tOM27zfk1F78omVBDMt-EDUBnT1OR3Qd6-FGdJHza-7BXjumokh5SMSXEjxIx6kji_tPXjzwqRN84GBYap0e-kWhuABkOje3hAa1r88wpq96Pk7?key=g9SNe8floSX29K5Ha8UM_Q)&#x20;

![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfrREYmuADCeuZMBAYT9nDAEqLoLjMgvnGye2k5SDVtPsAn-bKrv1mrYGQb09gGfiGJLV66bmWQKEtByuKo_vNto4_j4enCLJRjqHpDKqiqX4IaSFSTXpu-xQ0VghMV4ZGb1gVTwMb3vzTVRB7RVhwqztpx?key=g9SNe8floSX29K5Ha8UM_Q)&#x20;

<figure><img src="/files/AYReYT9vXcRS71cQYJNT" alt="" width="283"><figcaption><p>&#x3C; Live Information ></p></figcaption></figure>

To view the tracking status of the video, select (check) **View -> Live Information**. The top part of the video will display in the format `fps cap: { }, process: { }, out: { }`.

* **cap**: Frame rate of video capture
* **process**: Frame rate of the motion capture process
* **out**: Frame rate of LiveLink transmission


# 4. Character Windows

### 4-1. Character Mode

<div align="left"><figure><img src="/files/OXd6UOdSUVOuOqrRXYUY" alt="" width="416"><figcaption></figcaption></figure></div>

In Character mode, you can display and select characters registered under character1, character2, and character3 in the Character tab found in File -> Settings.

### 4-2. Character Setting

To register a character in Character mode, you need to configure the settings in the Character tab under File → Settings.

<figure><img src="/files/RjwseRqwiA6J3vdNoT6d" alt="" width="372"><figcaption><p>&#x3C; Character Settings ></p></figcaption></figure>

#### **4-2-1. Display Configuration**

* **Resolution Width**:
* **Resolution Height**:
* **Resize Percent**:
* **Default Character Number**:

**Deactivate Actor on Startup**: An option to prevent the character from launching automatically when YanusLIVE starts.

#### &#x20;  **4-2-2. Character 1, 2, 3**

* **Mode Name**: The name displayed in Character mode.
* **Execution File Path**: Specify the path and file for execution.
* **Execution Type**: Choose between Unreal Engine or Unity, depending on which engine was used to create the executable file.

#### &#x20;  **4-2-3. Pixel Streaming Mode**

* **IP Address**: The IP address of the PC where Pixel Streaming is running.
* **Port Number**: The default port number is 80.

### 4-3. Streaming Mode

<div align="left"><figure><img src="/files/bQAYsvoKDENUxOv8RGPm" alt="" width="419"><figcaption></figcaption></figure></div>

* You can select LiveLink1,2 and connect or disconnect the connection.
* Configure the LiveLink settings in the Network tab under File -> Settings.

<figure><img src="/files/YYACxmwukpx6EGt08DWL" alt="" width="372"><figcaption></figcaption></figure>

* LiveLink0 is used for local network settings with the YanusLIVE character.


# 5. Values Windows

### 5-1. Values Mode

<div align="left"><figure><img src="/files/8nUv2icjCuY9IpnN5FHJ" alt="" width="164"><figcaption></figcaption></figure></div>

* **Live**: Displays the values tracked by the Actor in real-time.
* **Max**: Displays only the maximum values tracked by the Actor.

### 5-2. Pin Tooltip

<div align="left"><figure><img src="/files/4XO7HGQJt6bxh4yTmJMh" alt="" width="109"><figcaption></figcaption></figure></div>

* **Pin Tooltip**: When you click on the Values slide the Tooltip enlarges the value and remains fixed. Clicking again or unchecking the **Pin Tooltip** option will unpin the Tooltip.

### 5-3. Disable Neutral Calibration, Disable Retargeting

<div align="left"><figure><img src="/files/ufFT0eu3rcUlfZmUMANl" alt="" width="105"><figcaption></figcaption></figure></div>

* **Disable Neutral Calibration**: A button to disable applying the neutral calibration created in the Actor window to the Character. When activated, it appears yellow.
* **Disable Retargeting**: A button to disable applying values generated in the Actor profile to the Character.

### 5-4. Values

<figure><img src="/files/g0dRdRP1MeJEWGsbvcJp" alt="" width="273"><figcaption></figcaption></figure>

This displays the data values corresponding to each expression’s mesh. It allows you to identify the names and values of specific expressions. If the Max values are too small, you can use this information to adjust (tune) the data accordingly.


# 6. Actor Profile Windows

### 6-1. Actor Profile Mode

<div align="left"><figure><img src="/files/vNURjCPUJqI7fayPo5b4" alt="" width="175"><figcaption></figcaption></figure></div>

* **Scale**: A setting that adjusts the size of the blendShape value by multiplying it.
* **Offset**: A setting that adjusts the blendShape's Neutral Calibration value by adding to it.

### 6-2. Sync Left/Right

<div align="left"><figure><img src="/files/PnIjC1LwqIgiwrmtyAvj" alt="" width="134"><figcaption></figcaption></figure></div>

Sync Left/Right is an option that synchronizes symmetrical facial data, allowing two or more data points to be linked and moved together.

### 6-3. Actor Profile Editor

<div align="left"><figure><img src="/files/hvqNCjBbYH2nKvUgBu9c" alt="" width="39"><figcaption></figcaption></figure></div>

<div align="left"><figure><img src="/files/yYQPp48eeNFqVnoF55kp" alt="" width="186"><figcaption></figcaption></figure></div>

The Actor Profile Editor is an editor used to adjust the tracking values of the actor. It is used when more extensive data modification is required beyond the default range of adjustments.

* **Value**: The current measured value.
* **Scale**: The Scale value for Retarget.
* **Scale Range**: The range of the Scale Slider.
* **Offset**: The Offset value for Retarget.
* **Single Step**: The increment value for each click of the increment button.

### 6-4.  Actor Profile Slider

![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeTyptH86NMxxSlHHvoS8mCCgUKxRmGfgcP8YAHfGq4CjE-FpbC5teOG-Xjh4QjRV4Iqsd7q9GWSD5cxBZSfYNhv_Y-Y3sX3l0cbX0N4lzQgMM2N9huZ8Bv8B0YNayu_Y5tn3T1IUYHYlYSZqPrznhwzDve?key=g9SNe8floSX29K5Ha8UM_Q)

To tune the actor's tracking data, select Scale or Offset in Actor Profile Mode, then adjust the desired data by moving the slider left or right. The changes will be applied in real-time to the Character window.

### 6-5. Buttons

<div align="left"><figure><img src="/files/GAbedTjqQqNbuyhrV3GI" alt="" width="407"><figcaption></figcaption></figure></div>

These buttons are used to create files for the Actor Profile properties.

* **Apply**: Applies the modified data value (a button that activates with a single press).
* **Init**: Resets Scale to 1.0 and Offset to 0.0.
* **Reload**: Reloads the settings from the file.
* **Save**: A button to save the modified data, functioning as a "Save As" feature when applied. This applies to the Neutral Calibration, Scale, Scale Range, and Offset settings.


# 7. MENU


# File

![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfyyb27W_7dEzpwSicKq4DVsWZSwV8QSDr0SiLQ1jekWLvlMiM_ZTgK-us5jYR6jGIlHWHWj7sd7db11opeyxutgoPnxYYA6pFNw7M1dswlsv97PTGK14h5pSmZbk-EVq1sIiyXp3f15VQm4XAf6AdojIY?key=g9SNe8floSX29K5Ha8UM_Q)

1. **Open Video File**: Open a video file.
2. **Open Actor Profile File**: Open an Actor Profile.
3. **Save Actor Profile File**: Save the Actor Profile.
4. **Generate Facial Data File**: Process the video file and save it as a CSV file.

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXdyZyTVOMtQ9PLpXriFI8C3Xr4ml-xTLZDjpPHKeCx2KnBrF2tubxaGkyVjd1iZ-Nc_o_n8_bIaZPPk4j0HToFrCsbJoWr_aHRml2a3661yVvsUaFOOizIfS_t-3Lz-_X4cNUgV9JQDmMgViC6ZVl53hki0W6epectk7yiWKA?key=g9SNe8floSX29K5Ha8UM_Q" alt=""><figcaption></figcaption></figure>

* **Video File**: Select the video file from which to generate data.
* **Actor Profile**: Load the Actor Profile tuning data to apply during data generation.
* **Output File**: Specify the path and file name where the converted CSV file will be saved.
* **Data Type**:
  1. **Full Process**: Generates a file with all selected options, including filters and Actor Profile applied.
  2. **Unfiltered Data**: Generates data with only the Actor Profile applied, without filters.
  3. **Raw Data**: Generates data by purely analyzing and tracking facial expressions.

#### 5. Settings <a href="#settings" id="settings"></a>

<div align="left"><figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXdXXGPQH_aAew_yyBNOY7FDzLvA6t5QsThMYB6SjJNfJv7nYy9m3_vR2PhN0UbNT18exK13_OuepOGlRQrl4xUJF0IvIXfV9vOiY6OzqxtXdaU3VWg17loVyJU1p0HTE0eEAv55QlZ672aBRXoL5CfTIeY?key=g9SNe8floSX29K5Ha8UM_Q" alt="" width="563"><figcaption></figcaption></figure></div>

6. **Show Settings Folder : Open Settings Folder**
7. **Show Local Folder : Open Local Folder**
8. **Show Actor Profile Folder : Open Actor Profile Folder**
9. **Exit : Exit YanusLIVE Software**


# Settings

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXdXXGPQH_aAew_yyBNOY7FDzLvA6t5QsThMYB6SjJNfJv7nYy9m3_vR2PhN0UbNT18exK13_OuepOGlRQrl4xUJF0IvIXfV9vOiY6OzqxtXdaU3VWg17loVyJU1p0HTE0eEAv55QlZ672aBRXoL5CfTIeY?key=g9SNe8floSX29K5Ha8UM_Q" alt=""><figcaption></figcaption></figure>


# Network

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXcjOyVFcLjNZanUxFAZpdvlDtsJ4zu_F8t1MsMlAM2dQeQjrOXtYaESSYxavyXYFJT7gDmf_iNsX7Nf6uXsLm2xtVeHdfKx09AUwX4YTvI6YuFZYvfAszW6Tb-OsMVUYPuPuV74phwzeKUXW72ZxcdfJYnH4fM22efHEw17Bw?key=g9SNe8floSX29K5Ha8UM_Q" alt="" width="375"><figcaption></figcaption></figure>

**HyperDeck**: Controls the HyperDeck through its IP settings.\
**LiveLink 0**: Default setting for transmission in Character mode (continuously transmitted when Actor mode is running).\
**LiveLink 1, 2**: IP settings for the LiveLink to be used for streaming.


# Actor

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXe3Iq4ZVEaUpSPEP3sPXeNsswDvyltAxB5epV38adUdPKQTrhC007p0b_22y5iWKlIR7PLJAaMiRlG3Y5f_MKzJAPfJZ1VhxfT2i8DzAwlJ0EwoEK37TfM-FGADiL5W9OXxgnwL4ui1_CD9m9sRCf6fSd46ouLQFGs50ugn?key=g9SNe8floSX29K5Ha8UM_Q" alt="" width="375"><figcaption></figcaption></figure>

* **Yanus CAM**: Settings for using Yanus CAM with HyperDeck
* **USB Camera**: Settings for using another USB Camera as an input.

In USB Camera mode, if **Set Camera Parameters** is checked, the system will attempt to set the resolution and frame rate to the values entered upon connection (this may not work properly if the camera does not support these settings).

* **Video File**: Settings for using a video file as an input.
* **Resize Percent** is a percentage-based setting that reduces the size of the input image while maintaining the aspect ratio of width and height.
* **Common**: Settings that apply to all Actor modes.<br>
* **Actor Display Frame Rate** sets the refresh rate for displaying frames in the Actor video.
* **Resize Aspect Ratio** is a function that forcibly adjusts the aspect ratio of the input video if it differs from the actual ratio.

Changes made in the Actor tab will only be applied the next time Actor mode is restarted, if Actor mode is currently running.


# Filter

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXfeZwbvhREEPWMKBBOMmeNlWAvG3IHzSHGBJOzoQAseYPaHssFi2aU6GtBGIm3j1jTmLuCcaIbWGILKiRwtB741v-Y09gauiJd4ozD9I-4qdyiKMamque16nPbA61t--K6yUUm6HX8HmSFQLALI4pKx9rTevveRmGcEd58QJg?key=g9SNe8floSX29K5Ha8UM_Q" alt="" width="375"><figcaption></figcaption></figure>

* **Preset**

The preset is a pre-configured option for the filter, and generally, this setting alone produces high-quality data. The presets provided are **Stable**, **Balanced**, and **High Performance**. **Stable** is a setting resistant to noise, while **High Performance** is used when fast responsiveness is important.

### Parameters

After specifying the **Preset Name**, you can add a custom setting by clicking **Add**.\
**Process Mode** has two options: **IMAGE** and **LIVE\_STREAM/VIDEO**.&#x20;

Use the **IMAGE** mode for fine-tuning the filter, while the **Stable** preset is set to **LIVE\_STREAM/VIDEO** mode.\
**Filter Type** includes four options: **MOVING\_AVERAGE**, **BUTTERWORTH**, **KALMAN**, and **NONE**.&#x20;

The **Stable** preset uses **NONE**, while the others use **KALMAN** mode.\
**Average Window**, **Butterworth Cutoff Freq.**, and **Kalman Q/R** are coefficient settings for the respective filter modes.\
In **KALMAN** mode, if the value change is smaller than **AVG.**&#x20;

**Threshold (>Vel.)**, the Average filter is applied concurrently before the Kalman filter.

### Secondary Filter Configuration

When **Use 2nd Filter Coefficients** is checked, the selected **BlendShapes** can have 2nd filter coefficients applied through **Selection Keywords** input.\
To verify the blendShapes selected by keywords such as "jawopen," "mouth," or "left," check **Highlight Selected BlendShape**.&#x20;

The color of the blendShape names in the Values window will change to yellow.

Changes to the filter settings will be applied immediately when you click **Apply**, even if Actor mode is running. (The only exception is **Process Mode**, which requires a restart of Actor mode.)

Filter settings are applied equally to **Yanus CAM**, **USB Camera**, **Video File**, and **Generate Facial Data File**.

For managing preset settings, there are **Save**, **Add**, **Reload**, **Init**, and **Delete** buttons.&#x20;

You can save a preset with the same name if the **Preset Name** is unchanged, or change the name and click **Add**.&#x20;

**Reload** cancels changes and reloads settings from the file, and **Init** resets settings to the default. User-defined presets can be deleted, but the presets provided upon distribution cannot be deleted, though they can be modified.


# Experimental

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXekz4sUa6FinlNRdVAbePvAE8CinHEm27JgSPVmMYKXeVCNgAybPUbibLGI9IADCM8qOazLONkP489hblsDwZ-PbbNuthmp39ujAGWuZYH9xOAMp26h9o0tA3GpGENsKDJ__FUeltqtYSa52AGHtbeHIt5_r_pDWr_GY2E9hw?key=g9SNe8floSX29K5Ha8UM_Q" alt="" width="375"><figcaption></figcaption></figure>

**4-1. CSV Data File Play**: A mode that uses pre-generated CSV file data when playing a video file. This mode is useful for checking CSV files and allows using LiveLink player without the motion capture process, reducing the use of PC resources.

**4-2. Font Size**: An option to specify the font size of tooltips displayed in the Value and Actor Profile Editor.

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXeFWncvNtdS4NmuRsW3-7pZMZ-Lukq24vTB0vSfhzr1GUMd_HdMeZDFHJ_nyBIyRRghY8p2IXGLZg7jthB1BesqH8_O4hFK1_XPq0bBsp5ZJajRqOfZSVLFtWjUmG6d3dMK7Ce_Rd14aEEObAjndaOxD91g?key=g9SNe8floSX29K5Ha8UM_Q" alt=""><figcaption><p>&#x3C; Values Tooltip ></p></figcaption></figure>

**4-3. Emotion Improvement**\
An option for enhancing emotional facial expressions. The relevant blendShapes are **CheekSquint** and **NoseSneer**, and a separate pre-calibration factor has been applied in addition to the Actor Profile.

**4-4. Sync Eye Movements**\
An option to determine whether the movements of both eyes should be synchronized or move independently. If the asymmetry between the movements of both eyes exceeds the threshold based on the selected reference eye, their movements will be synchronized.\
If **Enable Neutral Cal. EyeDirection** is unchecked, the blendShapes related to eye movement are excluded from the application of Neutral Calibration. (This does not exclude them from the Neutral Calibration process itself.)


# Character

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiqSh3wiU4_gTIytmOo77zqw-5JybPp91OSFcPHapnkLEWB9646mRLikDFHgzhIIiFsq98q2GV9dyDDmbtTqf9lorJl0uN_MxYwhcwGhB8ipQd_wFuJ34HgLjMjEzoTs6CkiJxv14hENVKTOSlWoA8K_0-YrW-SOElKpHH9w?key=g9SNe8floSX29K5Ha8UM_Q" alt="" width="375"><figcaption></figcaption></figure>

**5-1. Display Configuration**

* **Resolution Width**: Set the horizontal resolution.
* **Resolution Height**: Set the vertical resolution.
* **Resize Percent**: Set the scaling percentage for the resolution.
* **Default Character Number**: Set the default character.
* **Deactivate Actor on Startup**: Pause Actor mode when Character is launched.

**5-2. Character 1, 2, 3**

* **Mode Name**: The name displayed in character mode.
* **Execution File Path**: Specify the path and file for execution.
* **Execution Type**: Select the engine used to create the executable file, either Unreal Engine or Unity.

**5-3. Pixel Streaming Mode**

* **IP Address**: The IP address of the PC running Pixel Streaming.
* **Port Number**: The default port is 80.


# View

![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXcKWXGdvUUTxl4m3DfyeP5CCxjMPK0wdPD3MwYLIa1HA9RvhUMg2R1ny0ARPrcBtr5NaMHKJcS7QGXJG3uF6NYZ_jzeRaNEHXxp3eEGpynxMUf0SOW1hix9cXKOA-osiJd6Tdel5O7q68f-1OjUR8lt_8fx?key=g9SNe8floSX29K5Ha8UM_Q)

**Reset Layout**: Reset to the initial default layout.\
**Player Layout**: Switch to the Player layout.\
**\[HyperDeck]**: Toggle the visibility of the HyperDeck window.\
**\[Actor]**: Toggle the visibility of the Actor window.\
**\[Character]**: Toggle the visibility of the Character window.\
**\[Values]**: Toggle the visibility of the Values window.\
**\[Actor Profile]**: Toggle the visibility of the Actor Profile window.\
**FaceMesh**: Display the tracking mesh on the video in the Actor window.\
**Live Information**: Display video tracking performance.


# Tools

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXcDOH2OSYZjyKJmCXJPt3Jp2aekwjbwigbi_wBVmiyF905PjReMZ2D1FxpCBsSGhImOlzKWqfgzzfuifyl-cZMX0BNOJzq9xWWW6pPpnS1K70rs4Xo2SXH0WYhpgI7yNksDAbeGJfT1_Zu7b45tzOBwASYN?key=g9SNe8floSX29K5Ha8UM_Q" alt=""><figcaption></figcaption></figure>

**Reboot HyperDeck**: An option to restart the HyperDeck, used in case of issues with the HyperDeck.\
**Reset settings on restart**: An option to reset all YanusLIVE settings to their defaults upon restart.


# Help

![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXccWAa-6HLOErJ5VvZ2Q8VWKSyKvZbU8NCW_ZhEra7OXtwWM8FDbX51woNpdgq6crs5m3EppP99Z1GhI9sTdtG_LYHTMCaeihULJOCAlLVnD4vuA1YIJFxgbPeshB2FKKhI8kT2rD5XqfmfA5wylY_WmmZ5?key=g9SNe8floSX29K5Ha8UM_Q)

**About**: Information about YanusLIVE\
**Web**: Connect to the YanusLIVE website\
**License**: License activation and deactivation


# 8. OBS Studio Support

Starting from YanusLIVE version 1.4.3, video input and control through OBS Studio are supported. This feature allows you to input standard USB cameras into YanusLIVE as a virtual camera in real-time,

### OBS Studio WebSocket Control Support

Added OBS Studio as an option in the YanusLIVE HyperDeck window's 'Device' combo box.&#x20;

When connecting to OBS Studio, the following automatic settings are applied.

* OBS Video Settings to USB Camera settings (Frame Rate, Resolution Width/Height).&#x20;
* Select USB Camera mode and OBS Virtual Camera device, then start Actor Mode.&#x20;

Note: The Start Virtual Camera button in OBS needs to be pressed manually.

### Local recording via OBS

* Set the local path to OBS Output > Recording Tab > Recording Path when connecting or when settings change.
* Set the recording filename format via OBS Advanced > Recording > Filename Formatting.

Note: When OBS Output > Output Mode is set to Advanced, recording can be paused.

### 1. YanusLIVE Settings for OBS Studio

In YanusLIVE, no special settings are required to connect with OBS Studio. The connection can be made with the default settings. OBS Studio must be installed on the same PC as YanusLIVE, and the port and password settings in OBS must match.

* IP Address
* Port Number
* Password

&#x20;

<figure><img src="https://lh7-rt.googleusercontent.com/slidesz/AGV_vUeqOPp3d5BYSWnsjjkXa5L_MZbJIGb7niEmtO5bjEvgYdncscoDgzt9KuV1dahmhrwZPurIDHFk1G0CdIPqgERtuVkCUcO9qn0q0urBGfiKt9zEMIL46FHeiFRw0lpUVcwKMKeh3YFFkZQgomH6cdzxSZ4oVtAe5G5TU0PFW4kzu-yaU94X2Q=s2048?key=n03uSH3twrUlXk8y6W2ZMQ" alt="" width="563"><figcaption></figcaption></figure>

### 2. OBS Studio Settings for Connecting with YanusLIVE

* In the OBS menu, go to **Tools** → **"WebSocket Server Setting"**, and check **"Enable WebSocket server"**.

Note. When using "Enable Authentication," enter the same password in  "**YanusLIVE > Settings**".

<figure><img src="https://lh7-rt.googleusercontent.com/slidesz/AGV_vUdJmj_xzyE9QoUCVubfcQRRUUxnS3oHkT22nf1NaSQ1MTxSYfdlSqrPtdQdSbduaFxAlaXxoXz7Nn0W2OIpni4o9mcvEoFtBNc2g7PcrLAl72RpKBHMctJ8F6kHguekAx-yScyRm3z_asXlBRa5uAVMIaaBtWzeHi0IOa6IVWWLSLd15euXFA4=s2048?key=n03uSH3twrUlXk8y6W2ZMQ" alt="" width="375"><figcaption></figcaption></figure>

* To connect with YanusLIVE, you need to run "**Start Virtual Camera**" in OBS Studio. Then, in the Actor window of YanusLIVE, set the **Actor Mode** to **USB Camera** and choose **OBS Virtual Camera** as the **Capture Device**. Once connected, press the play button to start.

### 3. OBS Studio Setting

#### OBS Studio "Video" Setting

* In the OBS Studio menu **settings**, go to the "**Video"** section and change the "**Base Resolution"** and "**Output (Scaled) Resolution"** to **1280 x 720**. \
  (This setting can affect the performance of the PC, so it is recommended to set it to 720p resolution.)
* Also, adjust the "**Common FPS Values"** to a value between 30 or 60, according to the supported frame rate of the camera. \
  (If 60 frames are supported and the PC performance is good, select 60 frames.)

<figure><img src="/files/g2Dqn9wZwqZ8AgsudIqE" alt="" width="563"><figcaption></figcaption></figure>

#### OBS Studio "Output" Setting

* In the OBS Studio menu settings, the **"Output Mode"** in the **"Output"** section must be changed to **"Advanced"**. This will allow you to set the **"Recording Path"**, which will automatically be matched to the path set in YanusLIVE.
* Additionally, in the **Output** section, go to the **Recording** tab under **Recording Settings** and select either **MP4** or **MOV** as the recording format. Also, choose a hardware encoder such as **NVIDIA NVENC H.264** under the **Video Encoder** option.

<figure><img src="https://lh7-rt.googleusercontent.com/slidesz/AGV_vUfJSq4Lel1ba_6wQNG-Y7PGz530rljml8wkevmOsvtpJFoQTYVHUuY7d6nF8JBWsYpx80iWduU0jyRAi0zx9HJuvzHpP3XfTNZxiaCAt8oC_oqPwjt6R_SWgsd0DaOAtMd9KeVhM-s55zLWORtwkRKnJMKHmGKskcDD58JMEyOCJNQhv_eheIM=s2048?key=n03uSH3twrUlXk8y6W2ZMQ" alt="" width="563"><figcaption></figcaption></figure>

#### OBS Studio "Advanced" Setting

* In the OBS Studio menu settings under the **"Advanced"** section, the **"Filename Formatting"** for recording is automatically synchronized with the recording name option in YanusLIVE.

<figure><img src="https://lh7-rt.googleusercontent.com/slidesz/AGV_vUc8c-DCcgMXFYcFuYuAhkkVMZvLN9kxYh7tARIZkgts-oYEuOpZh8AkNLfYkOCh2xz3nWriHYw1Ur9dNRALJDM3dTM9KjFD383dJ_Vg3bVPJNUvhlDk-3ULWCBXCMyCtof7iLsyLlphj653Z3CQNR7O_O702ekX4-u34Qar6vNjVnRxEoS-Sn8=s2048?key=n03uSH3twrUlXk8y6W2ZMQ" alt="" width="563"><figcaption></figcaption></figure>

### 4. Automatically configure settings and start with a single click of the "Connect" button.

* When you select OBS Studio from the device menu and press the **Connect** button, the HyperDeck mode switches to OBS Studio mode, and the interface changes accordingly.

<figure><img src="/files/3jSPkRCdokh924WRvRFI" alt=""><figcaption></figcaption></figure>

* Double-click on the video file to switch to play mode, and use the Live option button for one-click switch to Camera mode.

<figure><img src="/files/IlnaOe0FhKsrHlSk47JB" alt=""><figcaption></figcaption></figure>

* Set the path and filename, then start recording. When paused, the indicator blinks yellow.
* The pause button during recording is enabled only if the **NVIDIA encoder** is selected under the **Video Encoder** in the **Output** settings.

<figure><img src="/files/SGPpiX0OrTXsN79pP8cl" alt=""><figcaption></figcaption></figure>


# 9. Remote Trigger

The remote trigger is a feature designed for use with other equipment, enabling remote commands such as recording and stopping to be sent or received over the network to control other devices.

### Remote Trigger Receiver/Sender Support

* Receiver Modes: YanusLIVE, XEROmotion, Xsens, OptiTrack.
* Sender Mode: YanusLIVE.
* Supports starting/stopping recordings in OBS Studio and HyperDeck, as well as setting filenames via Trigger.

### 1. Remote Trigger Setting

In the YanusLIVE settings menu, simply select the software to trigger from the **"Remote Trigger Receiver"** or **"Remote Trigger Sender"** options, and specify the port. Once this is done, the setup is complete.

<figure><img src="https://lh7-rt.googleusercontent.com/slidesz/AGV_vUfi122P_1VdenQIrvW9DDUPDV8SVr9V7RdfDwsYAl9BM5D5NWi3aQGgUcuyUUZI5U2hU7u979-7LH4T58FSX4Xe41zyqGfiCu16qCTpxqD5gNEys5865hEMOfMkO3mVpGsOGX6fbrfKiwvJuUBOba5vJiVALQPIu7ygQqWBlXCSh8E8i6u4VKU=s2048?key=JBvOkl-RvDEvLa9OC3HPDA" alt="" width="375"><figcaption></figcaption></figure>

**Remote Trigger Receiver**

* Mode
* Port Number

**Remote Trigger Sender**

* Mode
* Port Number

### 2. Trigger Mode

In the OBS Studio or HyperDeck window of YanusLIVE, check the box for **Receiver** or **Sender** in the **Trigger option** to activate the function.

<figure><img src="/files/KPPcwwmRp5KyPuuyFVEH" alt=""><figcaption><p>Check the "Receiver" Trigger option to enable UDP reception. Verify events through the log display under "Values".</p></figcaption></figure>

If the "Sender" option under Trigger is checked, pressing the Record button broadcasts an XML message type trigger to the configured port within the same network.

<figure><img src="/files/DBluNIfr2ELZQsIshAWp" alt=""><figcaption></figcaption></figure>

This is the XML message from YanusLIVE Trigger Sender. It is similar to other devices, but variables related to synchronization may be added in the future.

#### Capture Start

\<?xml version="1.0" encoding="UTF-8" standalone="no" ?>\
\<CaptureStart>>\
\<Name VALUE="record\_test\_t11" />\
\<SessionName VALUE="" />\
\<DatabasePath VALUE="D:/YanusSTUDIO/Test/1007" />\
\<TimeCode VALUE="14:48:48:05" />\
\<TimeCodeRate VALUE="60" />\
\<Notes VALUE="" />\
\</CaptureStart>

#### Capture Stop

\<?xml version="1.0" encoding="UTF-8" standalone="no" ?>\
\<CaptureStop>>\
\<Name VALUE="record\_test\_t11" />\
\<TimeCode VALUE="14:48:52:44" />\
\<Notes VALUE="" />\
\</CaptureStop>

<br>

\
\ <br>


# 10. Using the Filter Function

The filter function in YanusLIVE affects the tracking quality and speed of facial video. Enhance the quality using the filter function.

## **How to Configure Filters**

**Settings > Filter Tap -> Preset -> Process Mode / Filter Type**

1. In versions before v1.3.1, the settings related to Process Mode and Filter Type, which were divided into USB Camera, Video File, and CSV Play under the Actor tab and Experimental, have been unified under the Filter tab.

2. The default preset is set to "Stable," with Process Mode set to LIVE\_STREAM/VIDEO and Filter Type set to "None." This mode ensures stable output without any jitter even without filter settings.

<figure><img src="https://lh7-rt.googleusercontent.com/slidesz/AGV_vUfbGof_6Ac2rZRvV5u9kZVZvu3LjJWx-67BJjZQ2nPXW5oEKUpccwtWfgA9boW94XU1UGByn56n3UxZJLUUMTieR_EORqO_lUJhCMCN45qyGb123Lg_7BI5h4YsZHiaUiztXLiwn45bBXJonVvfUdcOSk7sgjQIuXHmm1cBvXFkwln0_ltO6Qs=s2048?key=Trti_JI4cbePRs1EH1xafFeh" alt="" width="375"><figcaption></figcaption></figure>

3. In fast-talking situations where the responsiveness of lip movements is crucial, the Stable mode may have some limitations. Therefore, while keeping the existing Average and Butterworth modes unchanged, the Kalman filter has been upgraded to allow for two different settings to be applied per BlendShape.

4. Among the presets, "Balanced" and "High Performance" are configured to increase responsiveness. "Custom Ex01" is set to further reduce the jitter in BlendShapes related to the brow and eye while maintaining responsiveness for other parts.

<figure><img src="https://lh7-rt.googleusercontent.com/slidesz/AGV_vUcJPmsiz8ciKHfpioIRLI6FuE6lX09kum4qNgmrTKRnYmcEauxtfQGC0FMFb73k9KUtuNtYLT0wVA6KBboQF1jVwpsCCE736EMoSl5HQVFiGpTYVrVB0cvo98XlyYUClCgN01QT80PoHIomuFCYwLpgZzEtYU8xGluwR7Hpk3KFRjzcUWBjiVw=s2048?key=Trti_JI4cbePRs1EH1xafFeh" alt="" width="375"><figcaption></figcaption></figure>


# Basics of Filters

1. **Selection Keywords**: You can input multiple keywords separated by a comma (,). BlendShapes that contain these keywords (case-insensitive) will be selected.

<figure><img src="/files/gm5RliHj1ix1rntITAR4" alt="" width="322"><figcaption></figcaption></figure>

<figure><img src="https://lh7-rt.googleusercontent.com/slidesz/AGV_vUd4ZC7WZsfZHe-7FJBl-EwsWSV3NJgBuC6f8KfqshbZ9ipP52yp8PtpirTyjND_x8FgoYfKaprdxzAseNgJCLkqWnJdphaFUGkiPJ4Dp6cnTGj6uaQwxnf0ykjSATQA6mrkUjP8DnG49xb0CC47-2rzMAYEptxsDnj0aLAujX7eOXvLhqaqr2k=s2048?key=Trti_JI4cbePRs1EH1xafFeh" alt="" width="375"><figcaption></figcaption></figure>

2. In Secondary Filter Configuration, if you check Highlight Selected BlendShapes, you can verify the selected group by the color change of the corresponding BlendShape name in the Values section.

3. Custom Ex02 has the keyword set to "left." This is a tip for visually comparing the before and after changes when tuning filters based on the differences between the left and right sides.

To make it easier to configure the numerous filter tuning options, presets have been introduced. Although Settings > Graph and Tools > Filter Designer might seem challenging to use, these features have been activated for advanced users who are familiar with the developer mode.

The following pages contain the manual and filter-related content from previous patch notes.

<br>


# Integration of HyperDeck and YanusLIVE

<figure><img src="/files/MwOTd7iK53hINYQxvIAu" alt=""><figcaption><p><strong>&#x3C;HyperDeck Studio Mini by Black Magic Design></strong></p></figcaption></figure>

Black Magic Design Website

(<https://www.blackmagicdesign.com/products/hyperdeckstudio/techspecs/W-HYD-11>)

1. **Connecting the PC and HyperDeck**\
   To connect the HyperDeck to a PC, you need to connect the Ethernet, USB-C, and SDI IN ports on the HyperDeck. The Ethernet can be connected directly to the PC, but a static IP must be used. Connect the USB-C (EXT DISK) port to the PC. The PC's USB port can be either USB-A or USB-C.

<figure><img src="/files/ZQkYC4HGLzTVgGd0WJWj" alt="" width="375"><figcaption></figcaption></figure>

<figure><img src="/files/XvaIphEFrWChYEVGEQ1g" alt=""><figcaption><p><strong>&#x3C;Connecting HyperDeck to the PC></strong></p></figcaption></figure>

For the SDI-IN connection, use Acsoon's Rx device and the provided SDI cable. It is recommended to use the provided cable, as using an incorrect cable may result in improper video input.

2. **Network Setting**\
   After completing the network connection, you need to configure the IP settings for both the HyperDeck and the PC. Set the IP on the HyperDeck to Static IP and assign the desired IP.

<figure><img src="/files/RqBwp1FLmTIyNpEHUQ8E" alt="" width="316"><figcaption><p>&#x3C; Static IP ></p></figcaption></figure>

<figure><img src="/files/3jN6GekOlTcDSTyCuuBi" alt="" width="316"><figcaption><p>&#x3C; <strong>IP Input ></strong></p></figcaption></figure>

3. **YanusLIVE Settings**\
   Once the IP on the HyperDeck is set to static, you must also enter the same IP into the Settings of YanusLIVE.

<figure><img src="/files/IyikuBMk6nSgOF1XQA9C" alt="" width="372"><figcaption><p>&#x3C; <strong>YanusLIVE IP Setting ></strong></p></figcaption></figure>

<br>


# License

* To use YanusLIVE, a license must be entered.
* Upon first launching YanusLIVE, the following window will appear:

<figure><img src="/files/UKArJimSh7JNZg4pVXui" alt="" width="330"><figcaption></figcaption></figure>

* Click on License in the Help menu to display the following window:

<figure><img src="/files/A3IK4HaglYDFDfqDPSVO" alt="" width="301"><figcaption><p>&#x3C; License Input Windows ></p></figcaption></figure>

* Enter the 36-character License Key in this window and click Activate. A "License is valid!" window will appear if the license is successfully applied.

<figure><img src="/files/rJsSyoJ4PxCIcKZuKz61" alt="" width="124"><figcaption></figcaption></figure>

* If the license fails, an error message will appear.

<figure><img src="/files/YqHW0TMOuWVydWU3Kvrx" alt="" width="212"><figcaption></figcaption></figure>

* To transfer the license to another PC, deactivate the license on the existing PC before transferring it.

<figure><img src="/files/Aoj6MWHenW8TWKBaCLV7" alt="" width="197"><figcaption></figcaption></figure>


# Temp


# Test khchoi\_r250616

<figure><img src="https://lh7-rt.googleusercontent.com/slidesz/AGV_vUflBwlYp45MfWhdSoFfDeY0Uk1thxQfNYMVHR2GcQ2k5NnHBnogQjYUuoF8zEMapKSpHl4Dy29zimiHwUvRO8SGcOnqbXG8f96_BhRd-pk_rr3CGn2fG_L4_XVZQzm7iu2KSVev=s2048?key=Has_RQHHjKwPYIIt88xeDw" alt=""><figcaption></figcaption></figure>

{% tabs %}
{% tab title="Device" %}

{% endtab %}

{% tab title="Actor" %}

{% endtab %}

{% tab title="Character" %}

{% endtab %}

{% tab title="Values" %}

{% endtab %}

{% tab title="Actor Profile" %}

{% endtab %}
{% endtabs %}

## Contents

###


# Test khchoi\_r250613

그림

Style Test

## Heading1

### Heading2

#### Heading3

* Unordered List 1
* Unordered List 2
* Unordered List 3

1. number 1
2. number 2
3. number 3

devider before

***

devider after

{% hint style="info" %}
Hint

This is Hint commnet
{% endhint %}

> 인용 표시

```
// Some code

```

![](https://lh7-rt.googleusercontent.com/slidesz/AGV_vUd0HsKrxvkGUZNUybcQTu-vtSMw0SZWMDhJWodqpNSzM4m7YLvJN2xXDnWebNMq4Y3e6I8JhT_PbqEtfAOSiCEeym1sGVIQsHu9rRsv6_jezTQlGZzasxAmPjwzgpWv4KzOc--e3LOa86ztUrh8QQ=s2048?key=eAKWopSc6t9N7fe0DUsxIg)   A push button that rotates counterclockwise by 90° each time it's pressed.

![](https://lh7-rt.googleusercontent.com/slidesz/AGV_vUeuEG5j8oNBH6UaG0sT7DXPHVQ7940pvpnxJJu5MUcQJVK03t1PR-dIku681lQw_h8f03BlK2tBogYYC_tbp8wbB6GuW2KTq3uUERlkym8BxvgMhw6Uz0iiA9BeGo59y8T6kdDX0wdAYG5_degX-3g=s2048?key=eAKWopSc6t9N7fe0DUsxIg)   A push button that rotates clockwise by 90° each time it's pressed.

![](https://lh7-rt.googleusercontent.com/slidesz/AGV_vUd8PUPyOWIavIpnLrv9E37ZR84ky_dSqwXYEx77Z3kvZi1phTCKhbqhvuvIVCQgwdmEDJjtR6F1_dk3-FMcemFXLWdIYM5Gdc86NuXoJMKSS-q2g3LzKk7E4g5YSM6CDmCKSwLg_mBPnaiIc_A4bOs=s2048?key=eAKWopSc6t9N7fe0DUsxIg)![](https://lh7-rt.googleusercontent.com/slidesz/AGV_vUeuEG5j8oNBH6UaG0sT7DXPHVQ7940pvpnxJJu5MUcQJVK03t1PR-dIku681lQw_h8f03BlK2tBogYYC_tbp8wbB6GuW2KTq3uUERlkym8BxvgMhw6Uz0iiA9BeGo59y8T6kdDX0wdAYG5_degX-3g=s2048?key=eAKWopSc6t9N7fe0DUsxIg)    No Ratation

![](https://lh7-rt.googleusercontent.com/slidesz/AGV_vUd8PUPyOWIavIpnLrv9E37ZR84ky_dSqwXYEx77Z3kvZi1phTCKhbqhvuvIVCQgwdmEDJjtR6F1_dk3-FMcemFXLWdIYM5Gdc86NuXoJMKSS-q2g3LzKk7E4g5YSM6CDmCKSwLg_mBPnaiIc_A4bOs=s2048?key=eAKWopSc6t9N7fe0DUsxIg)![](https://lh7-rt.googleusercontent.com/slidesz/AGV_vUfwzcTg22awy2EWrX_S-h7v2qescRbIKyj4vM4uJqbmpWIz2U2FV5QvyU_62DK0EyAvoUoeIUQA9X7Uw5FZzKU4Z6yxlWtYS6gDD6s0ajeCIGamUqPqPpHUOKA-ouji-LUJf15iVbSfaM9sA8Pzn-g=s2048?key=eAKWopSc6t9N7fe0DUsxIg)    Rotate 90° CW

![](https://lh7-rt.googleusercontent.com/slidesz/AGV_vUdYGS3L2pBmjSFw49yam4eulvVpfrKCs0jWU0z5UBTLsclpQr0JKEZBv6Osuh5jbaWl9ZxSyGTrJzHoqD7OUt4N0GXynG2vW7Cq53w6aSTKBZ4o8nOZ9CT1ERACezJ1StZv9EjMTx_2tYyuiboPues=s2048?key=eAKWopSc6t9N7fe0DUsxIg)![](https://lh7-rt.googleusercontent.com/slidesz/AGV_vUeRbN8lVf52Lh0Wvx5OyCeJmXzByUSoR_tLI1PwejweBkw-UKkv_vckGYGDAc4hlesYV67J2rwg9qDpZHDWd9n3B7e2VoZAwajGQuqQj5Py0k31l_w03qlJzNPqOoaAWsdvXufJZ6TSqVKGyp6erg=s2048?key=eAKWopSc6t9N7fe0DUsxIg)    Rotate 180

![](https://lh7-rt.googleusercontent.com/slidesz/AGV_vUca_w7xTD_GM9jLRc0BNhTrtbwTMqc1qeKbBgBnD9L-HEjYaFpYvbi1S2VfDS53Cy1cRSVCmDNDZEpSekTR1FeC_Zxx2rla4q-I1-9cjYXVIgVq7ZwwGOrEC6ynYg9LcBdfkOwUln9d0wr9JXag9ho=s2048?key=eAKWopSc6t9N7fe0DUsxIg)![](https://lh7-rt.googleusercontent.com/slidesz/AGV_vUdmv-oRPGSzD3Xbxd74U5qPwyXisJXWzuImkKEpMvR_zZfUtn3D-d91jVa-eR9EfQPH0lbUS75lHvQPmM1ItKHQbVGzC9v4dzxs_LBWk5nY2TmHzDXjxGTl0Qfedl9pXkG5lKfNnX75mRTqaIHnbJ0=s2048?key=eAKWopSc6t9N7fe0DUsxIg)    Rotate 90° CW

<figure><img src="/files/t7HjSP6X3rqB4omgE68r" alt="" width="492"><figcaption></figcaption></figure>


# YanusFACE

<figure><img src="/files/IEkeRKRxNL20Wo5FQ2PL" alt=""><figcaption></figcaption></figure>

YanusFACE is an advanced tool for **automated blendshape generation** and **rigging**, designed to speed up your character production pipeline while keeping full creative control.

***

### ⚡ Core Benefits

* **Automated Blendshapes & Rigging** — instantly generate blendshapes and rigs for 3D models, streamlining the production process.
* **Advanced Expression Editing** — refine facial expressions with tools like **Mirror, Split, Default Bake Edit, Create Modification, and Corrective Expression**.
* **Seamless 3D Integration** — import/export models to **Blender, 3ds Max, and ZBrush** for detailed sculpting and editing.
* **Industry Compatibility** — built for **MetaHuman** and **Advanced Skeleton**, with adaptability for custom rigs and models.
* **Efficient Updates** — attach new objects to meshes for quick adjustments without re-modeling.
* **Custom Model Support** — with **ReTopology**, any model can be adapted to YanusFACE templates.

***

### ✨ Key Features

#### 🎛 Rig Manager

* **YanusSTUDIO RIG** — our custom rig, designed as a cleaner and more professional alternative to MetaHuman.
* **Batch Creator** — automatically generate a complete rig from object parameters.
* **Custom Creator** — design custom controllers from scratch or modify existing ones.
* **Optimize** — merge multiple controllers into a single one for cleaner workflows and easier sculpting.

***

#### 🎭 BlendShape Tools

* **Split & Mirror** — sculpt symmetrically or mirror changes across paired controllers.
* **Bake All Objects** — generate BlendShapes for skipped or unbaked objects.
* **Default Bake Edit** — directly edit bakes with intuitive search and efficient scene management.
* **Create Modification** — batch update all bakes after model adjustments.
* **Corrective Expression** — fine-tune rigs and create unique facial expressions.

***

#### 🟢 ReTopology

* **Problem Solved** — previously, custom models couldn’t be used due to mismatched topology with the YanusFACE template.
* **How It Works** — select a **Base (template)** and a **Target (your model)**, place control markers, then wrap your mesh to fit the base topology.
* **Result** — your model is converted into YanusFACE-compatible topology with **minimal quality loss**.
* **Workflow** — once retopology is done, you can apply all YanusFACE features (modifications, bakes, corrective expressions) directly to your own model.

***

#### 🛠 Essential Tools

* **Attach New Object** — connect new meshes or replace existing ones while keeping full Bake System integration.
* **Core Tools Panel** — access frequently used functions like **Generate, Reset, Edit, and DualPanel** directly in the main UI.

***

#### 💾 Installation & Licensing

* **Easy Installation** — drag & drop install script for Maya (2022 or later).
* **Trial License** — new users can try YanusFACE free for **2 weeks**.
* **Activation & Deactivation** — simple license management via the Help → License menu.
* **Flexible Licensing** — supports single-user, company, or bulk purchases.

***

### 🎯 Who Is YanusFACE For?

Perfect for:

* **Animators** — accelerate workflows and focus on creativity.
* **Riggers** — simplify complex setups and save time.
* **Digital Artists** — create expressive, professional characters with less effort.

***

### 🔗 YanusSTUDIO Integration

YanusFACE is fully integrated with other **YanusSTUDIO products**:

* **YanusReTARGET** — for retargeting animations.
* **YanusLIVE** — capture **real-time mocap data** and connect it to characters via **LiveLink**.

***

### 🚀 Get Started

Boost your character production with our **user-friendly guide** and **intuitive interface**.

***

### 📩 Contacts

* [🎥 **YouTube**](https://youtube.com/@yanusstudio?si=nNhO5mSq4GD9r8an)
* [💼 **LinkedIn**](https://www.linkedin.com/showcase/yanus-studio/posts/?feedView=all)
* [📸 **Instagram**](https://www.instagram.com/yanus_studio/)


# Settings

## 🧩 General&#x20;

This section describes how to set up the **main objects** and the **rig group** for proper animation processing and BakeGeneration.

<details>

<summary>Preview</summary>

<figure><img src="/files/QitfP6e1cZ6KIzj85kPp" alt="" width="504"><figcaption></figcaption></figure>

</details>

***

### 📋 Components

#### 1. Main Objects

These are the **primary objects** that contain animations.\
They can also be used to generate BlendShapes with **Generation**.

***

#### 2. Rig Group

A group (or list) of objects initialized by the user as a **RIG**.\
These objects are required for BakeGeneration to function correctly.

***

### 💡 Tips

* You can select individual objects or the entire group.
* The algorithm will automatically detect all meshes that contain animations.
* By clicking on the filled field, you can quickly check which objects were detected.

***

### ⚠️ Common Issues

* If a controller is **hidden, invisible, or missing** from the Rig Group, no BlendShape will be created.
* If a controller has **locked attributes**, a BlendShape will also not be created.

## 🎛 Rig

This section defines how the **controller detection algorithm** works inside the **RIG** module.\
All objects are divided into two categories:

* **UnTracking** — objects that are analyzed but ignored by the logic.
* **Tracking** — objects that are actively checked for BlendShapes or connections with main objects.

<details>

<summary>Preview</summary>

<figure><img src="/files/PmTiXPOXllYHySElpmEc" alt="" width="563"><figcaption></figcaption></figure>

</details>

***

### 📋 Interface

#### 1. UnTracking

A list of objects that the algorithm can see, but will **not** treat as controllers.\
Example: `camera`, `light`, `shader`.

***

#### 2. Tracking

A list of objects that **will be tracked** and considered in the logic.\
Example: `locator`, `mesh`, `nurbsCurve`.

***

#### 3. 🔄 Reset

A button that restores all settings to their **default values**.

***

### 💡 Tips

* To move an object from **UnTracking** to **Tracking**, simply **drag & drop** it.
* Use **Reset** anytime you need to quickly return to default parameters.




---

[Next Page](/llms-full.txt/1)