Website
Support

YanusLIVE

Version [1.4.5] – November 3rd, 2024

Added Features

  • Loading screen on startup

  • Restart Processes: Added under Menu > Tools. It is recommended to use this feature to restart processes if an issue occurs, before attempting a full program restart.

Improved Features

  • License deactivation without key: Deactivation is now possible without a License Key if the program is already activated.

  • Actor display rotation buttons: Rotation state is now visually indicated using button colors, making it easier to understand the current state.

  • Monitor display logic: If the previous window position from a multi-monitor setup is not available, the program will now display on the primary monitor by default.

  • Neutral Calibration prompt: Users are now prompted to save after performing Neutral Calibration, with data saved to the current Actor Profile.

  • Save button renamed: The button previously named Save in Actor Profile has been renamed to Save As to better reflect its functionality.

  • USB Camera Settings Check: If the camera's resolution or FPS differs from the settings after connecting, the user will be notified. Additionally, if the camera is inaccessible, users are prompted to ensure no other applications are using the camera.

Version [1.4.3] – October 18th, 2024

Improved Features

Separated the settings file path by version

  • e.g., {User Path}/YanusLIVE/version_1_4_3

  • Added portrait aspect ratios to the Resize Aspect Ratio selection.

  • 9:16, 3:4, 2:3, 486:720

Bug Fixes

  • Fixed side effects related to CSV conversion and Resize Aspect in version 1.4.2, which occurred after resolving the write permission issue for the settings file.

Version [1.4.1] – October 10th, 2024

Added Features

OBS Studio WebSocket Control Support

  • Added OBS Studio as an option in the YanusLIVE HyperDeck window's 'Device' combo box.

  • When connecting to OBS Studio, the following automatic settings are applied

  • OBS Video Settings to USB Camera settings (Frame Rate, Resolution Width/Height).

  • Select USB Camera mode and OBS Virtual Camera device, then start Actor Mode.

Note: The Start Virtual Camera button in OBS needs to be pressed manually.

Version [1.3.1] – September 2th, 2024

Added Features

  • Settings > Graph

View the graphs of multiple generated facial data sets.

  • Tools > Filter Designer

View the results of filter tuning with unfiltered data, without generating a CSV file.

Improved Features

  • The location of configuration ini files changed to a fixed path in User/YanusLIVE. This change eliminates inconveniences such as needing to reset the license after an update.

  • Reorganized items in the Settings window and improved terminology to be more user-friendly.

  • Filter Performance Enhancements and Preset Addition.

  1. Improved Kalman Filter performance by integrating it with the Average filter. The Average filter is applied only when the change in value is below a certain threshold before applying the Kalman filter. This enhances noise reduction while improving responsiveness.

  2. Added a feature to select specific BlendShapes using keywords and enabled dual settings for all filter coefficients, allowing different settings to be applied to BlendShapes with varying characteristics.

  3. Introduced a Preset feature for managing the increased number of filter settings. Depending on the use case, it is recommended to select from Stable, Balanced, or High Performance Presets.

  4. Presets now include both Process Mode and Filter settings and are uniformly applied across Camera, Video File, and Generate Facial Data File modes. The settings displayed in the Actor tab under Settings reflect these consistent settings, and CSV file generation now follows the Video File settings.

Version [1.2.6] - Aug 7th, 2024

Improved Features

  1. Multi-language and spaces can now be used in the paths and file names of YanusLIVE, Video, Actor Profile, and CSV Export Data.

  2. Fixed an issue where the [Generate Facial Data File] window would not open when there was an error in the path.

  3. Added a user notification when opening the [Settings] window if there is an error in the current values.

Version [1.2.5] - Jul 18th, 2024

Added Features

  1. Actor Profile Frame:

    • Added an icon to the left of the Actor Profile path to open the [Actor Profile Editor] window.

  2. Settings > Experimental:

    • Added editor_font_size parameter for setting the font size in the Actor Profile Editor window.

  3. Actor Profile Editor window:

    • BlendShape selection combo box.

    • Numeric settings for [Scale, Scale range, Offset].

    • Adjustable [Single step] value for [Scale, Offset] up/down buttons.

  4. Opening the Actor Profile Editor window

    • When the icon is clicked, the last modified BlendShape is automatically selected, and the window opens. [Clicking the icon] repeatedly opens additional windows. Multiple windows can be opened simultaneously.

    • [Double-clicking the Actor Profile Slider] will select the corresponding BlendShape and open the window. When the value tooltip is displayed, you can double-click, but it is better to use the circular handle.

  5. Utilizing the Actor Profile Editor

    • For settings where the Scale value range exceeds 2, you can effortlessly adjust the Scale range. This feature improves tuning convenience by showing multiple items in a large font, including those hidden within the scroll (e.g., EyeWide, EyeBrowDown).

Improved Features

  1. At program launch, the [Actor mode start/pause and stop] buttons will now only become active once preparation is complete.

Version [1.2.4] - Jul 8th, 2024

Added Features

  1. Settings > Experimental:

    • Added sync_eye_movements options as a check box.

    • Added sync_eye_reference selection options, [LEFT, RIGHT]

    • Added sync_eye_threshold parameter.

    • Added neutral_cal_eye_dir options as a check box.

  2. Option to Improve Eye Symmetry in Specific Situations

    • When [sync_eye_movement] is enabled, the movements of both eyes will be synchronized based on the selected eye [sync_eye_reference]. If the difference in movements between the eyes exceeds [sync_eye_threshold], synchronization will occur.

    • When [neutral_cal_eye_dir] is unchecked, blendshapes related to eye movement are excluded from being applied during neutral calibration. (They are not excluded from the neutral calibration process itself.)

  3. Values Frame

    • Added a feature to display values in a larger format using mouse tooltips, similar to the [Actor Profile] Frame.

    • When the tooltip is displayed, mouse clicking on it will pin it in place. To hide it, click on the bar area again or uncheck the [Pin Tooltip] checkbox. The existing [Sync Scroll] feature is retained and has been renamed to [Pin Tooltip].

Improved Features

  1. Adjusted the pairing of EyeLook Left and Right in the Actor Profile.

  2. A red border appears around the [Actor] screen during [HyperDeck] recording.

  3. Save ini files in 'utf-8' format to support multiple languages and paths with spaces (be careful not to change the 'utf-8' format when editing manually).

Version [1.2.3] - Jun 27th, 2024

Added Features

  1. Settings > Live:

    • Added usb_codec parameter options, [MJPG, YUY2, H264, DIVX, XVID, WMV1, WMV2, WMV3, WMV9, MPEG1, MPEG2, MPEG4].

Improved Features

  1. In "Actor mode: USB Camera" the codec is explicitly specified when connecting the device to prevent errors that may occur with automatic settings.

    • In most cases, it has been confirmed that the default MJPG setting is well compatible.

    • The specific codec must be installed on your PC. It uses the FourCC (Four Character Code) format. For more details, refer to https://fourcc.org/codecs.php.

    • If a setting not available in the combo menu is needed, you can directly edit the usb_codec entry under [ComoItemSetup] in the setting_user.ini text file.

  2. In “Generating Facial Data”, if the timecode cannot be read from the video file, the process will not handle the error. Instead, it will set the start timecode to 00:00:00:00 and generate the CSV file.

Additional Information

  1. Due to a change in the licensing policy, licenses issued before 24-06-17 are only valid up to v1.2.0. To use v1.2.3, you need to renew your license. If you have not received the updated license yet, please request it.

Version [1.2.2] - Jun 20th, 2024

Added Features

  1. Settings > Experimental:

    • Added csv_resize_percent options as a check box.

Improved Features

  1. The resize_aspect processing added in version 1.2.1 is also included in the [Generating Facial Data File] menu.

  2. When generating CSV data in the [Generating Facial Data File] menu, video frames are processed by resizing them according to csv_resize_percent.

    • In previous versions, this process was handled using the original video without resizing.

    • resize_percent and resize_aspect_ratio are now applied consistently not only in Yanus CAM, USB Camera, and Video File actor mode, but also during CSV data generation.

  3. The CSV data output folder is now remembered when changed, and it is set as the default path when the file dialog in Settings > Experimental > csv_file_path is opened.

Additional Information

  1. Due to a change in the licensing policy, licenses issued before 24-06-17 are only valid up to v1.2.0. To use v1.2.2, you need to renew your license. If you have not received the updated license yet, please request it.

Version [1.2.1] - Jun 19th, 2024

Added Features

  1. Settings > Experimental:

    • Added resize_aspect options as a check box.

    • Added resize_aspect_ratio parameter options, [16:9, 4:3, 3:2, 1:1, 720:486, …].

Improved Features

  1. When resizing the input video according to the yanus_resize_percent, usb_resize_percent, and file_resize_percent settings, allowing the aspect ratio to be modified simultaneously.

    • If resize_aspect is checked, set the height by dividing the width, adjusted by resize_percent, by the calculated aspect ratio value. The reference for resize_aspect_ratio is before rotating the video, and the height is adjusted to match the aspect ratio while keeping the width fixed.

    • For example, if you resize a 1920x1080 video to 68 percent while adjusting the aspect ratio to 4:3, the width will be 1920*0.68 = 1306, and the height will be 1306/(4/3) = 980. Thus, the video will be adjusted to 1306x980 (calculated with rounding).

    • For special aspect ratios like 720:486, you can directly add the width and height resolution to the list as is. However, in this case, you need to manually edit the resize_aspect_ratio entry under [ComboItemSetup] in the settings_user.ini text file.

Additional Information

  1. Due to a change in the licensing policy, licenses issued before 24-06-17 are only valid up to v1.2.0. To use v1.2.1, you need to renew your license. If you have not received the updated license yet, please request it.

Version [1.2.0] - Jun 14th, 2024

Added Features

  1. Settings > Live:

    • Added set_camera_parameters options as a check box.

    • Added process_file process options, [IMAGE, VIDEO].

  2. Settings > Experimental:

    • Added filter_type_live and filter_type_csv options for filter type selection, [MOVING AVERAGE, BUTTERWORTH, KALMAN, NONE].

    • Added average_window parameter for [MOVING AVERAGE] filter type, The previous version referred to this as the smooth factor.

    • Added butterworth_cutoff parameter for [BUTTERWORTH] filter type.

    • Added kalman_q and kalman_r parameter for [KALMAN] filter type.

    • Added process_csv options, [IMAGE, VIDEO, LIVE_STREAM].

    • Added csv_file_play options as a check box.

    • Added csv_file_path with the file dialog button.

    • Added zoom_font_size parameter.

  3. Settings > Remote:

    • Added startup_actor_control options as a check box.

  4. Video File playback process options:

    • Added a mode similar to LIVE_STREAM for Video File in the Camera.

    • Both LIVE_STREAM and VIDEO modes provide noise-free stability, but they have the drawback of reduced output during very fast movements.

  5. Process options and filter types:

    • For LIVE_STREAM and VIDEO process options, it is recommended to set the Filter Type to NONE.

    • When tuning is needed between faster responsiveness and noise stability, it is recommended to use IMAGE process mode.

    • In Image mode, open the Settings window and modify the filter type and parameters in the Experimental tab. Click Apply to see the changes reflected in real time. Tune the settings while observing the applied state on the character. Note that for live process mode, changes will only take effect after restarting Actor mode.

    • Default parameters for all three filter modes have been set to produce output similar to average_window = 4 (Previous default value)

    • For Butterworth, lowering the cutoff frequency reduces more noise but decreases responsiveness.

    • kalman_q improves responsiveness, while kalman_r removes more noise. The performance of kalman_q and kalman_r is influenced by their relative sizes, not their absolute values. The Butterworth filter is influenced only by frequency characteristics, but the Kalman filter can adapt better to changing conditions, although it can be a bit more difficult to tune.

  6. CSV data generation process options and CSV playback.

    • Updated to create CSV files with the same operations as the options executed in real-time processes.

    • The "Generating Facial Data File" window and the "Settings" window are open simultaneously. The process_csv is set to Image by default, and the pre-filter is set to Butterworth. After changing options and parameters, pressing the Apply button will change the settings and reflect them when generating.

    • In the "Generating Facial Data File" window, the smooth factor has been removed, and neutral data has been changed to unfiltered data.

    • Set the generated file to csv_file_path and check csv_file_play. Press the Apply button to apply the changed settings. When playing the Actor Video file, only the video is played without processing, and CSV data is read and sent to livelink. During this time, facemesh and actor profile do not operate. It is recommended to use this for data playback on low-spec PCs where FPS is insufficient.

Improved Features

  1. The set_camera_parameters option has been added to reduce connection delay when only connecting without setting parameters for a USB camera.

  2. The zoom_font_size option has been added to allow users to enlarge the font size when selecting and modifying blendShape values in the Actor Profile. After changing the number and pressing Apply, it will apply to the tool-tip in the Actor Profile.

  3. The startup_actor_control option allows users to automatically stop Actor mode when starting the Character Package and then restart Actor mode after the Character Package has launched. It is recommended to re-enable this setting if character switching causes freezing issues on low-spec PCs.

Known Issues

  1. Video File Path:

    • If the Video File Path contains non-English characters or spaces, there is an error that prevents the Generating Facial Data File from executing properly.

Version [1.1.0] - May 30th, 2024

Added Features

  1. Settings > Live:

    • Added frown_enhancement options as a check box [True, False]

    • Added cal_cheeksquint calibration parameter [0.0~scale_range]

    • Added cal_nosesneer calibration parameter [0.0~scale_range]

  2. Actor Profile JSON File:

    • The version of the Actor Profile file has been updated from 1.0 to 1.1.

    • Changed the neutral_enable of some blendShapes from false to true.

    • Removed the "extra" item.

    • When reading a file from the previous version, it will be automatically updated to the new format upon saving.

  3. Frown Enhancement:

    • Enable this option to activate CheekSquint and NoseSneer blendShape values for better frowning expression.

    • Added the ability to independently set the weights for CheekSquint and NoseSneer values via numerical input, separate from the Actor Profile settings.

    • If this feature causes undesired effects on expressions, it can be disabled via a checkbox.

    • With the Settings window open, these settings can be adjusted and applied in real-time using the Apply button. (If live monitoring is available, it can be useful to set events according to the type of performance.)

Known Issues

  1. Actor Profile:

    • If you want to exclude specific blendShapes from neutral calibration or modify the automatically set scale range, please directly edit the actor profile JSON file.

  2. UE Project LiveLink Port:

    • To use the YanusLIVE PKG and an Unreal Project simultaneously in the same local environment, change the port in UE > Project Settings > Plug-in > Apple ARKit. Note that this requires restarting UE.

Version [1.0.2] - May 24th, 2024

Added Features

  1. Settings > Live:

    • Added yanus_backend options, [MSMF, DSHOW].

    • Added process_camera options, [IMAGE, LIVE_STREAM].

    • Added display_fps options, [60, 30].

  2. Settings > Remote:

    • Added pixelstreaming_ip.

    • Added pixelstreaming_port.

  3. Menu > View > Live Information:

    • Added process, output FPS information display.

      (format: fps cap: 59.87, process: 60.21, out: 58.28)

Improved Features

  1. Restored Character External mode and renamed it to PixelStreaming.

  2. Reduced frame delay factors when displaying FaceMesh.

  3. Improved live performance by adding a new LIVE_STREAM mode when using the camera.

  4. Optimized to output as many frames as possible with minimal delay according to the computer's performance.

  5. Added option to select 30 fps or 60 fps display for Actor screen, reducing GUI load on lower-spec PCs.

Bug Fixes

  1. Automatically terminates any remaining 'YanusLIVE' tasks on restart to handle abnormal terminations (targets tasks containing the name 'YanusLIVE').

  2. Simplified Menu > Tools > ‘Reset settings on restart’ function by removing the function to check pkg path and update relative paths, now restores default settings.

Known Issues

  1. MSMF or DSHOW usb_backend:

    • The backend for USB Cameras can be either MSMF or DSHOW, depending on which is faster for your PC environment.

  2. Issues with LiveLink Resources:

    • When the Unreal Project is open on the local PC, running the Character Unreal Package may fail to operate due to LiveLink resources being occupied.

    • If the Unreal Engine package does not close properly, the newly started Yanus LIVE may fail to operate because it cannot acquire LiveLink resources. (In such cases, please use the Task Manager to force close the Unreal Engine package.)

Version [1.0.1] - May 13th, 2024

Added Features

  1. Settings > Remote:

    • Added width, height, and resize_percent options.

    • Added pkg_i_type [Unreal Engine, Unity] option.

  2. Settings > Live:

    • Changed usb_backend to a combo box [MSMF, DSHOW].

  3. Menu > Tools:

    • Added Reset settings on restart.

  4. Character Packages:

    • Added Unreal Engine MetaHuman-based character pkg.

    • Added Unity connection test character pkg.

Improved Features

  1. Changed the execution method of Character View (removed PixelStreaming).

  2. Improved ‘Actor to Character’ delay.

  3. Removed ‘Character mode: External.’

  4. Added the ability to add Unity type as a ‘Character PKG’ type (Experimental).

Bug Fixes

  1. Reduced the minimum size of the GUI width to 1718x700 for low-resolution monitor support.

  2. Activated HyperDeck's ‘actor prefix’ function.

  3. Added and fixed missing ‘Icon ToolTips.’

Known Issues

  1. MSMF (Microsoft Media Foundation) Support:

    • If the USB camera input device supports MSMF, FPS performance may improve

  2. GPU Settings:

    • In System > Display > Graphics > Advanced settings, set the option for Yanus_LIVE.exe to the integrated GPU option (which may be in power saving mode) for performance gains.

  3. Administrator Privileges:

    • If the Character window appears but YanusLIVE does not open properly, try running YanusLIVE with administrator privileges.

  4. Socket Port Errors:

    • While some socket port-related error messages have been improved after abnormal termination and restart, they may still occur in some cases.

    • You can terminate the Task named "Yanus_LIVE" in Task Manager to resolve the issue without restarting your PC.

  5. Display Resolution:

    • If characters appear small on monitors with a resolution of 1920x1080 or lower, please decrease the resize_percent value.

Version [1.0.0] - Apr 24th, 2024

PreviousYanusFACENextYanusReTARGET

Last updated