English (US)

Fumika / Piano motion capture system

Play in VR
Play in AR
Add to Mylist
Published on2020/11/08
Show translation

We are planning to make a virtual character called Fumika debut as a pianist. As a pianist, the piano playing motion needs to be accurate, and we are creating our own system to capture the playing motion with unity. This file uses it to capture the performance and is created based on the motion data. Specifically, it combines LeapMotion + HTC Vive + Midi data to capture finger movements during performance. At the point where the piano performance starts 24 seconds after the start of playback, the processing becomes heavy, and depending on the PC environment, you may have to wait for nearly 2 minutes. I'm sorry, but please wait a moment. Once you've read the data, you won't have to wait anymore. With the old MacPro2010, it took about 5 seconds. It may be related to the memory capacity. Depending on the viewing environment of the user, the timing of the picture and sound may not match. Please enjoy!


1000 characters left

Related scenes