DEMO / Hatsune Miku Wavefile version 2
I am using “USD from GLTF” tool from Google and Blender with CATS addon to convert the MMD dance motion data into Apple USDZ format and mix the sound inside Reality Composer app. The final product is .reality app that works on every iOS 13 devices.
In this test, I would like to bring dance performance animation, virtual character into a shareable AR experience. The process still is slightly involved in making sure everything is baked properly from animation, dynamics, shader materials and textures. However, it is so much easier to make this today than years before!
File size is small just around 20 MB, .reality file.
What still can be improved:
– In this demo Shader and Texture are converted as is, looks correct in Blender, but conversion is not always perfect.
– Blendshapes are still not supported for USDZ, perhaps some xcode and swift code involvement can allow this? For now Miku face is static
– USDZ needs a proper NPR shader and material, currently it is PBR only and limited. With Unity maybe shader can improve?
Other than all above limitations, the AR performance and AR anchor looks solid. Occlusion works but only if character is in real size.
