I'm using Wonder Dynamics for slightly different purposes (capturing and analyzing complex sports movements from video) and I'm deeply impressed by what it is capable of doing. While it still struggles with what state-of-the-art pose estimation and camera motion estimation models are struggling, the whole package and implementation are just insanely impressive. From the web UI that is incredibly fast even when uploading 4K@120fps footage to the final result - which is a Blender file and clean slate video for me. Extremely easy to use. A lot of love and care is put into this product.
Wonder Animation seems to be just a specific use case improvement over already impressive capabilities. Normal "Live Action" projects can also detect cuts, but the "Animation" project seems to understand the space from multiple cuts/angles.
I'm a bit confused. While the demo looks amazing, I feel it is quite misleading along with some of the wording they use.
Is is actually creating the 3d environment and character models or are these premade, and instead, its handling solely character rigging and camera tracking?
You have to provide rigged 3d character models yourself(or use their premade ones)- it does camera tracking + motion matching or whatever algo/ai fun to track the biped animation- so yeah you feed it a video and the 3d models and it spits out either a video of the composite or you can download the 3d scene for further use/massaging in other applications.
btw Animation filmmaker here- tested a previous version- it was a janky toy that wasn't useful to me, checked out the new stuff today but didn't get to testing it after reading through the several pages of limitations on camera work, composition etc that can be used in it. I don't want my cinematography/blocking constrained.
lowkey if the tech keeps up with the demo, huge W for indie movie makers, or amateurs, used their tech last year and was surprised by how good it worked
I'm using Wonder Dynamics for slightly different purposes (capturing and analyzing complex sports movements from video) and I'm deeply impressed by what it is capable of doing. While it still struggles with what state-of-the-art pose estimation and camera motion estimation models are struggling, the whole package and implementation are just insanely impressive. From the web UI that is incredibly fast even when uploading 4K@120fps footage to the final result - which is a Blender file and clean slate video for me. Extremely easy to use. A lot of love and care is put into this product.
Wonder Animation seems to be just a specific use case improvement over already impressive capabilities. Normal "Live Action" projects can also detect cuts, but the "Animation" project seems to understand the space from multiple cuts/angles.
I'm a bit confused. While the demo looks amazing, I feel it is quite misleading along with some of the wording they use.
Is is actually creating the 3d environment and character models or are these premade, and instead, its handling solely character rigging and camera tracking?
You have to provide rigged 3d character models yourself(or use their premade ones)- it does camera tracking + motion matching or whatever algo/ai fun to track the biped animation- so yeah you feed it a video and the 3d models and it spits out either a video of the composite or you can download the 3d scene for further use/massaging in other applications.
btw Animation filmmaker here- tested a previous version- it was a janky toy that wasn't useful to me, checked out the new stuff today but didn't get to testing it after reading through the several pages of limitations on camera work, composition etc that can be used in it. I don't want my cinematography/blocking constrained.
Nice site design tho(shrug)
I appreciate this information. Saves me some time. Thanks
Anyone surprised that Autodesk is citing blender in a non-negative light?
lowkey if the tech keeps up with the demo, huge W for indie movie makers, or amateurs, used their tech last year and was surprised by how good it worked
Looks really good, what are some use cases you have in mind outside the movie / animated film industry?
kudos