A New Era For Motion Capture at SIGGRAPH 2023

A New Era For Motion Capture at SIGGRAPH 2023

Vicon debuts its markerless motion capture technology in collaboration with Artanim, the research arm of Dreamscape, the leading VR company, at SIGGRAPH 2023

Vicon today marks a new era of innovation in the field of motion capture, announcing that it will debut its machine learning (ML) powered markerless technology at SIGGRAPH 2023 in Los Angeles, in collaboration with Artanim, the Swiss research institute and the award-winning VR group, Dreamscape Immersive.

The announcement follows nearly three years of research and development focusing on the integration of ML and artificial intelligence (AI) into markerless motion capture at Vicon’s renowned R&D facility in Oxford, UK. The project has been undertaken by a new dedicated team, led by CTO Mark Finch, and leverages nearly four decades worth of Vicon innovation to enable a seamless, end-to-end markerless infrastructure, from pixel to purpose.

Commenting on the news, Imogen Moorhouse, Vicon CEO, said:

Today marks the beginning of a new era for motion capture. The ability to capture motion without markers, while maintaining industry leading accuracy and precision, is an incredibly complex feat. After an initial research phase, we have focused on developing the world class markerless capture algorithms, robust real time tracking, labeling and solving needed to make this innovation a reality. What we are demonstrating at SIGGRAPH is not a one-off concept, or simply a technology demonstrator. It is our first step towards future product launches which will culminate in a first-of-its-kind platform for markerless motion capture.”

For Dreamscape, markerless motion capture can now provide a more true-to-life adventure than any other immersive VR experience by allowing for more free-flowing movement and exploration with even less user gear. Commenting on the decision to partner with Vicon, Aaron Grosky, President & COO of Dreamscape said:

We have been anxiously awaiting the time when markerless could break from concept and into product, where the technology could support the precision required to realize its amazing potential. Vicon’s reputation for delivering the highest standards of motion capture technology for nearly forty years and Dreamscape’s persistent quest to bring the audience into the experience with full agency and no friction meant that working together on this was a no-brainer. We’re thrilled with the result. The implications for both quality of experience and ease of operations across all our efforts, from location-based entertainment to transforming the educational journey with Dreamscape Learn, is just game-changing.

The collaboration between Vicon and Artanim was key to ensure the desired requirements for the VR use case were met.

Achieving best in class virtual body ownership and immersion in VR requires both accurate tracking and very low latency. We spent substantial R&D effort evaluating computational performance of ML-based tracking algorithms, implementing and fine-tuning the multi-modal tracking solution, as well as taking the best from the full-body markerless motion capture, and VR headset tracking capabilities,” said Sylvain Chagué, co-founder and CTO of Artanim and Dreamscape.

At SIGGRAPH, Vicon and Artanim showcased a six person, markerless and multi-modal real-time solve, set against Dreamscape’s location-based virtual reality adventure called The Clockwork Forest, created in partnership with Audemars Piguet, the Swiss haute horology manufacturer. The experience allows participants to shrink to the size of an ant and explore a mechanical wonderland, while working together to repair the Source of Time and restore the rhythm of nature.

With this showcase, Vicon earned a CGW Silver Edge Award for technological innovation.More information about the collaborative R&D project here.

 

Vicon - Artanim team at SIGGRAPH 2023  Vicon booth at SIGGRAPH 2023

SIGGRAPH 2015 – Real-Time Live!

Real Virtuality was presented in Los Angeles at SIGGRAPH 2015, the leading conference on computer graphics and interactive techniques. Real Virtuality is a multi-user immersive platform combining a 3D environment – which can be seen through a VR headset – with a real life stage set. Users are tracked by a motion capture system allowing them to see their own bodies and move physically in the virtual environment.

The experience offered by Real Virtuality brings a once in a lifetime experience. Unlike other static position VR systems, Real Virtuality allows users to become immersed in a VR scene by walking, running, interacting with physical objects and meeting other people. Because user’s movement exactly match their avatars movements in the 3D environment and are streamed to the users with very low latency, there is no discomfort or interface required. The bodies of the users become the interface. The VR platform offers a “matrix-like” degree of immersion over a large area, up to hundreds of square meters:

Humanity has essentially recreated, on the basest level, The Matrix  G. Clay Whittaker, Journalist, Popular Science

The demo “Walking through a pharaoh’s tomb” created in collaboration with Kenzan was selected as one of the three finalists for the Immersive Realities (AR/VR) contest. Artanim’s team was in Los Angeles from August 9th to 13th to present the project with the support of Pro Helvetia.

Siggraph 2015 Walking through a pharaoh tomb