Articles by Caecilia

You are currently browsing Caecilia’s articles.

Montreux Jazz Festival demo3D In Motion (3DIM) – our experimental setup of capture, visualization and sonification of movements in real time – was presented at the Montreux Jazz Festival on the 12th of July 2014 during an one hour workshop. For this occasion, a special sound design was developed by Alain Renaud from MINTLab. A mapping of different artists’ audio tracks recorded during their visit to the festival was performed. The tracks were generously provided by the Montreux Jazz Lab of EPFL.

Moreover, several improvements in the 3DIM application were achieved. For instance, an iPad App was implemented to easily switch between the sound design scenarios, a prompter was added to provide instructions to the user and an OSC connection between the sonification and graphical applications was programmed to control visual feedback from sound events.

Again, the feedback from the public was positive. We look forward to developing a first live performance using this system.

More information about the 3DIM project here.

A demo video of the setup including the sonification part will arrive soon. Stay in touch!

Montreux Jazz Festival demo      Montreux Jazz Festival demo

Tags: ,

Electron demoIn collaboration with Alain Renaud from MINTLab, we gave on the 20th of April a workshop at Electron Festival in Geneva. At this occasion, we presented the 3D In Motion (3DIM) experimental setup of capture, visualization and sonification of movements in real time. About twenty people participated to the workshop, where they had the opportunity to test the system and to learn more about the underlying techniques.

It was the first time 3DIM was officially presented to the public and the feedback was positive. This gave us a good basis for further developing the system both in terms of visualization and musicality. The next demonstration will take place in June at the New Interfaces for Musical Expression (NIME) Conference in London.

More information about the 3DIM project here.

 

 

Electron demo      Electron demo

Tags: ,

Last week, we were invited at the Winter Enrichment Program (WEP) 2014, a three weeks of compelling educational, cultural and recreational events organized by the King Abdullah University of Science and Technology (KAUST) in Jeddah (Saudi Arabia). There, we did a 3 half day workshop on Motion Capture and 3D animation for the students of KAUST. Participants had the chance to test our Xsens MVN system and to follow a course on the challenges related to Mocap and 3D character modeling/animation through case studies and practical examples. According to students feedback, they really enjoyed the workshop!

 

 

 

 

 

 

 

Also, we participated to the Science Fun Fair, an opportunity for the community and schools from Saudi Arabia to come and learn about the science at KAUST. At this occasion, we did motion capture demos and showed several videos about our latest projects.

Tags: ,

Yesterday, we tested with Tobias Baumann, game designer and freelancer, the Oculus Rift with our Xsens MVN in Unity 3D. The goal was to virtually hit columns of cubes and balloons. Some simple applications to start with, but resulting in a nice full-body immersive VR experience. The first tests were convincing. We will definitely continue working on this topic with Tobias. Stay tuned!

Tags: ,

Last week we tested the motion capture protocol for the research project “Motion and unconsciousness”. The setup is uncommon: subjects are asked to execute movements in the dark while still being able to see the other participant’s hands thanks to phosphorescent tape. They are also equipped with a respiration sensor and headphones with white noise to be isolated from external stimuli.

100 volunteers will participate to the study and be distributed in different groups according to specific criteria. One group will also be captured with simultaneous EEG recording. The goal of the project is to compare the subjective sensation of synchrony with objective data of motor coordination and synchronization acquired from motion capture when two people are engaged in joint action tasks.

 

Tags: , , ,

In the context of our project Shoulder3D, we spent a day in radiology to acquire specific data required for the validation of our research methodology. The objective of the project is to develop a new kinematic model to reliably evaluate the three-dimensional motion of the shoulder based on motion capture data. In order to compare the kinematics estimated by our methodology with the real motion of the shoulder bones, we performed a double acquisition. We simultaneously recorded motion capture data using our Vicon system and fluoroscopic images.

As you can see on the pictures below, setting up properly the system in such a confine area and dealing with the occlusions of the fluoroscopic device were the tricky parts of our work!

Mocap in fluoroscopy room    Mocap in fluoroscopy room

Tags: ,

The Institute of Movement Science and Sport Medicine of the University of Geneva and the Willy Taillard Laboratory of Kinesiology of the University Hospital of Geneva contacted us for an unusual motion capture session. Daniel Jaquet, a PhD student in Humanities, focuses his research on the description of fights in full armor in historical documents from the 16th century. Part of his thesis work aims at analyzing the range of possible movements while wearing such a 30 kg medieval armor. By using motion capture, he will be able to get a comprehensive amount of data.

Daniel - The Knight      Markers attached to the armor

For this mocap session, the main issue was related to the reflective surface of the armor. Indeed, reflections can be perceived as markers by the camera, introducing a lot of unwanted artefacts. By tuning our MXT40S cameras’ parameters and the reconstruction settings, we were able to solve this issue and collect good data for his study.

Mocap with a medieval armorHere are some clips of the recording session:

 Thanks to Stéphane Armand, Alice Bonnefoy and Daniel’s equerry for their help during the mocap session!

Tags: , ,

artanim participated in the Grand Prix d’Horlogerie de Genève 2011 which rewards the finest watch creations of the year. The ceremony was held at the Grand Théâtre de Genève on Saturday 19th of November 2011. Simply the best Swiss watchmakers were present, as well as the President of the Confederation – Micheline Calmy-Rey – the Director of the United Nations in Geneva and Ambassadors.

Under the theme “Time in the cinema”, artanim created in collaboration with Move for Art a show combining dance and 3D animation, a leap into the future marked by the inevitable epic sci-fi film “Star Wars” created by George Lucas. Darth Vader, the head of the imperial army, was embodied on stage by a dancer (Manuel Vignoulle). Its 3D clone, as well as the imperial troops were projected on big screens behind him and animated by the rhythm of his motion.

The video of the show is available in our portfolio. Check it out!

 

Tags: , , , ,

Vicon camera boxesLast week, Prophysics came to our studio in order to install our Vicon system: 3 MX Giganets, 24 MXT40S cameras!

The first day was dedicated to build the system that came packed into several boxes (see photo on the left). 16 cameras were first attached to the two flexible grids and 8 others were mounted on tripods.

The next day, the Prophysics’s technicians carefully calibrated each camera to obtain the biggest motion capture volume as possible while maintaining high tracking accuracy (see photo below). We finally tested the system intensively with different sizes of markers to ensure its proper setup, and especially to make sure we can precisely capture the smallest eyebrow movements, as well as incredible fast and large range of motion!

Vicon system calibration

Tags: ,