FAST (Facial Analysis Synthesis & Tracking) Team

In the area of Affective Computing, we analyze, synthesize and track emotions. We develop tools drawn from Artificial Intelligence (Auto-encoders and GANs) applied to the fields of image, voice and text.
Real time expression tracking in the emotion space

Keywords

KeyWords: Emotion analysis, Image Analysis, Audio Analysis, Text Analysis, Variational Auto-encoders, GANs, Mental Images, Mental Load, Mental Image, Stress analysis, Micro-expression spotting and analysis

Introduction

The team offers a new way of representing emotions that makes it possible to follow a person's emotional state over time. This real-time analysis of a user's emotions is multimodal: it exploits the voice, speech, context, gesture and facial expressions. Current work focuses on stress detection and micro-expressions spotting and analysis in a medical context. The tools developed come from Deep Learning mainly: GAN, VAE, CNN and auto-encoders mainly. The research work of the FAST team has been enhanced through the creation of three startups : Dynamixyz (Performance Capture), 3D Sound Labs (Binaural Reproduction) and Immersive Therapy (Tinnitus App.).

Highlights

2019 First place during the Micro-Expression Grand Challenge (IEEE Automatic Face&Gesture Recognition FG 2019) for Jingting Li (PhD student 2019)

2016 Fourth place during the Depression Challenge (International Workshop on Audio/Visual Emotion Challenge AVEC2016) for Raphaël Weber (PhD student 2016).

2016 Honorable Mention at Eurographics 2016 as part of the Günter Enderle Award for the paper for Vincent Barrielle (PhD student 2016).

Research Projects

EUR DIGISPORT

Écoles Universitaires de Recherche Digital Sport Sciences

Digisport's objective is to create an international graduate school, unique of its kind, in the field of training and research in sports and digital sciences. Dedicated chairs will host recognized international researchers who will work with students, especially at summer schools.

Leader: Benoit Bideau

Partners: Rennes Universities I&II, ENS Rennes, INSA Rennes, CentraleSupélec, ENSAI, CNRS joint laboratories (IRISA, IETR, IRMAR, CREST)

 

SPLASH3D

Brittany Region collaborative project "Au Croisement des Filières"  2020-2022

This project seeks to offer a virtual reality experience to customers of water parks. Equipped with a 100% waterproof Virtual Reality headset, the visitor takes place aboard a buoy and embarks on an adventure where real and virtual mixes.

Leader: Polymorph

Partners: Cimtech, CentraleSupélec

 

REFLETS

National Collaborative Generic Project ANR 2018-2021

Project REFLETS aims to address this situation head-on, by building novel health technology able to channel the psychological mechanism of facial and vocal emotional feedback for clinical application to post-traumatic stress disorders (PTSD) as well as well-being applications in the general population.

Leader: CentraleSupélec

Partners: IRCAM, Dynamixyz, HumanEvo, Chanel, CognacG

 

#IA RANDSTAD CHAIR

Teaching and Research Chair 2018-2023

Supported by Céline Hudelot, this chair aims to put artificial intelligence at the service of recruitment. It addresses three challenges relating to the world of work: 1 / represent the candidate in a more complete and precise manner, 2 / design and optimize the matching between candidate and offer with an issue of algorithmic non-discrimination, and 3 / analyze the emotions and in particular the stress of the candidate to help him to present himself better in front of a video camera. The FAST team is responsible for this third area of work.

Leader: Céline Hudelot (MICS team)

Partners: Randstad, Illuin Technology, CentraleSupélec

 

AWAKE SURGERY

Fondation de l'Avenir 2019-2020

Localization during an operation of the neurons invested in emotions analysis. With Dynamixyz tools,  FAST team produces animations of expressive faces and analyzes in real time the direction of the patient's gaze when viewing animations in a virtual reality headset.

Leader: Professor Menei (CHU Angers)

Partners: CentraleSupélec