HumanE-AI-net-Information

Humane AI Net Microproject on
Multimodal Perception and Interaction with Transformers

Participants:

INRIA - James Crowley and Yangtao Wang
Eotvos Lorand University (ELTE) - Andras Lorincz
Univ Grenoble Alpes, (LIG) - Dominique Vaufreydaz, Fabien Ringeval
Univ Paris Saclay (LISN CNRS) - Camille Guinaudeau, Marc Evrard, Francois Yvon
Jozef Stefan Institut (JSI) - Marko Grobelnik
Charles University - Pavel Pecina

Dates:

1 April 2021 - 30 Sept 2021

Objective:

Explore the potential of transformers for multimodal perception and interaction to support Humane AI

2-Minute Video presentation (Oct 2021)

Earlier 2-Minute Video Summary Presentation (10 March 2021)

Microproject Results

Tutorial On Transformers
Research Challenges and Data Sets
Tools for Research on Multimodal Perception with Transformers

Technical Meetings

10 May 2021 - Tutorial Review of Transformers

Tutorial Presentation on Transformers by Francois Yvon (Recording) (Slides)

25 May 2021 - Applications of Transformers to Spoken Language and Computer Vision

Quick review of Transformers by Francois Yvon (Recording) (Slides)
Use for Spoken language Processing by Marc Evrard (Recording) (Slides)
Use for Spoken language Processing by Fabien Ringeval (Recording) (Slides)
Intro to Use for Computer Vision by Camille Guinaudeau (Slides)
Use for Computer Vision by Yangtao Wang (Recording) (Slides)