Publications

Immersive AI Companions: Exploring the Design Space of Extended Reality Virtual Companions Through Speculative Design Workshops

Morad Elfleet, Joseph O'Hagan, Mohamed Khamis, Mathieu Chollet
ACM Designing Interactive Systems (DIS'26)
DOI

"I think this is fair": Uncovering the Complexities of Stakeholder Decision-Making in AI Fairness Assessment

Lin Luo, Yuri Nakao, Mathieu Chollet, Hiroya Inakoshi, Simone Stumpf
ACM CHI Conference on Human Factors in Computing Systems (CHI'26)
DOI

A Scenario Generation Framework for Targeting Emotional Vulnerabilities in Virtual Reality First Responder Training

Jeanne Parisse, Domitile Lourdeaux, Mathieu Chollet
18th International Conference on Agents and Artificial Intelligence (ICAART'26)
DOI

Probing Experts' Perspectives on AI-Assisted Public Speaking Training

Mathieu Chollet, Nesrine Fourati, Alisa Barkar, Marion Dragée, Liv Danthon-Lefebvre
European Conference on Technology Enhanced Learning (ECTEL'26)

Beyond Mute and Block: Adoption and Effectiveness of Safety Tools in Social VR, from Ubiquitous Harassment to Social Sculpting

Maheshya Weerasinghe, Shaun Macdonald, Cristina Fiani, Joseph O'Hagan, Mathieu Chollet, Mark McGill, Mohamed Khamis
IEEE Transactions on Visualization and Computer Graphics, 31(5)
DOI

Introducing the 3MT_French dataset to investigate the timing of public speaking judgements

Beatrice Biancardi, Mathieu Chollet, Chloé Clavel
Language Resources and Evaluation, 59(1)
DOI

Robust Understanding of Human-Robot Social Interactions through Multimodal Distillation

Tongfei Bian, Mathieu Chollet, Tanaya Guha
ACM Multimedia (MM'25)
DOI

From Speech and PPG to EDA: Stress Detection Based on Cross-Modal Fine-Tuning of Foundation Models

Alia Ahmed Al Dossary, Mathieu Chollet, Alessandro Vinciarelli
International Conference on Multimodal Interaction (ICMI'25)
DOI

System As A Collaborator (SAAC): a Framework for Modeling, Capturing and Augmenting Collaborative Activities in Extended Reality

Aurélien Léchappé, Aurélien Milliat, Alexandre Kabil, Mathieu Chollet, Cédric Dumas
IEEE International Conference on Automation Science and Engineering (CASE'25)
DOI

How to Categorize Collaboration During a Collaborative Puzzle-solving Task? Validation of Collaboration Profiles Using Multimodal Data in Virtual Reality Context

Aurélien Léchappé, Cédric Fleury, Mathieu Chollet, Cédric Dumas
Proceedings of the ACM on Human-Computer Interaction (CSCW'25)
DOI

EARN Fairness: Explaining, Asking, Reviewing, and Negotiating Artificial Intelligence Fairness Metrics Among Stakeholders

Lin Luo, Yuri Nakao, Mathieu Chollet, Hiroya Inakoshi, Simone Stumpf
Proceedings of the ACM on Human-Computer Interaction (CSCW'25)
DOI

Interact with Me: Joint Egocentric Forecasting of Intent to Interact, Attitude and Social Actions

Tongfei Bian, Yiming Ma, Mathieu Chollet, Victor Sanchez, Tanaya Guha
IEEE International Conference on Multimedia & Expo (ICME'25)
DOI

Understanding Social Interactions in Reality Versus Virtuality

Aurélien Léchappé, Ross Johnstone, Aurélien Milliat, John H. Williamson, Mathieu Chollet, Julie R. Williamson
ACM SIGCHI Conference on Human Factors in Computing Systems (CHI'25)
DOI

Decoding Persuasiveness in Eloquence Competitions: An Investigation into the LLM's Ability to Assess Public Speaking

Alisa Barkar, Mathieu Chollet, Matthieu Labeau, Beatrice Biancardi, Chloé Clavel
International Conference on Agents and Artificial Intelligence (ICAART'25)
DOI

Automatic Detection of Public Speaking Anxiety Through Linguistic Analysis

Maram AlMutairi, Mathieu Chollet
SGAI International Conference on Artificial Intelligence (SGAI'25)
DOI

Modeling Fatigue in Manual and Robot-Assisted Work for Operator 5.0

Arnaud Allemang-Trivalle, Jérémie Donjat, Gaëlic Bechu, Gilles Coppin, Mathieu Chollet, Oliver W. Klaproth, Andreas Mitschke, Arnd Schirrmann, Caroline G.L. Cao
IISE Transactions on Occupational Ergonomics and Human Factors, 12(1-2)
DOI

Investigating the Impact of Multimodal Feedback on User-Perceived Latency and Immersion with LLM-Powered Embodied Conversational Agents in Virtual Reality

Morad Elfleet, Mathieu Chollet
ACM International Conference on Intelligent Virtual Agents (IVA'24)
DOI

You're Hired! Effect of Virtual Agents' Social Status and Social Attitudes on Stress Induction in Virtual Job Interviews

Celia Kessassi, Cédric Dumas, Caroline G.L. Cao, Mathieu Chollet
IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR'24)
DOI

Insights Into the Importance of Linguistic Textual Features on the Persuasiveness of Public Speaking

Alisa Barkar, Mathieu Chollet, Beatrice Biancardi, Chloé Clavel
ACM International Conference on Multimodal Interaction (ICMI'23)
DOI

Characterization of Collaboration in a Virtual Environment with Gaze and Speech Signal

Aurélien Léchappé, Aurélien Milliat, Cédric Fleury, Mathieu Chollet, Cédric Dumas
ACM International Conference on Multimodal Interaction (ICMI'23)
DOI

Human Model For Industrial System And Product Design In Industry 5.0: A Case Study

Arnaud Allemang-Trivalle, Jérémie Donjat, Gaëlic Béchu, Gilles Coppin, Oliver W. Klaproth, Andreas Mitschke, Arnd Schirrmann, Mathieu Chollet, Caroline G.L. Cao
IISE Annual Conference and Expo (IISE'23)

Social Presence Mediates Audience Behavior Effects on Social Stress in Virtual Public Speaking

Celia Kessassi, Mathieu Chollet, Cédric Dumas, Caroline G.L. Cao
IEEE International Conference on Affective Computing and Intelligent Interaction (ACII'23)
DOI

It's not Just What You Do but also When You Do It: Novel Perspectives for Informing Interactive Public Speaking Training

Beatrice Biancardi, Yingjie Duan, Mathieu Chollet, Chloé Clavel
International Conference on Computer Vision Theory and Applications (HUCAPP'23)
DOI

Using Multimodal Data to Predict Surgeon Situation Awareness

Aurélien Léchappé, Mathieu Chollet, Jérôme Rigaud, Caroline G.L. Cao
21st Congress of the International Ergonomics Association (IEA'21)
DOI

Training public speaking with virtual social interactions: effectiveness of real-time feedback and delayed feedback

Social signal processing and virtual social interaction technologies have allowed the creation of social skills training applications, …
DOI

Investigating the Influence of Sound Design for Inducing Anxiety in Virtual Public Speaking

Virtual reality has demonstrated successful outcomes for treating social anxiety disorders, or helping to improve social skills. Some …
DOI

Assessment of Situation Awareness during Robotic Surgery using Multimodal Data

The use of robotic surgical systems disrupts existing team dynamics inside operating rooms and constitutes a major challenge for the …
DOI

Etude de l'influence du comportement d'un public virtuel sur le stress ressenti lors de prises de paroles simulées

Des agents virtuels peuvent être utilisés pour recréer des situations de prise de parole en public simulées devant un public virtuel. …
PDF

Vers un système de production de feedbacks personnalisé pour l'entraînement de la prise de parole en public

Motivés par le besoin de former les collaborateurs d’entreprises du secteur industriel, nous présentons un système de production de …
PDF

Multiple metaphors in metaphoric gesturing

The use of metaphoric gestures by speakers has long been known to influence thought in the viewer. What is less clear is the extent to …

Towards Narrative-Driven Atmosphere for Virtual Classroom

We propose the integration of interactive narrative techniques for audience atmosphere generation in Virtual Reality (VR) training …

A Scalability Benchmark for a Virtual Audience Perception Model in Virtual Reality

In this paper, we describe the implementation and performance of a Virtual Audience perception model for Virtual Reality (VR). The …
DOI

NADIA - Neural network driven virtual human conversation agents

Advances in artificial intelligence and in particular machine learning and neural networks have given rise to a new generation of …
DOI

Influence of individual differences when training public speaking with virtual audiences

Multimodal interaction technologies have enabled new applications for training interpersonal skills such as public speaking. Various …
Project DOI

NADiA - Towards neural network driven virtual human conversation agents

Advances in artificial intelligence and machine learning - in particular neural networks - have given rise to a new generation of …
PDF

A generic platform for training social skills with adaptative virtual agents

We present a versatile system for training social skills with interactive virtual agents reacting to the user’s automatically …
PDF Project

The relationship between task-induced stress, vocal changes, and physiological state during a dyadic team task

It is commonly known that a relationship exists between the human voice and various emotional states. Past studies have demonstrated …
DOI

A Methodology for the Automatic Extraction and Generation of Non-Verbal Signals Sequences Conveying Interpersonal Attitudes

IEEE In many applications, Embodied Conversational Agents (ECAs) must be able to express various affects such as emotions or social …
Project DOI

Perception of virtual audiences

A growing body of evidence shows that virtual audiences are a valuable tool in the treatment of social anxiety, and recent works show …
Project DOI

Racing heart and sweaty palms: What influences users' self-assessments and physiological signals when interacting with virtual audiences?

In psychotherapy, virtual audiences have been shown to promote successful outcomes when used to help treating public speaking anxiety. …
Project DOI

Assessing Public Speaking Ability from Thin Slices of Behavior

An important aspect of public speaking is delivery, which consists of the appropriate use of non-verbal cues to strengthen the message. …
Project DOI

Affect-LM: A neural language model for customizable affective text generation

Human verbal communication includes affective messages which are conveyed through use of emotionally colored words. There has been a …
PDF DOI

Native vs. Non-native language fluency implications on multimodal interaction for interpersonal skills training

New technological developments in the field of multimodal interaction show great promise for the improvement and assessment of public …
Project DOI

Emotion and Attitude Modeling for Non-player Characters

Within this chapter, we are presenting how game developers could take inspiration from the research in Embodied Conversational Agent to …
DOI

Manipulating the perception of virtual audiences using crowdsourced behaviors

Virtual audiences are used for training public speaking and mitigating anxiety related to it. However, research has been scarce on …
Project DOI

An architecture for biologically grounded real-time reflexive behavior

In this paper, we present a reflexive behavior architecture, that is geared towards the application in the control of the non-verbal …
DOI

Investigating the Physiological Responses to Virtual Audience Behavioral Changes

Virtual audiences have been used in psychotherapy for the treatment of public speaking anxiety, and recent studies show promising …
PDF Project

A multimodal corpus for the assessment of public speaking ability and anxiety

The ability to efficiently speak in public is an essential asset for many professions and is used in everyday life. As such, tools …
PDF Project

Public speaking training with a multimodal interactive virtual audience framework

We have developed an interactive virtual audience platform for public speaking training. Users' public speaking behavior is …
Project DOI

Multimodal public speaking performance assessment

The ability to speak proficiently in public is essential for many professions and in everyday life. Public speaking skills are …
Project DOI

Vers des Agents Conversationnels Animés dotés d'émotions et d'attitudes sociales

In this article, we propose an architecture of a socio-affective Embodied Conversational Agent (ECA). The different computational …
PDF

Exploring feedback strategies to improve public speaking: An interactive virtual audience framework

Good public speaking skills convey strong and effective communication, which is critical in many professions and used in everyday life. …
Project DOI

Towards a socially adaptive virtual agent

This paper presents a socially adaptive virtual agent that can adapt its behaviour according to social constructs (e.g. attitude, …
Project DOI

Agents Conversationnels Animés pour l’entrainement social : modèle computationnel de l’expression d’attitudes sociales par des séquences de signaux non-verbaux

The Embodied Conversational Agents (ECAs) used in social training must be able to simulate all the different social situations that a …
PDF Project

An architecture for a socially adaptive virtual recruiter in job interview simulations

Project

Suggestions for extending saiba with the vib platform

PDF DOI

From non-verbal signals sequence mining to bayesian networks for interpersonal attitudes expression

In this paper, we present a model and its evaluation for expressing attitudes through sequences of non-verbal signals for Embodied …
Project DOI

Expressing social attitudes in virtual agents for social coaching

The use of virtual agents in social coaching has increased rapidly in the last decade. In social coaching, the virtual agent should be …
PDF Project

Mining a multimodal corpus for non-verbal signals sequences conveying attitudes

Interpersonal attitudes are expressed by non-verbal behaviors on a variety of different modalities. The perception of these behaviors …
PDF Project

Expressing social attitudes in virtual agents for social coaching

This paper presents a model of social attitudes for reasoning about the appropriate attitude to express during an interaction. It …
PDF Project

An interactive virtual audience platform for public speaking training

We have developed an interactive virtual audience platform for public speaking training. Users' public speaking behavior is …
PDF Project

Expressing social attitudes in virtual agents for social training games

The use of virtual agents in social coaching has increased rapidly in the last decade. In order to train the user in different …
PDF Project

Investigating Non-Verbal Behaviors Conveying Interpersonal Stances

The study of the expression of affects and their expression by Embodied Conversational Agents is complex. This is because affects are …
PDF Project

A multimodal corpus for the study of non-verbal behavior expressing interpersonal stances

PDF Project

Vers des agents conversationnels animés socio-affectifs

Dans cet article, nous proposons une architecture d’un Agent Conversationnel Animé (ACA) socio-affectif. Les différents …
DOI

The TARDIS framework: Intelligent virtual agents for social coaching in job interviews

The TARDIS project aims to build a scenario-based serious-game simulation platform for NEETs and job-inclusion associations that …
Project DOI

A multimodal corpus approach to the design of virtual recruiters

This paper presents the analysis of the multimodal behavior of experienced practitioners of job interview coaching, and describes a …
Project DOI

Interpersonal stance recognition using non-verbal signals on several time windows

We present a computational model for interpreting nonverbal signals of a user during an interaction with a virtual character in order …
PDF

Computational model of film editing for interactive storytelling

Generating interactive narratives as movies requires knowledge in cinematography (camera placement, framing, lighting) and film editing …
Project DOI

A virtual cinematography system that learns from examples

The production of movies requires knowledge in cinematography, in particular on techniques such as framing, camera placement and …
PDF Project

Automated Camera Planner for Film Editing Using Key Shots

Generating films from 3D animations requires knowledge in cinematography (camera placement, framing and lighting) and editing (cutting …
PDF Project