Inferring Emotional Models from Human-Machine Speech Interactions

1 minute read

Conference Lelio Campanile, Roberta Fazio, Michele Di Giovanni, Stefano Marrone, Fiammetta Marulli, Laura Verde — 2023 · Procedia Computer Science

Venue & metadata

Journal/Proceedings: Procedia Computer Science
Volume: 225
Pages: 1241 – 1250
Note: Cited by: 1; All Open Access, Gold Open Access
Author keywords: Emotional State Inference; Human Digital Twin; Human Machine Interaction; Process Mining; Speech Analysis

Abstract

Human-Machine Interfaces (HMIs) are getting more and more important in a hyper-connected society. Traditional HMIs are built considering cognitive features while emotional ones are often neglected, bringing sometimes such interfaces to misuse. As a part of a long run research, oriented to the definition of an HMI engineering approach, this paper concretely proposes a method to build an emotional-aware explicit model of the user starting from the behaviour of the human with a virtual agent. The paper also proposes an instance of this model inference process in voice assistants in an automatic depression context, which can constitute the core phase to realize a Human Digital Twin of a patient. The case study generated a model composed of Fluid Stochastic Petri Net sub-models, achieved after the data analysis by a Support Vector Machine. © 2023 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (https://creativecommons.org/licenses/by-nc-nd/4.0)

Keywords

Behavioral research Emotion Recognition Man machine systems Petri nets Stochastic models Stochastic systems Virtual reality Emotional models Emotional state Emotional state inference Human digital twin Human machine interaction Human Machine Interface Human-machine Longest run Process mining Speech interaction Support vector machines

Links & artifacts

DOI Publisher

@conference{Campanile20231241,
  author = {Campanile, Lelio and de Fazio, Roberta and Di Giovanni, Michele and Marrone, Stefano and Marulli, Fiammetta and Verde, Laura},
  title = {Inferring Emotional Models from Human-Machine Speech Interactions},
  year = {2023},
  journal = {Procedia Computer Science},
  volume = {225},
  pages = {1241 – 1250},
  doi = {10.1016/j.procs.2023.10.112}
}

Suggested citation

Campanile, L., de Fazio, R., Di Giovanni, M., Marrone, S., Marulli, F., & Verde, L. (2023). Inferring Emotional Models from Human-Machine Speech Interactions [Conference paper]. Procedia Computer Science, 225, 1241–1250. https://doi.org/10.1016/j.procs.2023.10.112

← Back to Publications