The Uncanny Effect of Speech: The Impact of Appearance and Speaking on Impression Formation in Human–Robot Interactions
Project Period: 2022-2023
Abstract
This study explores the impact of appearance and speech on human perceptions of faces in human-robot interactions. Three videos were generated depicting the real face of an artist and two virtual versions of the same artist, with increasing resolution and fidelity. Each video was presented with and without speech, with matching levels of fidelity to the faces (real human speech and machine-generated speech of two levels of realism). Participants viewed all six videos and rated them on measures such as convincing, trustworthy, realistic, likable, showed biological movement, reassuring, friendly, familiar, and humanness. We found that the inclusion of speech (real) had a significant positive impact on the impression formation of real human appearance. In contrast, perceptions of the virtual avatars were more negative when speech (machine-like) was incorporated. This study illustrates the differential effects that speech can have on virtual faces in interactive settings.
Study Period: 2022-2023
Team Members: Janie Busby Grant; Damith Herath; Neelu Gurung
Publication
Gurung, N, Busby Grant, J & Herath, D 2023, ‘The Uncanny Effect of Speech: the Impact of Appearance and Speaking on Impression Formation in Human–Robot Interactions’, International Journal of Social Robotics, pp. 1-16. https://doi.org/10.1007/s12369-023-00976-4
https://link.springer.com/article/10.1007/s12369-023-00976-4
Janie Busby Grant
Psychology Research Lead
Associate Professor Janie Busby Grant is the Psychology Research Lead at CRL, where her work integrates human-robot interaction and artificial intelligence with a foundation in cognitive psychology and research design. With a strong emphasis on practical applications, Janie brings a reconciliatory approach to interdisciplinary research, particularly in exploring factors influencing human perception of, and engagement with robotic systems.
Damith Herath
Founder/Lead Collaborative Robotics Lab
Professor Damith Herath is the Founder and leader of the Collaborative Robotics Lab (CRL). His work focuses on exploring how robots and humans can collaborate, with an emphasis on the intersection of engineering, psychology, and the arts. His interdisciplinary approach actively seeks insights across diverse fields, promoting innovation and collaboration that transcends traditional disciplinary boundaries.