Gesture-based communication techniques can ease video conferencing challenges

Researchers have developed and demonstrated the potential benefit of a simple set of physical gestures that participants in online group video conferencing can use to enhance their meeting experience. Paul D. Hills from University College London, UK, and colleagues from University College London and the University of Exeter, UK, present the technique they call Video Meeting Signals (VMS) in the open access journal PLUS ONE on August 3, 2022.

During the COVID-19 pandemic, online video conferencing has been a useful tool for industry, education, and social interactions. However, it has also been linked to poor mental well-being, poor communication and fatigue.

To overcome the challenges of online video conferencing, Hills developed VMS, a set of simple physical gestures that can be used alongside verbal communication during a video conference. The gestures — including two thumbs up to signal approval, or a hand over the heart to show sympathy — are intended to enhance experiences by serving a similar function to subtle face-to-face signals, such as a smile. B. Raised eyebrows while they are more visible in a small video shot.

To explore the potential of VMS, Hills and colleagues first tested it among more than 100 undergraduate students. After half were trained in the technique, the students participated in two video-based seminars in groups of about 10 students each before answering a survey about their experiences.

Analysis of the survey results showed that those with VMS training reported a better personal experience, better sense of their seminar group and better learning outcomes compared to students without VMS training. Analysis of seminar transcripts also suggested that students with VMS training were more likely to use positive language.

Similar results were observed in a follow-up experiment with non-college participants. This experiment also suggested that participants trained to use emojis instead of VMS gestures did not experience the same improved experience as participants with VMS training.

These results suggest that VMS could be an effective technique to overcome video conferencing challenges. Going forward, the researchers plan to further investigate VMS, for example by investigating the mechanisms underlying its effects and how to use it for maximum benefit.

Paul D. Hills adds, “Our research shows that the use of gestures appears to specifically support online interactions, helping people connect and interact with one another. This can improve team performance, make meetings more inclusive, and improve psych-being.”

Daniel C. Richardson adds, “Because you can’t make eye contact or hear subtle nods, gestures, and murmurs of approval or disapproval in video conferences, it can be difficult to know if people are engaged in what you’re saying. We found strong evidence that encouraging people to use more natural hand gestures had a much better effect on their experience.”