Healthc Inform Res Search

CLOSE


Healthc Inform Res > Volume 29(2); 2023 > Article
Yoo, Kong, Joo, Choi, Kim, Lee, and Hong: User Experience of Augmented Reality Glasses-based Tele-Exercise in Elderly Women

Abstract

Objectives

The purpose of this study was to identify any difference in user experience between tablet- and augmented reality (AR) glasses-based tele-exercise programs in elderly women.

Methods

Participants in the AR group (n = 14) connected Nreal glasses with smartphones to display a pre-recorded exercise program, while each member of the tablet group (n = 13) participated in the same exercise program using an all-in-one personal computer. The program included sitting or standing on a chair, bare-handed calisthenics, and muscle strengthening using an elastic band. The exercise movements were presented first for the upper and then the lower extremities, and the total exercise time was 40 minutes (5 minutes of warm-up exercises, 30 minutes of main exercises, and 5 minutes of cool-down exercises). To evaluate the user experience, a questionnaire consisting of a 7-point Likert scale was used as a measurement tool. In addition, the Wilcoxon rank-sum test was used to assess differences between the two groups.

Results

Of the six user experience scales, attractiveness (p = 0.114), stimulation (p = 0.534), and novelty (p = 0.916) did not differ significantly between the groups. However, efficiency (p = 0.006), perspicuity (p = 0.008), and dependability (p = 0.049) did vary significantly between groups.

Conclusions

When developing an AR glasses-based exercise program for the elderly, the efficiency, clarity, and stability of the program must be considered to meet the participants’ needs.

I. Introduction

Augmented reality (AR) technology is undergoing rapid development and application, particularly in fields such as surgery and medical education [1]. AR refers to the real-time interaction between real space, virtual data space, and objects, with actual and digital information combined within the user’s field of vision; as such, the technology can present digital information that is difficult for users to detect or utilize in the real world [2].
Exercise video content has become accessible and affordable through YouTube, smartphone applications, and other platforms. Consequently, increasing numbers of people watch and follow exercise content in their living spaces. In addition, the use of wearable health-monitoring devices in conjunction with smartphones has promoted a steady increase in the number of people utilizing self-exercise management services based on mobile apps or internet websites [3,4]. As interest in AR-based exercise increases, studies have demonstrated associated improvements in muscle strength, joint mobility, exercise speed, and control [5]. The safe application of AR technology in elderly individuals can be facilitated by considering ways of improving AR technology to reduce content-related inconvenience; changing the user’s head rotation, viewing angle, and head rotation speed; and understanding correlations between camera movement and user discomfort with regard to content, screen elements, and vertical synchronization [6,7].
For elderly individuals, exercise is necessary to improve physical fitness and prevent disease [8]. Traditionally, elderly people exercise primarily through group and face-to-face interactions, at locations such as senior centers or cultural centers. However, since the coronavirus disease 2019 (COVID-19) pandemic began, various non-face-to-face methods based on information and communications technology have been introduced for exercising within living spaces [9,10]. In addition, remote exercise programs based on tablet videoconferencing have been associated with improvements in bone flexibility and muscle mass, as well as reductions in muscle atrophy and fall risk factors in elderly women [11]. Interest in AR-based exercise interventions has also increased, and studies have revealed positive effects on patients with stroke and Parkinson disease [12,13].
User experience (UX) encompasses the psychological and emotional responses of users based on their experiences using a product. UX reflects various aspects of human reactions, such as the visual and auditory senses as well as responses to external stimuli when using the product [14,15]. International Organization for Standardization (ISO) 9241-210, an international standard for human-computer interaction within human-system ergonomics, defines UX as “a person’s perceptions and responses that result from the use or anticipated use of a product, system, or service.” Under the ISO definition, UX includes all emotions, beliefs, preferences, perceptions, physical and psychological responses, behaviors, and achievements of users that occur before, during, and after product use. Thus, UX refers to the holistic physical, emotional, mental, and psychological experience of users during the entire process of using a product or service [16].
In today’s rapidly changing digital environment, older adults can struggle to learn to use digital devices and often lack experience in using them unaided. Relatedly, insufficient research has been conducted on UX among the older population. Hence, to utilize information technology among older adults, we must reflect on the feelings of these individuals regarding system use. By examining UX among older adults, we can understand their interest in using a certain service and consequently develop elderly-friendly services. This can help increase older adults’ user satisfaction by reducing the discomfort associated with usage. Moreover, elder-friendly services can serve as a driving force for these adults to enjoy exercise for long periods using information technology. Therefore, this study was conducted to investigate the UX among older adults using AR glasses in remote exercise programs. We suggest a direction for development of an AR glasses-based exercise program optimized for the requirements and technical skills of older users.

II. Methods

1. Participants

This study included 27 elderly women (76.40 ± 4.02 years old) residing in Incheon, Republic of Korea who reported having no exercise experience in the prior month and who consented to participate. Both the tablet group (13 participants) and the AR glasses group (14 participants) included individuals who had no issues with the Physical Activity Readiness Questionnaire and who could perform the exercises. Participants with cognitive impairment, as indicated by a score of 21 or lower on the Korean version of the Mini-Mental State Examination, were excluded. Additionally, participants with orthopedic problems, those with hearing or visual impairments, and those unable to communicate or follow instructions were excluded. This study was approved by the Institutional Review Board of Seoul National University Hospital (No. C-2012-139-1183).

2. Procedure

Before the study began, an assistant researcher visited the residential spaces of the participants and provided them with tablets, AR glasses (Nreal; Matrix Reality Technology Co. Ltd., Beijing, China), chairs, mats, and elastic bands. The participants were given instructions on how to use the tablet and how to connect it and the AR glasses to a smartphone (LG V50S ThinQ; LG, Seoul, Korea). They were also taught to operate the AR equipment. While watching a pre-recorded video on their tablets and glasses, the participants followed along with exercises demonstrated by an exercise instructor. The instructor could observe exercise movements through the camera built into each participant’s tablet and provide real-time feedback. In addition, the assistant researcher remained in the same space as the participants to ensure participants’ safety during exercise. A usability evaluation questionnaire was completed by participants in a 1:1 ratio with a research assistant after the exercise program.

3. Tele-Exercise Program

In this study, the operating system developed by Hong et al. [11] for a WebRTC server was used (Figure 1). Both the exercise instructor and the participants accessed the server through WebRTC and followed the same exercise program. The program was based on the exercise program recommended for elderly adults by the American College of Sports Medicine and consisted of muscle strengthening exercises that included sitting or standing on a chair [17], bare-handed calisthenics, and muscle strengthening using an elastic band (TheraBand; The Hygenic Corp., Akron, OH, USA). The exercise movements were presented first for the upper and then the lower extremities, and the total exercise time was 40 minutes (5 minutes of warm-up exercise, 30 minutes of main exercise, and 5 minutes of cool-down exercise). The exercise intensity was set at 14–15 on the Borg Rating of perceived exertion scale [18]. The instructor was an experienced exercise physiologist who provided real-time feedback to both groups.

4. Measuring Tool

The measurement tool used in this study was the User Experience Questionnaire (UEQ) [19], which includes six scales: attractiveness, efficiency, perspicuity, dependability, stimulation, and novelty. It comprises 26 survey questions rated on a 7-point Likert scale [20]. The attractiveness scale consisted of six items relating to the product’s attractiveness, enjoyability, friendliness, and good feelings elicited from the participants. The efficiency scale included four items concerned with how fast, scientific, and practical the product was. Perspicuity was measured by four items regarding whether the product was easy to understand, clear, simple, and easy to learn. Dependability was measured by four items, related to predictability, safety, and whether the product met expectations. The stimulation scale consisted of four items concerned with whether the product was interesting and motivated use. The novelty scale included four items asking whether the product was innovative and creatively designed.

5. Statistical Analyses

Validity and reliability tests were conducted for the six scales of the UEQ measurement tool. A factor analysis was performed to ensure validity, and the Cronbach α was calculated to verify reliability. In addition, data were analyzed using the Wilcoxon rank-sum test to compare the measurement items between the tablet and AR glasses groups. The UEQ scores were converted to a scale of 0 to 100 using the formula: Itemscore-16×100
All statistical analyses were performed using SAS 9.4 (SAS Institute Inc., Cary, NC, USA).

III. Results

1. Feasibility

To ensure the validity of the six scales of the UEQ measurement tool, the characteristics of each were derived after factor analysis using varimax rotation. In this method, based on the factor analysis, the questionnaire items corresponding to each of the six scales were classified into factors. Attractiveness was assessed using three factors among the six items: item #16 (pleasant), #24 (attractive), and #25 (friendly). Efficiency was assessed using two of its four items: #20 (efficient) and #22 (practical). Perspicuity was assessed using two of its four items: #2 (understandable) and #21 (clear). Dependability and stimulation were found to have a single factor including all four questions. Finally, among the four questions for novelty, item #3 (creative) and #15 (advanced) were selected (Table 1).

2. Reliability

The reliability of the six scales was high (0.690–0.882). The reliability results for the UEQ are attractiveness, 0.882; efficiency, 0.690; perspicuity, 0.741; dependability, 0.760; stimulation, 0.823; and novelty, 0.819 (Table 2).

3. Comparison between Groups

Of the six UX scales, attractiveness (p = 0.114), stimulation (p = 0.534), and novelty (p = 0.916) did not differ significantly between the groups. However, efficiency (p = 0.006), perspicuity (p = 0.008), and dependability (p = 0.049) differed significantly between the groups (Table 3).

IV. Discussion

The purpose of this study was to identify any difference in UX between tablet- and AR glasses-based tele-exercise programs administered to elderly participants.
Among the six UEQ scales, no significant differences were found between groups in attractiveness, stimulation, and novelty; however, significant differences were observed in efficiency, perspicuity, and dependability.
Attractiveness refers to the ease of understanding the functionality and operation of a product. Personal tastes and preferences influence the attractiveness of a product’s design, color, layout, and graphics [15]. In this study, no significant differences were observed in attractiveness between the two groups. Both groups showed relatively high scores, indicating a friendly and positive impression on elderly individuals accustomed to monitor-type screens, such as tablets or smartphones [20].
Stimulation refers to interest in using a product or service. This is related to user satisfaction with the product and is influenced by user motivation and interest [15]. Researchers can assess whether the visual and auditory feedback and interactions provided by a product affect the level of personalization. In this study, no significant difference was found between groups in the stimulation items, and both groups had relatively high scores. In addition, the elderly participants did not perceive either method of presenting visual stimuli (the tablet and the AR glasses) as boring or predictable. Both methods appear to motivate exercise.
Novelty is the degree to which a product or system can stimulate user interest due to its uniqueness and originality [19]. It can include both visual and functional aspects of a product, such as design, functionality, and the user interface. In this study, no significant difference was observed between the two groups in novelty, and both groups had relatively high scores. For both methods in this study, participants reported feeling novelty and creativity due to receiving real-time feedback on their movements, even though the exercise instructor was not actually in front of them. Although statistically insignificant, the novelty score was slightly higher in the AR group than in the tablet group. The large screen and wide field of view shown in the AR glasses allowed greater focus on the exercise image, even as it moved up, down, left, and right during the exercise. Thus, visual enhancement contributed to the interest of the elderly participants.
Efficiency refers to the practicality and efficiency of a product’s interaction with a system, thus indicating the ease with which a task can be completed using a product or service [15]. In this study, the tablet group displayed high efficiency, suggesting that familiarity with operating a smartphone or television screen influenced the speed of operation of the tablet system. Moreover, when the elderly participants wearing AR glasses exercised, the wires, earphones, and vests worn when connected to the smartphone felt uncomfortable and impractical. Therefore, these aspects require improvement when interventions using AR glasses are applied to the elderly.
Perspicuity indicates whether a user can clearly understand a product or system. This includes aspects such as the clarity of instructions, ease of navigation, and simplicity throughout the design [19]. The results were superior in the tablet group, indicating that the operation was clearly understood and could be performed easily when the elderly individuals used the tablet product. In this study, in the AR group, the process of connecting the glasses to a smartphone and accessing the smartphone program to play the video was more difficult than in the tablet group, confusing the elderly participants and resulting in a lower score in this category. Therefore, when applying interventions using AR glasses to elderly people, the system should be simple and easy to learn.
Dependability refers to whether products and services meet expectations and/or are stable. The more stable a product, the greater the likelihood of repeat use [19]. The results differed significantly between the groups and were higher in the tablet group; as mentioned above, various auxiliary equipment (earphones, earphones, wires, etc.) are thought to have interfered with the exercise. We believe that these issues contributed to system instability, and thus, the system failed to meet the expectations of the elderly individuals using AR glasses for the first time. Exercise is essential for elderly people, but as they age, factors such as rapid declines in physical ability, sensory function, and cognitive function hinder continued participation in exercise. In this regard, an exercise program based on AR glasses is a tool that could motivate elderly adults to continue exercising. AR-based exercise can increase interest and visual diversity, providing ongoing motivation. In addition, the software in AR glasses enables the recording, monitoring, and personalized coaching of daily exercise habits and movements, reducing the risk of injury and providing a safe exercise environment.
In the future, AR-based exercise programs should be researched not only for the elderly but also for other sex- and age-based demographics.
The limitations of this study are as follows. First, the sample size was too small to generalize the results. In particular, a nonparametric test was performed because of the small sample size. However, this is less reliable than parametric testing, and future studies will require larger numbers of participants. Second, we investigated the UX by conducting a one-time exercise program using AR glasses and a tablet; however, more reliable results may be obtained in the future if the UX is investigated over a longer period of use.
In conclusion, when developing an AR glasses-based exercise program for the elderly, the efficiency, clarity, and stability of the program must be considered to meet the needs of the participants.

Notes

Conflict of Interest

Hyoun-Joong Kong is an editorial member of Healthcare Informatics Research; however, he did not involve in the peer reviewer selection, evaluation, and decision process of this article. Otherwise, no potential conflict of interest relevant to this article was reported.

Acknowledgments

This study was supported by the Ministry of Education of the Republic of Korea and the National Research Foundation of Korea (No. NRF-2020S1A5B5A01043804) and the Institute of Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No. 2021-0-00312, Development of non-face-to face patient infection activity prediction and protection management SW technology in home and community treatment center for effective response to infectious disease).

Figure 1
(A) Tablet personal computer-based exercise and (B) augmented reality glasses-based exercise.
hir-2023-29-2-161f1.jpg
Table 1
Validity analysis of the User Experience Questionnaire (UEQ)
UEQ scale Item No. Factor 1 Factor 2 Question Inverse transformation
Attractiveness 24 0.948 −0.081 attractive ↔ unattractive inversion o
25 0.854 0.241 friendly ↔ unfriendly reverse conversion o
16 0.764 0.586 unpleasant ↔ pleasant
12 0.537 0.757 good ↔ bad inverse transformation o
14 0.312 0.737 I don’ like ↔ I feel good
1 −0.133 0.692 annoying ↔ enjoyable

Efficiency 20 0.862 0.161 inefficient ↔ efficient
22 0.814 −0.095 impractical ↔ practical
23 0.216 0.859 textured ↔ not textured o
9 −0.432 0.551 fast ↔ slow

Perspicuity 4 0.943 0.133 easy to learn ↔ hard to learn o
13 0.936 0.161 complex ↔ easy
2 0.086 0.895 I don’t understand ↔ I can understand
21 0.195 0.865 clear ↔ confusing o

Dependability 11 0.956 - hinders ↔ helps
19 0.906 - meets expectations ↔ does not meet expectations o
17 0.599 - stable ↔ unstable o
8 0.575 - not interesting ↔ interesting

Stimulation 6 0.930 - boring ↔ exciting
7 0.869 - unpredictable ↔ predictable
5 0.748 - worthy ↔ inferior o
18 0.681 - motivating ↔ does not motivate o

Novelty 15 0.916 0.083 common ↔ leading the way
3 0.912 0.128 creative ↔ boring o
26 0.057 0.819 conservative ↔ innovative
10 0.131 0.797 innovative ↔ ordinary o
Table 2
Reliability of measurement questions
UEQ scale Cronbach α
Attractiveness 0.882
Efficiency 0.690
Perspicuity 0.741
Dependability 0.760
Stimulation 0.823
Novelty 0.819

UEQ: User Experience Questionnaire.

Table 3
Differences in user experience scores between groups
UEQ scale Total (n = 27) Tablet (n = 13) AR (n = 14) p-value
Attractiveness 94.44 (61.11–100) 94.44 (94.44–100) 80.56 (50.00–100) 0.114
Efficiency 83.33 (75.00–100) 100 (83.33–100) 79.17 (66.67–83.33) 0.006*
Perspicuity 100 (66.67–100) 100 (100–100) 91.67 (50.00–100) 0.008*
Dependability 91.67 (75.00–100) 95.83 (87.50–100) 81.25 (75.00–95.83) 0.049*
Stimulation 91.67 (79.17–100) 91.67 (91.67–100) 91.67 (75.00–100) 0.534
Novelty 100 (75.00–100) 83.33 (83.33–100) 100 (75.00–100) 0.916

Values are presented as median (interquartile range).

UEQ: User Experience Questionnaire.

* p<0.01.

References

1. Olsson T, Karkkainen T, Lagerstam E, Venta-Olkkonen L. User evaluation of mobile augmented reality scenarios. J Ambient Intell Smart Environ 2012 4(1):29-47. https://doi.org/10.3233/AIS-2011-0127
crossref
2. Van Krevelen DW, Poelman R. A survey of augmented reality technologies, applications and limitations. Int J Virtual Real 2010 9(2):1-20. https://doi.org/10.20870/IJVR.2010.9.2.2767
crossref
3. Riley WT, Rivera DE, Atienza AA, Nilsen W, Allison SM, Mermelstein R. Health behavior models in the age of mobile interventions: are our theories up to the task? Transl Behav Med 2011 1(1):53-71. https://doi.org/10.1007/s13142-011-0021-7
crossref pmid pmc
4. Payne HE, Lister C, West JH, Bernhardt JM. Behavioral functionality of mobile apps in health interventions: a systematic review of the literature. JMIR Mhealth Uhealth 2015 3(1):e20. https://doi.org/10.2196/mhealth.3335
crossref pmid pmc
5. Merians AS, Jack D, Boian R, Tremaine M, Burdea GC, Adamovich SV, et al. Virtual reality-augmented rehabilitation for patients following stroke. Phys Ther 2002 82(9):898-915. https://doi.org/10.1093/ptj/82.9.898
crossref pmid
6. Kim U, Lee CS. A study on user-centered usability elements of user interface designs in an augmented reality environment. J Korea Inst Electron Commun Sci 2018 13(6):1317-22. https://doi.org/10.13067/JKIECS.2018.13.6.1317
crossref
7. Lee J, Jung D, Byun J, Lee M. Effects of a combined exercise program using an iPad for older adults. Healthc Inform Res 2016 22(2):65-72. https://doi.org/10.4258/hir.2016.22.2.65
crossref pmid pmc
8. Physical Activity Guidelines Advisory Committee. 2018 Physical Activity Guidelines Advisory Committee Scientific Report [Internet]. Washington (DC): U.S. Department of Health and Human Services; 2018 [cited at 2023 Apr 22]. Available from: https://health.gov/sites/default/files/2019-09/PAG_Advisory_Committee_Report.pdf
crossref
9. Jeon S, Kim J. Effects of augmented-reality-based exercise on muscle parameters, physical performance, and exercise self-efficacy for older adults. Int J Environ Res Public Health 2020 17(9):3260. https://doi.org/10.3390/ijerph17093260
crossref pmid pmc
10. Godtfredsen N, Frolich A, Bieler T, Beyer N, Kallemose T, Wilcke T, et al. 12-months follow-up of pulmonary tele-rehabilitation versus standard pulmonary rehabilitation: a multicentre randomised clinical trial in patients with severe COPD. Respir Med 2020 172:106129. https://doi.org/10.1016/j.rmed.2020.106129
crossref pmid
11. Hong J, Kim J, Kim SW, Kong HJ. Effects of home-based tele-exercise on sarcopenia among community-dwelling elderly adults: body composition and functional fitness. Exp Gerontol 2017 87(Pt A):33-9. https://doi.org/10.1016/j.exger.2016.11.002
crossref pmid
12. Gorman C, Gustafsson L. The use of augmented reality for rehabilitation after stroke: a narrative review. Disabil Rehabil Assist Technol 2022 17(4):409-17. https://doi.org/110.1080/17483107.2020.1791264
crossref pmid
13. Tunur T, DeBlois A, Yates-Horton E, Rickford K, Columna LA. Augmented reality-based dance intervention for individuals with Parkinson’s disease: a pilot study. Disabil Health J 2020 13(2):100848. https://doi.org/10.1016/j.dhjo.2019.100848
crossref pmid
14. Wikipedia. User experience [Internet]. [place unknown]: Wikipedia; 2023 [cited at 2023 Apr 23]. Available from: https://en.wikipedia.org/wiki/User_experience
crossref
15. Laugwitz B, Held T, Schrepp M. Construction and evaluation of a user experience questionnaire. Holzinger A. In: HCI and usability for education and work. Cham, Switzerland: Springer; 2008 63-76. https://doi.org/10.1007/978-3-540-89350-9_6
crossref
16. International Organization for Standardization. Ergonomics of human-system interaction — Part 210: Human-centred design for interactive systems. Geneva, Switzerland: International Organization for Standardization; 2019. 9241-210:2019
crossref
17. American College of Sports Medicine. ACSM’s guidelines for exercise testing and prescription. 10th ed. Philadelphia (PA): Lippincott Williams & Wilkins; 2018.
crossref
18. Borg GA. Psychophysical bases of perceived exertion. Med Sci Sports Exerc 1982 14(5):377-81. https://doi.org/10.1249/00005768-198205000-00012
crossref pmid
19. UEQ Team. User Experience Questionnaire [Internet]. [place unknown]: UEQ Team; 2018 [cited at 2023 Apr 23]. Available from: https://www.ueq-online.org/
crossref
20. Schrepp M, Hinderks A, Thomaschewski J. Applying the user experience questionnaire (UEQ) in different evaluation scenarios. Marcus A. In: Design, user experience, and usability: theories, methods, and tools for designing the user experience. Cham, Switzerland: Springer International Publishing; 2014 383-92. https://doi.org/10.1007/978-3-319-07668-3_37
crossref


ABOUT
ARTICLE CATEGORY

Browse all articles >

BROWSE ARTICLES
FOR CONTRIBUTORS
Editorial Office
1618 Kyungheegung Achim Bldg 3, 34, Sajik-ro 8-gil, Jongno-gu, Seoul 03174, Korea
Tel: +82-2-733-7637, +82-2-734-7637    E-mail: hir@kosmi.org                

Copyright © 2024 by Korean Society of Medical Informatics.

Developed in M2community

Close layer
prev next