International Journal of Clinical Pediatric Dentistry

Register      Login

SEARCH WITHIN CONTENT

FIND ARTICLE

Volume / Issue

Online First

Archive
Volume  17 (2024)
Volume  16 (2023)
Volume  15 (2022)
Volume  14 (2021)
Volume  13 (2020)
Volume  12 (2019)
Volume  11 (2018)
Volume  10 (2017)
Volume  9 (2016)
Volume  8 (2015)
Volume  7 (2014)
Volume  6 (2013)
Volume  5 (2012)
Volume  4 (2011)
Volume  3 (2010)
Volume  2 (2009)
Volume  1 (2008)
Related articles

VOLUME 17 , ISSUE 12 ( December, 2024 ) > List of Articles

ORIGINAL RESEARCH

Expert Usability Evaluation of a Mobile Application for Systematic Caries Management in Children and Adolescents: A Cross-sectional Study

Yu-Min Kang, An-Na Yeo, Su-Young Lee

Keywords : Dental caries, Heuristics, mHealth, Mobile applications

Citation Information : Kang Y, Yeo A, Lee S. Expert Usability Evaluation of a Mobile Application for Systematic Caries Management in Children and Adolescents: A Cross-sectional Study. Int J Clin Pediatr Dent 2024; 17 (12):1370-1376.

DOI: 10.5005/jp-journals-10005-2992

License: CC BY-NC 4.0

Published Online: 06-01-2025

Copyright Statement:  Copyright © 2024; The Author(s).


Abstract

Aims and background: The field of mobile healthcare (mHealth) has attracted attention, and the quality of mHealth applications is also being addressed. Therefore, usability evaluation should be conducted to verify the quality of mHealth applications. The aim of this study was to conduct an expert evaluation to verify the systematic aspects and usability of a mobile application (“CAMBRA-students”) developed to evaluate caries risk in children and adolescents and to provide systematic caries management. Materials and methods: The expert reviewers consisted of five professionals, including two dental hygienists, one professor of dental hygiene, and two IT specialists. These experts evaluated the technical issues of the mobile application using the heuristic evaluation and the Mobile App Rating Scale (MARS). Frequency analysis was used to determine the heuristic score and MARS. Results: As a result of the heuristic evaluation, a total of 45 comments were received, of which 23 problems were extracted. The usability evaluation for professionals resulted in an overall score of 3.64. In the subscales (engagement, functionality, esthetics, information, and application subjective quality) of the MARS, the domain “application subjective quality” received the lowest score of 2.95 and the domain “information” received the highest score of 4.18. Through expert evaluation, the “CAMBRA-students” application was improved, and the usability was modified by correcting systemic and usability issues. Conclusion: The “CAMBRA-students” application is expected to be used in public oral health services for students. It will contribute to improving the oral health status of adolescents using the caries risk management system. Clinical significance: The “CAMBRA-students” application effectively manages caries risk in adolescents and has enhanced usability and systematic quality through expert evaluation, enabling personalized oral health management. It can significantly improve adolescent oral health and be integrated into school-based programs.

PDF Share
  1. Topp CW, Østergaard SD, Søndergaard S, et al. The WHO-5 Well-Being Index: a systematic review of the literature. Psychother Psychosom 2015;84:167–176. DOI: 10.1159/000376585
  2. Gallup. 2012–2022 Smartphone Usage Rate and Brand, Smart Watch, Wireless Earphone Survey. Seoul, Korea: Gallup Report; 2022.
  3. World Health Organization. mHealth: New Horizons for Health Through Mobile Technologies: Second Global Survey on eHealth. Geneva, Switzerland: World Health Organization; 2011.
  4. Cai X, Zhang F, Lin C, et al. Achieving effective and efficient basal insulin optimal management by using mobile health application (APP) for type 2 diabetes patients in China. Diabetes Metab Syndr Obes 2020;13:1327–1338. DOI: 10.2147/DMSO.S244826
  5. Stoyanov SR, Hides L, Kavanagh DJ, et al. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth 2015;3:e27. DOI: 10.2196/mhealth.3422
  6. Park JH, Park HY, Park JH. Qualitative evaluation of lifestyle management apps using the Korean Mobile Application Rating Scale (MARS). J RWEAT 2020;14:134–141. DOI: 10.21288/resko.2020.14.2.134
  7. Weekly T, Walker N, Beck J, et al. A review of apps for calming, relaxation, and mindfulness interventions for pediatric palliative care patients. Children 2018;5:16. DOI: 10.3390/children5020016
  8. Santo K, Richtering SS, Chalmers J, et al. Mobile phone apps to improve medication adherence: a systematic stepwise process to identify high-quality apps. JMIR Mhealth Uhealth 2016;4:e132. DOI: 10.2196/mhealth.6742
  9. Escoffery C, McGee R, Bidwell J, et al. A review of mobile apps for epilepsy self-management. Epilepsy Behav 2018;81:62–69. DOI: 10.1016/j.yebeh.2017.12.010
  10. Bardus M, van Beurden SB, Smith JR, et al. A review and content analysis of engagement, functionality, aesthetics, information quality, and change techniques in the most popular commercial apps for weight management. Int J Behav Nutr Phys Act 2016;13:35. DOI: 10.1186/s12966-016-0359-9
  11. Masterson Creber RM, Maurer MS, Reading M, et al. Review and analysis of existing mobile phone apps to support heart failure symptom monitoring and self-care management using the Mobile Application Rating Scale (MARS). JMIR Mhealth Uhealth 2016;4:e74. DOI: 10.2196/mhealth.5882
  12. Tinschert P, Jakob R, Barata F, et al. The potential of mobile apps for improving asthma self-management: a review of publicly available and well-adopted asthma apps. JMIR Mhealth Uhealth 2017;5:e113. DOI: 10.2196/mhealth.7177
  13. Grainger R, Townsley H, White B, et al. Apps for people with rheumatoid arthritis to monitor their disease activity: a review of apps for best practice and quality. JMIR Mhealth Uhealth 2017;5:e7. DOI: 10.2196/mhealth.6956
  14. Thornton L, Quinn C, Birrell L, et al. Free smoking cessation mobile apps available in Australia: a quality review and content analysis. Aust N Z J Public Health 2017;41:625–630. DOI: 10.1111/1753-6405.12688
  15. Bowman DA, Gabbard JL, Hix D. A survey of usability evaluation in virtual environments: classification and comparison of methods. Presence 2002;11:404–424. DOI: 10.1162/105474602760204309
  16. Nielsen J. Heuristic evaluation. In: Usability Inspection Methods. New York: John Wiley & Sons; 1994. pp. 25–62.
  17. Yen PY, Bakken S. A comparison of usability evaluation methods: heuristic evaluation versus end-user think-aloud protocol—an example from a web-based communication tool for nurse scheduling. AMIA Annu Symp Proc 2009;2009:714–718.
  18. Kang YM, Lee SY. Heuristics evaluation and development of the caries management by risk assessment (CAMBRA)-kids application for caries management of preschoolers. J Korean Soc Dent Hyg 2019;19:479–492. DOI: 10.13065/jksdh.20190043
  19. Yeo AN, Lee SY. Effect of dental caries management using ‘CAMBRA-kids’ mobile application for children under 5 years old. Int J Dent Hyg 2022;20:443–452. DOI: 10.1111/idh.12565
  20. Parker K, Bharmal RV, Sharif MO. The availability and characteristics of patient-focused oral hygiene apps. Br Dent J 2019;226:600–604. DOI: 10.1038/s41415-019-0197-7
  21. Väyrynen E, Hakola S, Keski-Salmi A, et al. The use of patient-oriented mobile phone apps in oral health: scoping review. JMIR Mhealth Uhealth 2023;11:e46143. DOI: 10.2196/46143
  22. Petersen PE. The World Oral Health Report 2003: continuous improvement of oral health in the 21st century—the approach of the WHO Global Oral Health Programme. Community Dent Oral Epidemiol 2003;31:3–23. DOI: 10.1046/j..2003.com122.x
  23. Lee JH, Park Y, Jung JE, et al. Usability evaluation of a mobile app for sexual violence survivors. J KoCon 2022;22:700–711.
  24. Byun AJ. Development and Evaluation of Smartphone App “Healthy kids” for Children's Weight Control with their Parents [Master Thesis]. Seoul: Seoul National University; 2018.
  25. Nielsen J. Enhancing the Explanatory Power of Usability Heuristics. In: Adelson B, Dumais ST, Olson JS, editors. CHI. ACM; 1994. pp. 152–158.
  26. Bertini E, Gabrielli S, Kimani S. Appropriating and assessing heuristics for mobile computing. In: Proceedings of the Working Conference on Advanced Visual Interfaces. Assoc Comput Mach 2006;1:119–126.
  27. Jeon E, Park HA. Development of the IMB model and an evidence-based diabetes self-management mobile application. Healthc Inform Res 2018;24:125–138. DOI: 10.4258/hir.2018.24.2.125
  28. Lee WH. Heuristic evaluation of mobile augmented reality applications: focused on location-based service type apps. Korea Society Design Trend 2017;5:131–140.
  29. Fung RHY, Chiu DKW, Ko EHT, et al. Heuristic usability evaluation of university of Hong Kong libraries’ mobile website. J Acad Libr 2016;42:581–594. DOI: 10.1016/j.acalib.2016.06.004
  30. Roy A, Nayak PP, Shenoy PR, et al. Availability and content analysis of smartphone applications on conservative dentistry and endodontics using mobile application rating scale (MARS). Curr Oral Health Rep 2022;9:215–225. DOI: 10.1007/s40496-022-00325-w
  31. Zhang H, Gil TS, Kang EJ. A feasibility study of Korean mobile application rating scale (MARS) for evaluating the quality of blood pressure management apps. Korean J Health Educ Promot 2018;35:41–51. DOI: 10.14367/kjhep.2018.35.3.41
  32. Siddiqui NR, Hodges SJ, Sharif MO. Orthodontic apps: an assessment of quality (using the Mobile App Rating Scale (MARS)) and behaviour change techniques (BCTs). Prog Orthod 2021;22:25. DOI: 10.1186/s40510-021-00373-5
  33. Reyes A, Qin P, Brown CA. A standardized review of smartphone applications to promote balance for older adults. Disabil Rehabil 2018;40:690–696. DOI: 10.1080/09638288.2016.1250124
PDF Share
PDF Share

© Jaypee Brothers Medical Publishers (P) LTD.