From GUI to VUI: A Natural Language Approach to Multimodal Medical System

Abstract

Within healthcare, the human touch between the doctor and the patient is extremely important. Unfortunately, most medical systems are based on user interfaces that make most doctors focus more on paying attention to the screen when capturing information than on the consultation itself. This paper presents a methodology that allows converting a graphical user interface (GUI) to a voice user interface (VUI) to automatically integrate a multimodal system. The methodology can be easily extended to other types of applications for building multimodal systems from already defined web GUIs.