T-Space at The University of Toronto Libraries >
Journal of Medical Internet Research >
Volume 8 (2006) >
Please use this identifier to cite or link to this item:
|Title: ||Evaluation of Spoken Dialogue Technology for Real-Time Health Data Collection|
|Authors: ||Levin, Esther|
|Keywords: ||Original Paper|
ecological momentary assessment
|Issue Date: ||11-Dec-2006|
|Publisher: ||Gunther Eysenbach; Centre for Global eHealth Innovation, Toronto, Canada|
|Citation: ||Esther Levin, Alex Levin. Evaluation of Spoken Dialogue Technology for Real-Time Health Data Collection. J Med Internet Res 2006;8(4):e30 <URL: http://www.jmir.org/2006/4/e30/>|
|Abstract: ||[This item is a preserved copy and is not necessarily the most recent version. To view the current item, visit http://www.jmir.org/2006/4/e30/ ]
A real-time assessment of patients’ experiences is an important methodology for studies in health care, quality of life, behavioral sciences, and new drug and treatment development. Ecological momentary assessment is a methodology that allows for real-time assessment of experience and behavior in a subject’s natural environment. Recently, electronic data collection techniques have been introduced, including systems utilizing interactive voice response.
The objective of this project was evaluation of spoken dialogue methodology for real-time data collection of information from patients for health, behavioral, and lifestyle studies and monitoring. While the management of the data collection process was Internet-based, this additional eHealth communication channel was based on over-the-phone natural language conversation with a dialogue system utilizing automated speech recognition technology. For this study we implemented a dialogue system for patients’ assessment and monitoring of chronic pain.
Experimental evaluation of usability of the Pain Monitoring Voice Diary was performed with 24 volunteers. The volunteers were asked to contribute 10 sessions with the system over a period of 2 weeks; in practice, the number of sessions per subject ranged from 1 to 20. The subjects were asked to either relate to pain episodes in their past while answering the system’s questions, or use as a guidance one of nine provided medical scenarios compiled by a pain specialist, ranging from migraines and back pain to post-surgical pain (knee injury) and cancer- and chemotherapy-related afflictions.
From 24 volunteers, we collected a total of 177 dialogue sessions: 171 sessions were completed, while the caller hung up in the other 6 sessions. There were a total of 2437 dialogue turns, where a dialogue turn corresponds to one system prompt and one user utterance. The data capture rate, measuring the percentage of slots filled automatically, was 98%, while the other 2% were flagged for transcription. Among the utterances sent to transcription, where the user had opted for the “none of those” option, 70% corresponded to the “type of pain” slot, 20% to the “symptoms” slot, and 10% to the “body part” slot, indicating that those are the grammars with the highest out-of-vocabulary rate.
The results of this feasibility study indicated that desired accuracy of data can be achieved with a high degree of automation (98% in the study) and that the users were indeed capable of utilizing the flexible interface, the sessions becoming more and more efficient as users’ experience increased, both in terms of session duration and avoidance of troublesome dialogue situations.|
|Description: ||Reviewer: Slack, Warner|
|Rights: ||© Esther Levin, Alex Levin. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 11.12.2006. Except where otherwise noted, articles published in the Journal of Medical Internet Research are distributed under the terms of the Creative Commons Attribution License (http://www.creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited, including full bibliographic details and the URL (see "please cite as" above), and this statement is included.|
|Appears in Collections:||Volume 8 (2006)|
Items in T-Space are protected by copyright, with all rights reserved, unless otherwise indicated.