T-Space at The University of Toronto Libraries >
Journal of Medical Internet Research >
Volume 10 (2008) >
Please use this identifier to cite or link to this item:
|Title: ||Web Evaluation at the US National Institutes of Health: Use of the American Customer Satisfaction Index Online Customer Survey|
|Authors: ||Wood, Fred B|
Siegel, Elliot R
Love, Cynthia B
|Keywords: ||Original Paper|
World Wide Web
consumer health information
|Issue Date: ||15-Feb-2008|
|Publisher: ||Gunther Eysenbach; Centre for Global eHealth Innovation, Toronto, Canada|
|Citation: ||Fred B Wood, Elliot R Siegel, Sue Feldman, Cynthia B Love, Dennis Rodrigues, Mark Malamud, Marie Lagana, Jennifer Crafts. Web Evaluation at the US National Institutes of Health: Use of the American Customer Satisfaction Index Online Customer Survey. J Med Internet Res 2008;10(1):e4 <URL: http://www.jmir.org/2008/1/e4/>|
|Abstract: ||[This item is a preserved copy and is not necessarily the most recent version. To view the current item, visit http://www.jmir.org/2008/1/e4/ ]
The National Institutes of Health (NIH), US Department of Health and Human Services (HHS), realized the need to better understand its Web users in order to help assure that websites are user friendly and well designed for effective information dissemination. A trans-NIH group proposed a trans-NIH project to implement an online customer survey, known as the American Customer Satisfaction Index (ACSI) survey, on a large number of NIH websites—the first “enterprise-wide” ACSI application, and probably the largest enterprise Web evaluation of any kind, in the US government. The proposal was funded by the NIH Evaluation Set-Aside Program for two years at a cost of US $1.5 million (US $1.275 million for survey licenses for 60 websites at US $18,000 per website; US $225,000 for a project evaluation contractor).
The overall project objectives were to assess the value added to the participating NIH websites of using the ACSI online survey, identify any NIH-wide benefits (and limitations) of the ACSI, ascertain any new understanding about the NIH Web presence based on ACSI survey results, and evaluate the effectiveness of a trans-NIH approach to Web evaluation. This was not an experimental study and was not intended to evaluate the ACSI survey methodology, per se, or the impacts of its use on customer satisfaction with NIH websites.
The evaluation methodology included baseline pre-project websites profiles; before and after email surveys of participating website teams; interviews with a representative cross-section of website staff; observations of debriefing meetings with website teams; observations at quarterly trans-NIH Web staff meetings and biweekly trans-NIH leadership team meetings; and review and analysis of secondary data.
Of the original 60 NIH websites signed up, 55 implemented the ACSI survey, 42 generated sufficient data for formal reporting of survey results for their sites, and 51 completed the final project survey. A broad cross-section of websites participated, and a majority reported significant benefits and new knowledge gained from the ACSI survey results. NIH websites as a group scored consistently higher on overall customer satisfaction relative to US government-wide and private sector benchmarks.
Overall, the enterprise-wide experiment was successful. On the level of individual websites, the project confirmed the value of online customer surveys as a Web evaluation method. The evaluation results indicated that successful use of the ACSI, whether site-by-site or enterprise-wide, depends in large part on strong staff and management support and adequate funding and time for the use of such evaluative methods. In the age of Web-based e-government, a broad commitment to Web evaluation may well be needed. This commitment would help assure that the potential of the Web and other information technologies to improve customer and citizen satisfaction is fully realized.|
|Description: ||Reviewer: Bailey, Bob|
|Rights: ||© Fred B Wood, Elliot R Siegel, Sue Feldman, Cynthia B Love, Dennis Rodrigues, Mark Malamud, Marie Lagana, Jennifer Crafts. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 15.02.2008.
Except where otherwise noted, articles published in the Journal of Medical Internet Research are distributed under the terms of the Creative Commons Attribution License (http://www.creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited, including full bibliographic details and the URL (see "please cite as" above), and this statement is included.|
|Appears in Collections:||Volume 10 (2008) |
Items in T-Space are protected by copyright, with all rights reserved, unless otherwise indicated.