Client Questionnaire for Web Developers This questionnaire is very. 25-Point Website Usability Checklist The 25-Point Website Usability Checklist offered. Quest.cgi is a free script for administering user interface usability questionnaires on the web. The script has been used to display and collect data from several. ![]() ![]() Measuring satisfaction: Beyond the usability questionnaire Most usability tests culminate with a short questionnaire that asks the participant to rate, usually on a 5- or 7-point scale, various characteristics of the system. Experience shows that participants are reluctant to be critical of a system, no matter how difficult they found the tasks. This article describes a guided interview technique that overcomes this problem based on a word list of over 100 adjectives. —, March 3, 2008, updated 22 July 2009. Measuring user satisfaction A common mistake made by novice usability test moderators is to think that the aim of a usability test is to elicit a participant's reactions to a user interface. Experienced test moderators realise that a participant's reaction is just one. To get the complete usability picture, we also need to consider effectiveness (can people complete their tasks?) and efficiency (how long do people take?). These dimensions of usability come from the International Standard,, which defines usability as: 'Extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use.' The ISO definition of usability makes it clear that user satisfaction is just one important dimension of usability. People may be well disposed to a system but fail to complete business-critical tasks with it, or do so in a roundabout way. The System Usability Scale (SUS) is a 10-Question questionnaire that offers a quick, cost-effective yet accurate way to evaluate the usability of a website. The System Usability Scale (SUS) is a 10-Question questionnaire that offers a quick, cost-effective yet accurate way to evaluate the usability of a website. The three measures of usability effectiveness, efficiency and satisfaction (PDF document) and you need to measure all three to get a rounded measure of usability. Importance of collecting satisfaction measures A second mistake made by people new to the field of usability is to measure satisfaction by using a questionnaire only (either at the end of the session or on completion of each task). There are many, and few usability questionnaires are up to scratch. For example, we've known for over 60 years that you need to avoid the 'acquiescence bias': the fact that people are more likely to agree with a statement than disagree with it (Cronbach, 1946). This means that you need to balance positively-phrased statements (such as 'I found this interface easy to use') with negative ones (such as 'I found this interface difficult to navigate'). So it's surprising that two commonly used questionnaires in the field of usability the Usefulness, Satisfaction, and Ease of use and the Computer System Usability Questionnaire () suffer from just this problem: every question in both of these questionnaires is positively phrased, which means the results from them are biased towards positive responding. Questionnaires that avoid this source of bias often suffer from other sources of bias. For example, few undergo tests of reliability. This means that the same questionnaire may yield different results at different times (this can be checked by measuring the questionnaire's test-retest reliability). Even fewer usability questionnaires are assessed for validity. This means that there is no guarantee that the questionnaire actually measures user satisfaction. Problems with measuring satisfaction In our studies, we notice that participants tend to rate an interface highly on a post-test questionnaire even when they fail to complete many of the tasks. I've spoken to enough of my colleagues at conferences and meetings to know that this problem is commonplace. Is this because we are about to give the participant £75 for taking part in a test session or is there something else at work? For example, one group of researchers makes this point: 'In studies such as this one, we have found subjects reluctant to be critical of designs when they are asked to assign a rating to the design. In our usability tests, we see the same phenomenon even when we encourage subjects to be critical.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. Archives
March 2018
Categories |