This chapter introduces usability evaluation methods uems for mobile applications. A good user interface design typically needs the use of a variety of usability evaluation methods 6, 18. System usability scale sus the system usability scale sus provides a quick and dirty, reliable tool for measuring the usability. The plan describes the background, purposes, limitations, audiences, decisions, methods, sample, instrumentation, procedures, logistics and timeline for an usability evaluation for the information literacy elearning modules reusable and portable across a college of education, a. Some chapters 9, 23 did not propose new usability inspection methods but rather compared the effectiveness of different approaches to usability evaluation. Pdf statistical methods to measure usability evaluation. Thus a key element of usability evaluation is deciding when to employ guidelines and inspection userfree methods and when its critical to perform empirical research such as usability testing or contextual inquiry with the target audience. Theories, methods, and tools for designing the user experience third international conference, duxu 2014, held as part of hci international 2014, heraklion, crete, greece, june 2227, 2014, proceedings, part i. A comparative study of two usability evaluation methods using a webbased elearning application. Usability is often mistakenly equated with user satisfaction, which is an oversimplification. Statistical analysis has meant to provide statistical methods for making tests of significance and trustworthy estimations of the magnitude of the effects indicated by the results for the reduction of data. Usability inspection methods after 15 years of research and. The heuristic evaluation method is one of the most useful method and the least expensive one 17. Evidence of their reliability and usability may improve their acceptance within the sr community.
We explored the performance of three tools when used to. The top 7 usability testing methods adobe xd ideas. There are generally three types of usability evaluation methods. Usability evaluations of secure software systems require procedures that deviate from standard hci techniques. Whitten 17 highlights the differences between secure software and other software and why usability evaluation of secure. Usability evaluation of mobile applications using iso 9241. In usability testing approach, representative users work on typical tasks using the system or the prototype and the evaluators use the results to see how the user interface supports the users to do their tasks. In a series of usability evaluation method evaluation studies that became known as the comparative usability evaluation series seven studies that we know of as of this writing, a number of usability evaluation methods were tested under a variety of conditions and a major observation emerged. In addition, there is a need for quick and dirty methods to allow low cost assessments of usability in industrial systems evaluation. Welcome to the usability body of knowledge usability body. Heuristic evaluation most common informal method involves usability specialist judges they judge each dialogue element follows usability principles of not evaluator goes through one dialogue element several times and compare that with various usability principles at the end all evaluators can communicate and share their findings. Apr 29, 2016 usability evaluation of mobile applications. Usability engineering is the discipline that provides structured methods for achieving usability in user interface design during product development.
Principles and proposed methods of emr usability evaluation and rating electronic medical record emr adoption rates have been slower than expected in the united states, especially in comparison to other industry sectors and other developed countries. This conceptual paper provides a profile of the ways in which mobile device usability evaluation methods are being adapted to better reflect technological. Proceedings of the 2007 annual research conference of the south african institute of computer scientists and information technologists on it research in developing countries port elizabeth, south africa. Usability evaluation the encyclopedia of humancomputer. Usability evaluation methods proceedings of the 2009. Heuristic evaluationcontd advantages application of recognized and accepted principles. Evaluation methods vary and may be conducted solely by experts or involve end users individuals that will use the product 2527. User testing results showed that only 22 to 41% of the participants were.
Usability evaluation methods for mobile applications. Usability is an inherent measurable property of all interactive digital technologies developed evaluation methods that determine whether or not an interactive system or device is usable. Usability is the most widely used concept in the software engineering field and defines the software systems demand and use. Usability evaluation methods assessing the usability of a product with the purpose of identifying usability problems andor obtaining usability measures. Analytic methods usability inspection heuristic evaluation cognitive walkthrough usability inspection expert walkthrough based on usability guidelines, often working from a checklist generally want more than one expert if affordable. Usability includes methods of measuring usability, such as needs analysis and the study of the principles behind an objects perceived efficiency or elegance. These descriptions will form the core of a knowledge base that defines our field and will help communicate usability methods to clients, project managers, and team members. Usability evaluation method an overview sciencedirect topics. We begin, in section 2, by making explicit some of the important differences between the evaluation of ve user. Usability evaluation method an overview sciencedirect. To the best of our knowledge, only one prior study concern analysis practice in usability evaluation. There are many common data models designed for specific domains, such as health, banking, or business.
Usability evaluation 14 reporting usability test results. The plan describes the background, purposes, limitations, audiences, decisions, methods, sample, instrumentation, procedures, logistics and timeline for an usability evaluation for the information. A key challenge is the selection of an appropriate method, or combination of methods, to efficiently and effectively assess usability. We describe methods of usability evaluation, offering several alternative methods for measuring efficiency and effectiveness, including patient safety. Usability evaluations are often confused with usability, the holistic view in designing and evaluating systems for people overall. The system usability scale sus provides a quick and dirty, reliable tool for measuring the usability. Developing a usability evaluation method for elearning applications. Evaluating mobile applications and devices is particularly challenging given the variability of users, uses, and environments involved.
Building upon rags, an interim find version of guidance for data usability in risk assessment was issued by the risk assessment subgroup of the data useability workgroup in october 1990. Usability evaluation methods different kinds of system evaluationresearch analyticempirical analytic means reasoning and working by analysis empirical means making observationsor measurements formativesummative formative research earlier. Our investigation is a secondary analysis of data reported in a previous study, in which we used two methods user testing and semistructured interviews to identify usability challenges faced by clinicians in finding and entering diagnoses selected from a standardized diagnostic terminology in a dental ehr. Originally created by john brooke in 1986, it allows you to eva. Guidance for data useability in risk assessment part a. According to iso 9126, the usability characteristic is defined as the capability of the software product to be understood, learned, used, and attractive for the user, when used under specified conditions iso 91262 2001. In this paper, we present a survey of some existing approaches to usability evaluation of ves. Comparison of heuristic and cognitive walkthrough usability. There are several userbased and expertbased usability evaluation methods that may perform differently according to the context in which they are used. Agresti and coull publish the adjustedwald binomial confidence interval in the american statistician. When reporting results from a usability test, you should focus primarily on your findings and recommendations that are differentiated by levels of severity.
The purpose of evaluation can be to improve the usability of the product as part of designdevelopment formative evaluation, or to assess the extent to which usability objectives have been. Usability evaluation assesses the extent to which an interactive system is easy and pleasant to use. To meet the goals of this project, the report recommends the development of a webbased. Harper, richard, rodden, tom, rogers, yvonne and sellen, abigail 2008. It applies the proposed approach to a case study of a comparative evaluation of an academic website. First click testing examines what a test participant would click on first on the interface in order to complete their intended task. The objective of this study was to compare 2 expertbased methods, heuristic evaluation he and cognitive walkthrough cw, for evaluating usability of health care information systems. Usability evaluation methods reporting usability test results when reporting results from a usability test, you should focus primarily on your findings and recommendations that are differentiated by levels of severity. Intuitive spontaneous results usability early in the development process effective identification of major and minor problems rapidity, he can be used throughout the development process disadvantages disassociation from end users does not identify or allow for unknown users needs. In humancomputer interaction and computer science, usability studies the elegance and clarity with which the interaction with a computer program or a web site web usability is designed. Usability evaluations refer to any one of a set of methods allowing a user experience ux expert to evaluate the usability of a product or system in varying levels of detail. The study was presented as a pilot, and was based on interviews with 11. A survey of usability evaluation department of computer. It consists of a 10 item questionnaire with five response options for respondents.
If usability methods are combined, it becomes even more important to distinguish the information contribution by each method. This section of the usability bok presents descriptions of methods, including procedures, resources needed, outcomes, appropriate uses, benefits, and costs. User testing with real users is the most fundamental usability method and is in some sense irreplaceable, since it provides direct information about how people use comput. Usability inspection is the generic name for a set of methods based on having evaluators inspect or examine usabilityrelated aspects of a user interface. Usability evaluation of a data model tests whether the data model is easy to read, understand, and use by the database and data warehouse designers.
Usability evaluation an overview sciencedirect topics. Determine when to test what usability testing can employ many methods and work with products at many levels of development. Human health evaluation manual, part a epa 1989a serves as a general guidance document for the risk assessment process. A data model is usually designed in a way to cover the requirements of database and data warehouse designers. The paper proposes an approach to comparative usability evaluation that incorporates important relevant criteria identified in previous work. Usability testing on a new system is import to help understand what works and what does not. Evaluation plan for usability testing of module prototypes. Usability evaluation 14 reporting usability test results when reporting results from a usability test, you should focus primarily on your findings and recommendations that are differentiated by levels of severity. One of such methods is the enduser think aloud protocol and the heuristic evaluation method. The methods of usability evaluation evolved from the first initiatives in the 1980s, becoming constants, enabling increasingly successful interactive experiences 11,17, 21. Despite this, there is a need for broad general measures which can be used to compare usability across a range of contexts. If the re is enough of an interface to complete tasks or or even imagine completing a task it is possible to perform a usability test.
Usability evaluation methods and principles for the web. Usability evaluation methods usability body of knowledge. Over the past decades various usability evaluation methods have been developed and implemented to improve and assure easytouse user interfaces and systems. Pdf methods of usability evaluations of mobile devices.
It is often included in iterative development so that the product continually improves. Pdf developing a usability evaluation method for e. Welcome to the usability body of knowledge usability. With an increasing capacity for greater user interactivity through a range of tasks and. This paper investigates the application of two usability evaluation methods, namely heuristic evaluation and empirical user testing supported by eye tracking, to the website of a learning management system with the. Bernhaupt has classified following usability evaluation ue methods6. Usability evaluation methods proceedings of the 2009 annual. This broad definition includes labbased usability testing with users, heuristic and other expertbased usability inspection methods, modelbased analytic methods, all kinds of expert evaluation, and remote. Usability inspection methods after 15 years of research.
964 282 672 1530 1015 700 459 257 458 380 1319 762 455 104 487 1096 147 812 75 1409 232 61 980 1282 1044 647 212 1290 235 932 404 563