| Usability Index Checklist for Web Sites | |||||
| You can use this checklist to calculate the Usability Index of your Web site. | |||||
| Add or delete questions to match your requirements. | |||||
| Answer each checklist question with not applicable (N/A), yes, or no. | |||||
| If a category is missing (for example, no search tool) answer all questions in the category no. | |||||
| To determine the Usability Index count the number of yes answers compared with the total of the yes and no answers. | |||||
| With the Microsoft Excel 5.0 spreadsheet, use yes=1 and no=1 and the Usability Index is calculated for you. | |||||
| In the collaborative spirit of the Web, you can use this checklist for research; however, | |||||
| any commercial or business use requires prior permission from Keevil & Associates. | |||||
| Email any questions to Benjamin Keevil (bkeevil@sympatico.ca) at www3.sympatico.ca/bkeevil/. | |||||
| This checklist was updated on September 13, 1998 from focus group feedback. To print, scale to 80%. | |||||
| Copyright (c) 1998 Keevil & Associates. | |||||
| Usability Index (calculated by Excel as a per cent) | 76 | ||||
| What is the name of the Web site? | Keevil & Associates | ||||
| What is the location (URL) of the Web site? | http://www3.sympatico.ca/bkeevil/ | ||||
| What is the main purpose of the site? | Sell technical writing services | ||||
| (sell products or services, advertise jobs, conduct research, upgrade products, display information) | |||||
| What is the style of the site? | Simple technical | ||||
| How many users are there? | 100 | ||||
| When was the usability index measured? | May-98 | ||||
| Checklist Questions | |||||
| Finding the Information | N/A | Yes | No | For more information... | |
| Contents | |||||
| Contents list included? | 1 | Nielsen usability 1994 | |||
| Links in contents list correct? | 1 | ||||
| Site Map | |||||
| Site map included? | 1 | Nielsen usability 1994 | |||
| Links in site map correct? | 1 | ||||
| Headings labelled correctly? | 1 | ||||
| Two or three highest heading levels included? | 1 | ||||
| Capitalization, spelling, and punctuation correct? | 1 | ||||
| Acronyms avoided where possible? | 1 | ||||
| Headings (Choose one page at random) | |||||
| Headings brief and informative? | 1 | ||||
| Headings unique? | 1 | ||||
| Headings parallel? | 1 | ||||
| Headings stand out on the page? | 1 | ||||
| At least one heading on every page? | 1 | ||||
| Each heading accurately reflects tasks or information? | 1 | ||||
| Search | |||||
| Search tool included for sites with over 20 pages? | 1 | ||||
| Choose a topic at random -- can you find it? | 1 | ||||
| Index | |||||
| Index included? | 1 | ||||
| Entries in alphabetical order? | 1 | ||||
| Secondary and tertiary entries included? | 1 | ||||
| Up-to-date information | |||||
| Is the date of the last update indicated? | 1 | ||||
| Is there an automatic update notification mechanism? | 1 | ||||
| Is new information indicated? | 1 | ||||
| Finding an answer | |||||
| Choose a simple fact - can a user find it? | 1 | ||||
| Can the user find the answer in 10 minutes? | 1 | ||||
| Glossary | |||||
| Glossary included? | 1 | ||||
| Introductory statement correct? | 1 | ||||
| All specialized terms in site included? | 1 | ||||
| Terms not used in site eliminated? | 1 | ||||
| Format correct? | 1 | ||||
| Entries in alphabetical order? | 1 | ||||
| Lead-in wording of entries parallel and correct? | 1 | ||||
| Cross-referencing style correct? | 1 | ||||
| Acronyms treated correctly? | 1 | ||||
| Glossary proofread for spelling and punctuation? | 1 | ||||
| Definitions consistent with site definitions? | 1 | ||||
| Terms and definitions copied from organizations credited? | 1 | ||||
| Understanding the Information | N/A | Yes | No | ||
| Overview Page | |||||
| Is an "Overview" page or picture included? | 1 | Nielsen 1994 | |||
| Product description included? | 1 | ||||
| Description of relation to other products correct? | 1 | ||||
| Purpose and uses of product described? | 1 | ||||
| About This Site Topic (for 50-page sites) | |||||
| For 50-page sites, "About This Site" topic included? | 1 | ||||
| Sentence describing the site included? | 1 | ||||
| Sentence describing the product or service included? | 1 | ||||
| Topic "Organization of this site" included or implied? | 1 | ||||
| Topic "How to use this site" included? | 1 | ||||
| Topic "Software Release" included for software products? | 1 | ||||
| Topic "Who should read this site" included? | 1 | ||||
| Figure "Product Documentation Map" included? | 1 | ||||
| Topic "Related Publications" included? | 1 | ||||
| Topic "Prequisites and Corequisites" included? | 1 | ||||
| Topic "Conventions in This site" included? | 1 | ||||
| Topic "Getting Help" included? | 1 | ||||
| Organization of the Site | |||||
| Does every major topic have an "Introduction". | 1 | ||||
| "Introduction" part informative? | 1 | ||||
| Is the "inverted information pyramid" used? | 1 | http://useit.com | |||
| Organization conforms to style guidelines? | 1 | ||||
| Heading levels appropriate to level of detail? | 1 | ||||
| Headings task-based? | 1 | ||||
| Structure of lists parallel? | 1 | ||||
| Structure of procedures parallel? | 1 | ||||
| Structure of examples parallel? | 1 | ||||
| Each paragraph has main idea, described in topic sentence? | 1 | ||||
| Presentation moves from general to specific? | 1 | ||||
| Presentation moves from simple to complex? | 1 | ||||
| Information complete? | 1 | ||||
| Information limited to appropriate and necessary topics? | 1 | ||||
| Information in correct sequence? | 1 | ||||
| Procedures task oriented? | 1 | ||||
| Summary included and accurate? | 1 | ||||
| Style (Choose five pages at random) | |||||
| Style conforms to desired style? | 1 | ||||
| Editorial comments added or otherwise resolved? | 1 | ||||
| Active and passive voices used appropriately? | 1 | ||||
| Second person used appropriately? | 1 | ||||
| Present tense predominates? | 1 | ||||
| Reading level acceptable? | 1 | ||||
| One-sentence paragraphs used sparingly? | 1 | ||||
| Sentences simple but not terse? | 1 | ||||
| Latin words and abbreviations eliminated where possible? | 1 | ||||
| Transitions between topics smooth? | 1 | ||||
| Instructions in imperative mood? | 1 | ||||
| Positive expressions and expressions predominate? | 1 | ||||
| Abbreviations, acronyms, and symbols used sparingly? | 1 | ||||
| Abbreviations and acronyms in prescribed style? | 1 | ||||
| Imprecise (vague) words replaced with precise ones? | 1 | ||||
| Jargon avoided? | 1 | ||||
| Redundant and extraneous words removed? | 1 | ||||
| Coining of verbs, adjectives, and nouns avoided? | 1 | ||||
| Noun strings limited to maximum of three words? | 1 | ||||
| Examples | |||||
| Examples included? | 1 | ||||
| Examples relate well to tasks? | 1 | ||||
| Examples tested and approved? | 1 | ||||
| Complexity of examples appropriate for audience? | 1 | ||||
| Figures | |||||
| Figures consistent in font, layout, and style? | 1 | ||||
| Figures flow in an obvious manner? | 1 | ||||
| Figures easily interpreted? | 1 | ||||
| Figures suit information presented? | 1 | ||||
| Figures useful? | 1 | ||||
| Figures sufficient in number? | 1 | ||||
| Figures appropriately titled and numbered? | 1 | ||||
| Each figure title unique? | 1 | ||||
| Figures referenced in preceding text? | 1 | ||||
| Titles, callouts, and annotations informative? | 1 | ||||
| Figures correctly integrated with the text? | 1 | ||||
| List of Abbreviations | |||||
| List of abbreviations included? | 1 | ||||
| Entries in alphabetical order? | 1 | ||||
| Style correct, concise, and readable? | 1 | ||||
| Terminology | |||||
| Approved terminology used? | 1 | ||||
| Terminology based on standards? | 1 | ||||
| Sources of specialized terminology listed in bibliography? | 1 | ||||
| General terms used as defined in Webster's dictionary? | 1 | ||||
| Naming conventions applied correctly and consistently? | 1 | ||||
| Highlighting conventions consistent and correct? | 1 | ||||
| New terms highlighted and defined when first used? | 1 | ||||
| Synonyms avoided after meaning of terms established? | 1 | ||||
| Meaning of each term consistent throughout each site? | 1 | ||||
| Meaning of each term consistent throughout set of sites? | 1 | ||||
| First occurrences of abbreviations follow spelled-out words? | 1 | ||||
| Level of technical terms appropriate to audience? | 1 | ||||
| Depreciated, restricted, and forbidden words avoided? | 1 | ||||
| Difficult-to-translate words avoided? | 1 | ||||
| Supporting User Tasks | N/A | Yes | No | ||
| User-Oriented Tasks | |||||
| Does the title of the site represent a major task? | 1 | ||||
| Do the topics represent subtasks? | 1 | ||||
| Does the topic order represent the subtask order? | 1 | ||||
| Does each topic have a clearly defined goal? | 1 | ||||
| Is there a procedure for a basic, getting started task? | 1 | ||||
| Does each task have an introduction? | 1 | ||||
| Are the tasks described using action verbs? | 1 | ||||
| Does the graphical user interface emulate the product? | 1 | ||||
| Tasks | |||||
| Choose a task - can you complete the task in 10 minutes? | 1 | ||||
| Interactive Tasks | |||||
| Are reply forms shorter than one page? | 1 | ||||
| Does the site use QuickTime movies? | 1 | ||||
| Information Updates | |||||
| Is the date of the last update indicated? | 1 | ||||
| Is there an automatic update notification mechanism? | 1 | ||||
| Is new information indicated? | 1 | ||||
| User Questions | |||||
| Are Frequently Asked Questions (FAQ) included? | 1 | ||||
| For example - How to install the software? | 1 | ||||
| For example - How to start the application? | 1 | ||||
| For example - How to exit from the application? | 1 | ||||
| For example - Where to get help information? | 1 | ||||
| Evaluating the Technical Accuracy | N/A | Yes | No | ||
| Technical Content | |||||
| Product names and numbers correct? | 1 | ||||
| Warning and caution notices included and correct? | 1 | ||||
| All outstanding technical issues resolved? | 1 | ||||
| Content technically accurate? | 1 | ||||
| Content tested by technical writer? | 1 | ||||
| Content tested by verification team? | 1 | ||||
| Content approved by product development? | 1 | ||||
| Content approved by product management? | 1 | ||||
| Content approved by product marketing? | 1 | ||||
| Content approved by legal and patents? | 1 | ||||
| Presenting the Information | N/A | Yes | No | ||
| Display Speed (Choose three pages at random) | |||||
| Home page displays within 10 seconds with a 33.6 modem? | 1 | ||||
| If not, is there feedback indicating the delay? | 1 | ||||
| Are graphics under 25K in size? | 1 | ||||
| If more than 5 graphics on a page, are they 15k or smaller? | 1 | ||||
| For URL (URI) links, is the final slash included? | 1 | ||||
| Are WIDTH and HEIGHT attributes included on all images? | 1 | ||||
| Are WIDTH and HEIGHT attributes included on all tables? | 1 | ||||
| Are complex tables split into simple tables? | 1 | ||||
| Links | |||||
| Is there advance notice before downloading large files? | 1 | ||||
| Are thumbnail pictures at least 1 x 2 inches (2.5 x 5.0 cm.)? | 1 | ||||
| Is there at least one link on every page? | 1 | ||||
| Is the color of the link correct? | 1 | ||||
| HTML Format (Choose one page at random) | |||||
| Do pages display on small 2 x 3 inch (5.0 x 7.5 cm.) terminals? | 1 | ||||
| Is standard HTML code used? | 1 | ||||
| International Format | |||||
| Are international audiences recognized? | 1 | ||||
| Are meeting times international? | 1 | ||||
| Are icons international? | 1 | ||||
| Are metaphors international? | 1 | ||||
| Text Format (Choose three pages at random) | |||||
| Text left justified and ragged right? | 1 | ||||
| Format consistent throughout the site? | 1 | ||||
| Figures and tables aligned correctly? | 1 | ||||
| White space used effectively? | 1 | ||||
| Information presented in readable blocks? | 1 | ||||
| Major topics begin on separate pages? | 1 | ||||
| Bad line breaks corrected? | 1 | ||||
| Sentences not continued across pages? | 1 | ||||
| No widowed headings? | 1 | ||||
| No orphans? | 1 | ||||
| Mechanics (Choose five pages at random) | |||||
| Spelling correct? | 1 | ||||
| Punctuation correct? | 1 | ||||
| Grammar correct? | 1 | ||||
| Cross-references used only when necessary? | 1 | ||||
| Cross-references to other parts of site use "see"? | 1 | ||||
| Cross-references to other sites use "refer"? | 1 | ||||
| Changes marked accurately with correct revision characters? | 1 | ||||
| Spelling checker runs error free? | 1 | ||||
| Readability checker indicates appropriate level? | 1 | ||||
| Lists | |||||
| List formats appropriate for items listed? | 1 | ||||
| Lists punctuated correctly? | 1 | ||||
| Messages | |||||
| Messages (for example, errors) included and accurate? | 1 | ||||
| Message format correct? | 1 | ||||
| Message style consistent? | 1 | ||||
| Messages as brief as possible? | 1 | ||||
| Trademarks | |||||
| Trademarks acknowledged correctly? | 1 | ||||
| Trademarks used as adjectives modifying nouns? | 1 | ||||
| Appendixes or References | |||||
| References included and correctly placed? | 1 | ||||
| References consist of related but not vital information? | 1 | ||||
| References referred to from topics? | 1 | ||||
| Printing | |||||
| For a 50-page site, can you download a 2-page file? | 1 | ||||
| Do all the text and graphics print? | 1 | ||||
| Does the file print on A4 and US letter size paper? | 1 | ||||
| Summary of Questions | N/A | Yes | No | Total | |
| Finding the Information | 0 | 18 | 18 | 36 | |
| Understanding the Information | 20 | 60 | 4 | 84 | |
| Supporting User Tasks | 6 | 12 | 1 | 19 | |
| Evaluating the Technical Accuracy | 5 | 4 | 4 | 13 | |
| Presenting the Information | 15 | 25 | 11 | 51 | |
| Total number of questions that you answered. | 46 | 119 | 38 | 203 | |
| This checklist has 203 questions in total. | |||||
| Calculating the Usability Index | N/A | Yes | No | Usability Index (per cent) | |
| 100 x (Total Yes Answers)/(Total Yes + No Answers) | 46 | 119 | 38 | 76 | |