Usability | Consulting | Facilities | Lab Capabilities | Study procedures | Workshops | About us | Home

logo

Workshop on Modern Consumer-Oriented Website Design

Usability test examples

Workshop | Timetable | Handout preview | Usability tests examples | Ordering | Participants evaluation | Photo gallery | Contact

 

Usability test of Teleios Systems Ltd website

Usability test of Ministry of Legal Affairs website

 

Usability test of Teleios Systems Ltd website

The following tasks were performed by a test person (see here):

Task 1: Write the name of the manager of the message central group.

ANS: Cordell Lawrence
Task 2: Write one feature of Shout which is the web-based application designed to allow  media houses real-time interaction with their audiences.

ANS: Real time audience interaction, Feedback, On-air Requests, Polls/Surveys, Web-based access, Message archiving and search, Customizable automated message 

         response system, Built-in user support 

Task 3: Write the maximum number of persons allowed per team for the SMS code jam competition.

ANS: four (4) persons

Task 4: Write one Message Central application.

ANS: Triumph, Aggelos, Snapshot, MessageCentral for Microsoft Outlook, Converge, SHOUT Interactive Media System

Task 5: Write the email address for sending a resume to Teleios for job application.

ANS: careers@teleios-systems.com

 

teleios-observer

                                                                                   Figure 1: Usability Testing Task Analysis - Teleios Systems Ltd

 

 

1

2

3

4

5

 

N/A

Comments

     Visibility of system status

1

Is status feedback provided continuously (e.g. progress indicators or messages)?

DISAGREE

 

AGREE

 

     Match between system and real world

2

Are the words, phrases and concepts used familiar to the user?

DISAGREE

 

AGREE

 

3

Is information presented in a simple, natural and logical order?

DISAGREE

 

AGREE

 

     User control and freedom

4

Are facilities provided to return to the top level at any stage (e.g. links back to homepage)?

DISAGREE

 

AGREE

 

     Consistency and standards

5

Is the use of terminology, controls, graphics and menus consistent throughout the system?

DISAGREE

 

AGREE

 

6

Is there a consistent look and feel to the system interface?

DISAGREE

 

AGREE

 

     Aesthetic and minimalist design

7

Is the design simple, intuitive, easy to learn and pleasing?

DISAGREE

 

AGREE

 

8

Is the website free from irrelevant, unnecessary and distracting information?

DISAGREE

 

AGREE

 

9

Are icons clear and buttons labelled and is the use of graphic controls obvious?

DISAGREE

 

AGREE

 

     Navigation

10

Is navigational feedback provided (e.g. showing a user's current and initial states, where they've been and what options they have for where to go)?

DISAGREE

 

AGREE

 

11

Are any navigational aids provided (e.g. search facilities)?

DISAGREE

 

AGREE

 

     Structure of information

12

Is there a hierarchical organisation of information from general to specific?

DISAGREE

 

AGREE

 

13

Does each screen comprise 1 document on 1 topic with the most important information appearing at the top?

DISAGREE

 

AGREE

 

 

1

2

3

4

5

 

N/A

Comments

                                                                Figure 2: Usability Testing User Feedback - Teleios Systems Ltd

 

Results

The test person had difficulty finding the required information while performing task 4 (Write one Message Central application). From the test person's feedback (Figure 2), low scoring questions are indicative causative factors in the overall poor navigation offered by the website, including navigation, structure of information, consistency and standards and visibility of system status.

 

Usability problems allocated

1. Bad navigation: The test person had difficulty in finding the name of the manager for the message central group (task 1) and a feature of SHOUT (task 2). This 

      initial hint of website navigation problems was highlighted in task 4.

2.Negative comments: Because of the navigation problems the test person vocally expressed the difficulties experienced out loud (task 1 and task 2).

3. Negative mood: Similarly these problems in finding relevant informed caused a noticed drop in the test person's mood.

 

Video-highlight

1. Navigation error: Task 1 (Write the name of the manager of the message central group), view

2. Success: Task 1 (Write the name of the manager of the message central group), view

3. Navigation error: Task 2 (Write one feature of Shout which is the web-based application designed to allow  media houses real-time interaction with their audiences), view

4. Negative comment Task 3 (Write the maximum number of persons allowed per team for the SMS code jam competition), view

 

Usability test of Ministry of Legal Affairs website

The following tasks were performed by a test person on the Ministry of Legal Affairs website.

Task 1: Write the cost for a certified copy of a document in the company’s Registry.

ANS: TT $20.00
Task 2: Open the form for Application for Computer Generated Birth Certificate.

ANS: The navigation path to the Computer Generated Birth Certificate is:

          Home >> Documents Center >> Civil Registry >> Application forms for Civil Certificates >> Application for Computer Generated Birth Certificate
Task 3: Write where you can obtain a marriage certificate.

ANS: From Marriage Clerk, Civil Registry - Registrar General's Department, Red House after banns are published

Task 4: Write the phone number of Intellectual Property Office.

ANS: 625-9972

Task 5: Write the documents required for Registration of a Newspaper.

ANS: The original name approval letter, Statutory declaration, Bond (if required)

 

observer

                                                                                                      Figure 3: Usability Testing Task Analysis - Ministry of Legal Affairs

 

 

1

2

3

4

5

 

N/A

Comments

     Visibility of system status

1

Is status feedback provided continuously (e.g. progress indicators or messages)?

DISAGREE

 

AGREE

 

     Match between system and real world

2

Are the words, phrases and concepts used familiar to the user?

DISAGREE

 

AGREE

 

3

Is information presented in a simple, natural and logical order?

DISAGREE

 

AGREE

 

     User control and freedom

4

Are facilities provided to return to the top level at any stage (e.g. links back to homepage)?

DISAGREE

 

AGREE

 

     Consistency and standards

5

Is the use of terminology, controls, graphics and menus consistent throughout the system?

DISAGREE

 

AGREE

 

6

Is there a consistent look and feel to the system interface?

DISAGREE

 

AGREE

 

     Aesthetic and minimalist design

7

Is the design simple, intuitive, easy to learn and pleasing?

DISAGREE

 

AGREE

 

8

Is the website free from irrelevant, unnecessary and distracting information?

DISAGREE

 

AGREE

 

9

Are icons clear and buttons labelled and is the use of graphic controls obvious?

DISAGREE

 

AGREE

 

     Navigation

10

Is navigational feedback provided (e.g. showing a user's current and initial states, where they've been and what options they have for where to go)?

DISAGREE

 

AGREE

 

11

Are any navigational aids provided (e.g. search facilities)?

DISAGREE

 

AGREE

 

     Structure of information

 12

Is there a hierarchical organisation of information from general to specific?

DISAGREE

 

AGREE

 

13

Does each screen comprise 1 document on 1 topic with the most important information appearing at the top?

DISAGREE

 

AGREE

 

 

1

2

3

4

5

 

N/A

Comments

                                                                   Figure 4: Usability Testing Task Analysis - Ministry of Legal Affairs

Results

The test person had could not complete task 4 (Write the documents required for Registration of a Newspaper). From the test person's feedback (Figure 4), low scoring questions are indicative causative factors in the overall poor navigation offered by the website, including navigation, structure of information, consistency and standards and visibility of system status.

 

Usability problems allocated

1. Bad navigation: The test person had difficulty finding the computer generated birth certificate (task 2), the phone number of the Intellectual property office (task 4) and

     did not find the documents required for registration of a newspaper (task 5).

2.Negative comments: Because of the navigation problems the test person vocally expressed the difficulties experienced out loud (task 1 and task 2).

3. Negative mood: Similarly these problems in finding relevant informed caused a noticed drop in the test person's mood.

4. General error: These errors were caused by the bad website structure and poor hierarchy of information.

 

Video-highlight

1. Navigation error: Task 1 (Write the cost for a certified copy of a document in the company’s Registry), view

2. Success: Task 3 (Write where you can obtain a marriage certificate), view

3. Navigation error: Task 4 (Write the phone number of Intellectual Property Office), view

4. Navigation error: Task 5 (Write the documents required for Registration of a Newspaper), view

 

Workshop | Timetable | Handout preview | Usability tests examples | Ordering | Participants evaluation | Photo gallery | Contact

UWI Usability Lab                                                                                   Usability test examples

Usability | Consulting | Facilities | Lab Capabilities | Study procedures | Workshops | About us | Home

international-flags
Revised: 17 August 2010