Guerilla Understandability Testing

What we did ?

After we developed the sequential flow of activities within the application through well-defined flow charts and sketching storyboards we carried out a guerilla test to determine the user ability of our application, based on their ability to navigate through the application and accomplish user goals.

The Guerilla Test Setup

The test was executed with a designer present taking important notes from the user while administering the test. The designer asked specific questions and received good feedback and also additional explanation where needed. Most importantly the users were allowed to “think out loud” to process the sketches and give logical reasoning for making choices or decisions to accomplish goals. The test was recorded and the team analyzed results.

Guerilla Test#1
https://drive.google.com/file/d/0B8nDbyWKpofid0NacTlZVFhYQmM/view?usp=sharing

Guerilla Test #2
https://drive.google.com/file/d/0B8nDbyWKpofiYVIyUnlaVUw1dUU/view?usp=sharing

Guerilla Test Findings
Generally the application paper prototypes were well understood by our users during the test. They were able to move from one user interface screen to another and perform actions with good reasoning and judgment. Most of the users were able to go through the application from start to finish with just a few exceptions
Observations

Problems found

1. Some users used the “done” button for the wrong function. They pressed the button
   before they wanted to switch to another menu (e.g. food, drink).
   
2. The users recognized that the edit button at the button of the home screen
   performed the same function as done because they both lead to the “MyOrder”
   screen where items could be also edited.
   
3. So of the users missed the specials menu and only went to food and drinks and
   proceeded to checkout.
   

Solutions /Changes
The team has decided that making the “done “button inactive before and order is placed and inactive if the ordered items are empty. Also the “done” button will show a popup message informing the user if he/she wants to proceed to checkout and only redirect to the “MyOrder” page.

1. The “edit” button will be removed from the home screen so that the users are not confused but the “edit” button in the “MyOrder” page will remain to help user remove items from their order.
   
2. We think that relocating the specials menu in a more significant location on the screen might increase the chances of selecting form the special deals apart from ordering only from food and drinks.
   

Card Sorting

Card sorting was the primary technique used to collect information about how our target group perceived the application architecture and giving use valuable data for improving it further.

This exercise was conducted for determining the finalized the architecture of the application that was initially designed. The results of this exercise served as input for rethinking the proposed hierarchical information architecture and make changes where necessary after discussion.

Card Sorting Test #1

Card Sorting Test #2

Final Ordered Cards

Card Sorting Results

In the card sorting we found out from users that one main menu wasn't clear as it barley represented the sub menu. So we decided to make that main menu to be sub menu and replaced it with a main menu that can represent all the sub menus. That is the only change we came to because users have easily sorted the cards.

	Group One	Group two	Group three	Group four	Group  five
Card 1: Alcohol	1	0	0	0	1
Card 2: Soft drink	2	0	0	0	0
Card 3: Juice	2	0	0	0	0
Card 4: Warm Drink	2	0	0	0	0
Card 5: Chicken	0	2	0	0	0
Card 6: Sandwich	0	2	0	0	0
Card 7: Burger	0	2	0	0	0
Card 8: Specials	0	2	0	0	0
Card 9: 5 beer 4euros	0	0	2	0	0
Card 10: 2 burgers + drink	0	0	2	0	0
Card 11:  Pay	0	0	0	2	0
Card 8: Cancel	0	0	0	2	0

Groups names: Drinks, Food, Specials, Add /Edit and an extra group created by the users Alcohol

To the highest extent the potential users arranged the information architecture as we designed. There was a slight difference. For example one users selected alcohol as a different rather than a sub menu to drinks. Another user have a bit difference in the add menu buying choosing pay as the main menu rather than a sub menu to the Add/Edit menu.

Easy Order app - Making the order

The Mc Donalds kiosk is the application we have as inspiration to improve ours.

Cloze Test Analysis

The Cloze Test

Based on the table above the majority of the users understood the test and performed it sufficiently. To improve the results of the cloze test we can test on a much larger group of target users. 

Decisions and Considerations 

In-App help:
We decided to use In-App help than manual because the application is not fully developed and the manual document is more of for the internal use by the clients. It is easy to understand for using the application and can be accessed very easily. 

Order Application

This video demonstrating how the application is for the different group of users.

Cloze Test

Cloze Test

This week we have created a close test from our online help manual for another group of selected group of potential users to perform the test and record the process. This will help us in improving our text in the manual and understanding how our users interpret it. The outcome will improve our user support and help for using the application.

GUI Test

GUI Test 1

In this test we selected three random potential users to use the application and to give feedback of their experience using our application. This was observed by video recording the users during the process.

Reports

Reports

First Test
In the first test we did with potenial users, we have found the following errors that need to be corrected.

• When users want to buy the same item more than one, there is no button to select more quantity.
• Users have complained about the font of the app.
• The textbox that shows Shop number have no use for users.
• Users have hard time understanding the balance left textbox.

Graphical User Interface

The Application

The Easy Order Application

What is it?
This is a festival  food ordering application that works like an online menu for products that exist in shop where users can place and pay for orders. This application  will assist the user in speeding up their order.