Test with Users - Think Aloud Approach - Vincent
We interviewed Vincent. Vincent is a 22 year-old young French engineer. As electronics engineer he really likes the realization of electronics staff (conception…) and he is found of music. He is living in Chartres. After having well-welcomed Vincent (offering him drinks and food), we have explained him what we wanted him to do and giving him the questions sheet. We have explained the principles of this interview and have tried to make him feel comfortable. Vincent was very patient and open-minded. He read the instructions and then opened the application. He began by interact with the application as he liked without following what was asked in the instruction sheet. We have put Vincent’s impression in the order he declared them to us.
First page: The first thing Vincent did was to read the part with the ‘?’. He said: “I am new I want to read the documentation”. Then he said that he couldn’t understand a word because he has no knowledge of Latin and was disappointed by keeping the same level of knowledge about our application even after reading (or trying) to read the documentation. He said he was lost. He was surprised to find a FAQ. For him the question mark is the symbol of a help page not a FAQ. He was wondering how one could create a page. My settings: Then he decided to see the settings page. He said there was no feedback when he clicked a button there are no changes. My General List: “On the object there is the ‘hand’ I thought that would mean I can click on it but I can’t”. Change Wish: Rating: “Why are the starts filled by default? To my mind this is not logical I would have done the contrary.” Spelling mistake: New Wishà Co-worker’s list Add Wish: Not working. I can add but I can’t see the wish I have just created. Why when I enter something I have to erase letter by letter the default text? It should be selectionable so I could erase that more easily. General List: When I click on it I would like to go back or see something Categories: What are they for? Send email: It stays when I click on it No addition of wishes possible When I delete a wish it is always there in the list “Show as list”, it did not disappear. New Wish: The only way to go out form this menu is to add the wish. It could be useful to have the possibility to click nearby and do something else in the same time. No new list addition possible I can’t choose the name of the list I want to add I can’t select the different lists My connections: I can’t click on the different groups. When I choose someone’s list: Group gift is not working Others people? It is complicated. I do not understand. Oh I see it may be the people who want also the gift. No return button to go on the previous page. Others people? Are these people on my list also? Are they using the software also? Do they want the same wish? Add to my friends? Why not add to my co-workers? There should be a problem with the name. Shop: It’s cool, I can have the price. Closing is possible. Take it/ Don’t take it: I do not understand. It should be added to my wishlist. The frame is not well done in make a grouped gift. I can’t click on the persons. Go Home: super The Design is cool but I am wondering what will happen if there are many persons in the list and plenty of connection, it may lead to a mess. Then after browsing the application according to his desires, Vincent has taken back the instructions sheet to read again the question and looked and tried them one by one. Rating: It is possible to remove one on two stars. It is not good for readability. My connections: No opportunity to add a new type of connection. Why not taking back the left rectangle which is in the general page to offer some options (maybe change the view)? The tree is not clear enough. The persons related to Thomas are not linked to me. Why are there empty circles? I would like to add someone. When I click on somebody, I do not have the same operation as in the general page. I mean a big circle with options. I can’t go back! There is a bug: Make a grouped gift then I click on go to my home, the window group gift does not disappear. Search in Group gift: It is possible to enter the name but near the zone to fill there is no ‘search’ or ‘go’ button. To close the window I am forced to accept. Why not putting a close symbol (cross)? Make a group gift: Not the same design as the other pages. The pop up window has the same problem. Show more option is ok. Take it? What does it mean? To buy it for the person or for me? Oh I think it means to buy in order to make the gift. No problem Categories It is not possible to see in which category an object is. General impressions: Vincent is a very patient and conscientious person. He has taken the time to test the prototype. In general, when he sees a new thing he tries to click on everything and see what will happen. He seems like an average or even an expert user. He knows precisely what he expects form a window or an option. |
     |
