Tag results

Usability testing for Wikimedia... right now!

(Worrying about) Usability seems to be all the rage in Wikimedia at the moment. I think it’s an important thing to worry about, but we have this problem that we are unable to tell and often even guess, how our projects are perceived by people not already familiar with them.

One quick answer might be Feedback Army, a recently created little service that employs Amazon’s Mechanical Turk workers.

I decided to give it a spin for some aspects of Wikimedia Commons. For US$7 for 10 responses, why not? I sent people to look at Image:Easter_Island_map-en.svg, which was yesterday’s Picture of the Day. Here’s the instructions I gave them:

This is testing the usability of the site, not your ability. If you can’t find the answer to any of the questions, that is itself a valid answer.

  1. What is this a picture of?
  2. Who created this picture?
  3. What file format is this picture in? Is there anything special about it?
  4. Has this picture been judged to be a good one or not? How can you tell or not tell?
  5. How many versions of this picture have been uploaded? By which users?
  6. Would you be allowed to use this picture to create a paper map for sale? How can you tell or not tell?
  7. What date was this page last edited?

And a few questions about you:

  1. Are you male or female?
  2. What is your age?
  3. Have you ever edited a wiki before?

#1 is a gimme to make sure they’re sensible people. #2 is asking people to find the “Author” field in the description below the image. #3 was partially just curiosity about people’s awareness of SVGs, although most respondents picked up on the template:translation possible.

#4 is about the FP (featured picture) and POTY (picture of the year) markers. #5, as a couple of respondents noticed, was ambiguous — unintentionally on my part. I was actually referring to different uploaded versions present under the “File history”, but different translated images are listed in a section called “Other versions” so that was poorly worded on my part. 5 people responded about the translated images, 3 about the file history section, 1 pointed about the ambiguity and 1 didn’t respond.

#6 was about the Creative Commons BY-SA license. Partly it tests if they can locate that information, and partly it tests if they know (or can quickly find out) what that means. So partly it is a test of Creative Commons’ marketing I think. :)

#7 is one that is intentionally a bit confusing. The last version of the image uploaded was at 23:43, 22 October 2008, which is available directly on the page, but the time the page was last edited has to be found from the History tab. (It is 22:11, 24 November 2008.) Exactly half of respondents picked each answer, October or November.

#8, 9 and 10 are just basic demographics.

You can read all the responses on Feedback Army, or better read responses as a spreadsheet that I put together in Google Docs.

So these are just some very quick checks. Other interesting things to check would be if people can navigate and understand history pages, navigating categories, and then obviously editing and uploading.

What questions would you ask? Would you change any of the above questions?

04 December, 2008 • ,

Comment [2]

wikimedia commonswikipedialinkscommunitymediawikiconferenceslinux.conf.auwmfcreative commonswikimaniapoty2008australiawikimedia chapterswikimedia australiavideo
(see all tags)

free culture


...& other free content projects

interesting folk