Tuesday, October 23, 2007

User Constructs in e-Learning

The reason I was in Beijing in the first place was to present a paper at the Computers and Advanced Technology in Education Conference, CATE 2007. The paper was titled “The Impact of User Constructs on e-Learning Effectiveness Using the Repertory Grid”, reporting on an experiment that one of my students did. It was to study the frame of mind of users of e-Learning systems, i.e., how do users perceive the different functions provided by such systems? Why do they like or dislike certain functions?

We showed the users various items in combinations of 3 at a time, and ask them which 2 among the 3 are most alike and which one is most different from the other two. Using this method we tried to understand the criteria/dimension (construct) that the user employs in the evaluation of the items. For example, a user may find car and train to be alike because they are machines, while horse is an animal. Another user may find horse and car to be alike in terms of carrying capacity, while train carries much more. By showing the functions provided by e-Learning systems in triples to the users, and studying their responses, we hoped to understand the “constructs” that the users use to interpret/evaluate the functions provided. Each construct represents a possible “dimension” in which a function can be evaluated.

In our experiment we found 11 such constructs, and we further consolidated such constructs into 2 major dimensions. One of which is “more focused and consolidating knowledge” vs “not stimulated, motivated, and boring, useless”. Another is “help to explain problems and through interacting” vs “have to take initiative to solve problems, not helping as there is no interaction/stimulation”.

Finally the common functions provided by e-Learning systems such as WebCT are evaluated by placing them in a Cartesian coordinate system formed by these two dimensions. According to our study, the best function is the bulletin board/discussion forum. The scale of this project is too small to draw much conclusions from. But it does demonstrate one way to study systematically the “usability” of e-Learning systems, and in fact, information systems in general.




5 comments:

an old friend said...

I tend to go to forum for an answer rather than going through books and manuals. The reason is what you can find in the forum are usually more practical and direct. You can also look for similar experiences. And there are always some nice guys who are willing to share with you how they struggle and learn through trials and errors and how finally the problem is solved.

StephenC said...

I feel the same way. And I tend to use the forum as well as the content pages the most. Students, of course, cannot post onto the content pages. Hence to them it is a one way function and not very interactive.

Anonymous said...

Its like you read my mind! You seem to know a lot about this, like you wrote the book in it or
something. I think that you could do with a few pics to drive the message home a bit, but other than that, this is
excellent blog. A great read. I will certainly be back.
My web site: online casino website

Anonymous said...

If you wish for to take a great deal from this paragraph then you
have to apply these methods to your won weblog.

Here is my web site; mediawiki.ske48fan.info
Feel free to surf my blog :: discount dental plans

Anonymous said...

This is a topic which is close to my heart... Many thanks!
Exactly where are your contact details though?

Here is my webpage :: sims