But hold on, because I think I've figured it out.
Let's make a comparison. A great deal of work goes into the production values of video games, particularly the big, 3D action games, and yet the ultimate success of games is actually determined by game play. Production values may attract initial purchasers, but if a game fails to engage as a game, then the word will soon get round and the product will bomb. As a result, the upmost care is taken to fine tune the gameplay to ensure as individualised and authentic an experience as possible for every player. In fact, much to the regret of some of the big game studios, production values can be comparatively low - as with most so-called 'casual games' - and yet succeed fantastically as long as the game is fun to play.
Another example. Hollywood spends tens, if not hundreds of millions of dollars, on the production of major feature films. With the most expensive films, production values are at an extreme high. Yet, as we have seen time and time again, what actually determines a film's success is its plot, characters and dialogue.
So, how is it that, with games and films, success is ultimately determined by the intellectual effort put into the design of products that provide a satisfying user experience, whereas with e-learning this doesn't hold true? The reason, I believe, is that games and films operate in a market with an effective feedback loop between producer and consumer. Selling e-learning, on the other hand, as I've remarked several times on this blog, is like selling dog food - you sell to the owner, i.e. the employer, rather than the dog, a.k.a. the learner. With e-learning we have a market failure, because there is an inadequate feedback loop from learner to producer. When employers purchase an e-learning product or engage with a developer, they choose on the basis of production values rather than learning design, because they have neither the time nor the inclination to test out materials with real learners.
Where do you see real effort placed on the design of intelligent, individualised learning experiences? Well, it's much more likely to come when the provider is engaging directly with the learner, as with the Kahn Academy or the open courses provided by Stanford University (see my post on Massively Scalable Training).
Assuming I've correctly diagnosed the problem, I've still no idea what the solution should be.
Hi Clive. I think the solution might appear, when SMEs will make an e-learning content on their own. Like Khan does. I don't see any stronger and more effective feedback loop between producer and consumer. Maybe this is an illusion but...
ReplyDeleteYou have made wonderful and insightful comparisons. I agree with most of what you say that the process of learning is as important as the learning itself. Technology should play a supplementary role.
ReplyDeleteAgreed. We need Tripadvisor for elearning! Failing that, as purchasers / owners we can implement feedback loops for ourselves. I have a generic 'value for time' metric that automatically sends to people one month after a significant, formal learning intervention that simply says "One month ago you completed [intervention] name. In retrospect, was it good value for you time?" and it gets them to rate between 1 - no, I haven't done anything differently through to 8, yes I am now gaining benefits that far outweigh the investment of my time.
ReplyDeleteSome interpretation of the statistics is required, but ultimately it has helped me to identify a few dead dogs at which point I've been able to investigate as to why the elearning or other intervention isn't leading to sufficient benefits.
Often of course it's because there are other factors that preventing people from gaining the benefit of the learning, eg there are disincentives to people applying the learning and no incentives, in which case those issues need to be tackled. But equally as often it's because the learning design is flawed, in which case I can tackle the supplier of that learning.
Hi Clive,
ReplyDeleteYou have touched on an issue of interest to me. I have encountered several barriers around trying to access students:
A perception that the learner does not know what they want.
A perception that the programme designer always knows best, without attaining proper qualatitive feedback. Which leads me neatly onto...
The lack of 'meaningful' and timely feedback. There is also a further issue here that in corporate training students sometimes just want to get the certificate and are not really engaging with the material.
On top of this, I think there is a fear factor around facing feedback from the student.
Paul