Collaborative auto-ethnography – an antidote to big data in MOOCs?

Firstly, thanks to @helencrump for the title of this post. The alternative title was ‘#oldsmooc – the MOOC that keeps giving”. But I think Helen’s one sounds much more impressive 🙂

I’m not quite sure where I’m going with this post but there was a flurry of activity on my twitter stream last night/this morning and I just wanted to try and capture some of the ideas that have been floated.

Regular readers of this blog will know that a group of #oldsmooc-ers recently presented a paper at the EMOOCs Conference, called “Signals of success and self directed learningwhere we took a collaborative auto-ethnographical approach to create a range of narratives which described our different measures of success in participating in the mooc.  We felt that this personal reflection would help to address some of the gaps in understanding what actually motivates learners in MOOCs and probably more importantly for us as a group to explore the extent “connection, self-efficacy and self-directed strategies facilitate learning in a MOOC”.   As a self selecting group we were very conscious that we could not ensure our narratives were typical of other leaners on the MOOC, but we did try and collect some more data from other participants.  I have tried to document the story of our collaboration, which has been a key  signal of success for us all.

Getting the paper accepted was a great moment for us all, as was the conference presentation and tweets it generated.  We were still unsure if our approach and methodology really had any traction.  But last night Paige altered us all to this bit of activity on the current #rhizo14 MOOC.  Again through connections and network (aka some of our group taking part in another mooc) it seems our ideas and approach are being explored by other learners.

I think this is really important.  We know that existing accepted educational metrics don’t really apply in the MOOC context, particularly for retention. Despite the promise of MOOCs and big data being able to give us insights into how people learn, I, like others, am still not so sure about some of the methods being used and in turn the patterns that are emerging. As well as the quantitative data, we need to get much more qualitative data exploring as many different narratives as possible from learners. It’s only by doing that that can we really start to help develop our understanding of how people define success in MOOCs. And in turn, we can ask more challenging questions of/from the quantitative data.

Being a bear of very little brain, I like seeing the pretty patterns and swirly diagrams, but find it confusing when they don’t seem to relate to my own experiences.  Mind you,  if this article in the Sunday Observer is to be believed we won’t need to grapple with big data -v – little data -v- educational theory for much longer as soon the google robots will have worked it out all out for us and will have “fixed” education.

My experience of learning on MOOCs has been very different from my traditional educational experiences. I know I didn’t (and still don’t really) enjoy formal education, and I am much happier (and hopefully more creative) in connected, loosely structured learning experiences than read a bit, do the test, read a bit more ones.

Anyway below is a collation of the tweets from last night this morning, which range from us being all “check us out with starting an auto-ethnographic revolution” to more serious questions about the nature of open collaborative spaces, self disclosure and the importance of failure. On the last point, Pat Parslow referenced the “confessional” booth at the PELeCon Conference, which again got me thinking about the use of the language of guilt around what are perceived to be non traditional ways of doing things. But that’s probably a post for another day.

Cloudworks, purple dots, tea and biscuits (Warning this post contains references to MOOCs) #emoocs2014

How do you measure success on a MOOC? It’s a question that has been causing a lot of consternation as our traditional measures of success in education don’t seem to apply. Large drop out rates, challenges of assessment at scale, I don’t really need to go into all the details, it’s documented by others far more eloquently than me.

However, despite my unsuccessful attempts in many MOOCs I have managed to complete a few (4 now!).  They all have been successful learning experiences for me. I got a certificate for one of them, but nice as they spacemen are on it, it isn’t really my biggest signal of success. As I blogged about before, it’s been after the MOOC  that the really collaboration and reflection on success has begun.

This week at the EMOOCs 2014 Conference my colleagues Paige Cuff and Helen Crump are presenting our paper Signals of Success. Now having a paper accepted for a conference might not be your measure of success for a MOOC, but for me, Paige, Helen, Penny, Briar, Iwona and Yishay, actually pulling of this international collaboration has been a real triumph.

You can see a pre-print of our paper and some more information here.

And if you are wondering where the title of this post came from, this twitter conversation will give you a clue.

css.php