Skip to main content

Interaction in Distance and Online Education: A Research Review

In 2014, I was honoured to be invited (with my wife Susan) to be a visiting scholar at Beijing Normal University (BNU). BNU is arguably the preeminent research university in distance and online education in China.  One of my commitments during this visit was to create a review of the thorny and complex topic of interaction in distance education.

As anyone researching distance and online education and many readers of this blog will know, interaction leading to active and engaged learning is a pivotal topic for teachers, learners and institutions. Interaction is multi-faceted (many actors, many modes) but also expensive in terms of student and teacher time. Thus, there has been a wealth of research on the topic during the 40 years that I have been an active researcher and teacher.

Thus, with no apology for the length, I link here the final 44 page review. Most obviously it is 7 years out of date, but I think distance education researchers and teachers  will find something of value in the extensive research and references noted.  Ironically when I returned to Canada I submitted the review study and was told it was published in China, However, I didn’t bother to promote or publish the review myself.

Fortunately, Grad student SCOTT A. HAUERT, saw the review in Chinese and asked me to make it available (in English)!  I attempt to rectify this mistake by posting the review here under a Creative Common Public Domain license.

The full Research Review is here

I post below the table of contents:

Emergency Distance Education

Each day brings news of more cancellations of social events. In many areas schools have closed and it seems as likely as not, that many campus based schools will be closing for ???? days/weeks.  This is the black swan event that most financially pressed colleges didn’t really have the energy to think about. But now it is upon us.  This creates both opportunity and challenge. In this post provide personal recommendations for an emergency move to online education.  The unprecedented opportunity to learn from a crash course on distance education in a networked era.

All of these closures has resulted in many posts designed by pundits, institutions and companies offering advice to teachers scrambling to very quickly move a course on line- in the middle of the term.  See for example Tony Bates’ Advice to those about to teach online because of the corona-virus or  Stephen Downs’ Quick Tech Guide and Cornell’s University’s Preparing for Alternative Course Delivery during Covid-19.   The challenges of going online VERY quickly are not unrelated to the task of “Building an Airplane in the sky” as documented in the famous EDS advertisement!  Thus, I add to the list of advice columns with the post below.

The good news is that digitization is already in place across most campuses – likely both students and faculty are enrolled in an institutional Learning Management System (LMS) – (if not this should be a top administrative priority) or an institutional wide network on Google or another provider.  There are a host of private and open source environments that would likely jump at the chance to host your course – perhaps even for free. Doing so is likely a very bad idea – unless there is absolutely no institutional system to safeguard emails, recordings and confidential marks. This is NOT the time to blazing innovation on the latest social software platform.  Rather it is a time to get a course up running very quickly.

You can think of your course on the LMS as your own mini learning environment or classroom. When you think of the activities that go on in your campus classroom now, try to find a tool that allows you to meet that same, or very similar learning goals and learning activities – only online.  For example, if you regularly use student presentations you can teach students how to be presenters on a webconference or to record and then share videos they can make with their phones.  A good place to start looking for tools is the tool library in your MOODLE, BlackBoard, or Canvas LMS. It likely has tools for small groups discussions, quizzes, blogs, micro blogging, collaborative writing, gallery of photos and more.

Some wealthier and larger institutions may have classroom lecture capture systems that can be used to record your lectures,  Oh yeah –  your campus is closed. A simpler idea is to record a video – at home using your laptop with the built in microphone.  This does not yield high definition television quality video – but it works.  Again if you are lucky your institution has a contract with a video streaming service- if not you can always use YouTube.

These recorded and streamed videos of course are available 7X24, but watching video doesn’t have the same engagement and commitment value that arises when class and teacher gather online in real time.  Especially, if you are taking an existing campus course online, a great tool to use is webconferencing.  Web conferencing supports the real time presentation of content that defines many classrooms. However, in addition it supports student break out groups, text discussions, comments and questions and a host of quiz and drawing tools.

In education we have a long history of video conferencing (as distinct from webconferencing) courses. These courses using dedicated classrooms and very expensive technology – most of which was prone to breakdown.  Current web conferencing tools like ZOOM, Adobe Connect, Big Blue Button and others can overcome many of the restraints of older technologies. These systems are great for classes up to around 60 students. The technology itself may scale beyond 60, but managing large lecture theatre takes more skill than seminar or classroom sized groups.  Do remember that all of the students will likely not show up for each scheduled class.  This is fine as you can record the interactions, and they can replay them when they wish to do so.

Cornell teaching communications chart

In the screen shoot above from Cornell University you can see how only three tools (Canvas LMS, Zoom webconferencing, and email),  that are readily available to all teaching staff, can cover almost all the communications demands of a quality online education.

When designing and talking about online courses, I often think of the Community of Inquiry Model (COI) developed by Randy Garrison, Walter Archer at the beginning of the online course era. The strength of the COI model is its simplicity and capacity to act as guiding heuristic for online teachers.  The model suggests that quality learning happens when three educational components (teaching, social and cognitive presence) are present in the online environment.

The-Community-of-Inquiry-CoI-Model

Community of Inquiry (COI) model

In an emergency online course, it is important for the teacher to quickly develop and nourish teaching presence. This means being present and especially in the first few days or weeks to be online daily. Second is to insure continuity of the course by posting dates and learning tasks for the remainder of the term.  Although many courses run asynchronously, a great way to kick start teaching and social presence in an emergency course is with a real time class, using webconferencing tools described above. At minimum, the teacher should record a video, explaining how the course will continues in the near future.

Social presence creates a sense of security, support and humour.  It is done by providing a space for students to meet and greet online, to ask questions, to chat about concerns with each other – as well the professor. The LMS is well developed to handle this informal interaction  – think of causal conversation outside the physical classroom as well as creating a comfort zone where students can readily ask questions and express concerns.

Finally cognitive presence is the reason the course continues.  The teacher stimulates cognitive presence by creating dynamic presentations, asking triggering questions for both individuals and small groups, monitoring interactions to clear up any misconceptions and challenges students to find ways to create applied knowledge from the information they are acquiring in the class.

Emergency courses often don’t have the luxury of time to create new content. Thus, the savvy teacher quickly checks out available open educational resources, that can be incorporated into the course. Teacher’s often think of OERs only as open textbooks and indeed, there are thousands of open text books available for free download and editing. In addition, there is a growing number of simulations, games, lab exercises, videos and graphics free for the asking.  If you are fortunate there may be a dedicated OER support unit on your campus that you can contact for help finding resources. However there are many OER repositories and George Mason University runs a free OER Metafinder searchable data base.

The coming months will see lots of uncertainty and financial challenges for many, however these viruses tend to come and eventually to go.  Hopefully the experience, for both students and teachers, will provide a healthy does of online education literacy.

 

 

New Book from AUPress – An Online Doctorate for Researching Professionals

New Book from AUPress – An Online Doctorate for Researching Professionals

coverI was pleased to receive in the post a hard copy of a new book in the Issues in Distance Education book series, for which I continue to serve as the series editor. Now of course you can read all of the books in this series as they are available for download  under Creative Commons licensing. But it is nice to hold paper copy and a purchase ($39.95 Can.) makes the press and the authors happy (think $$$).

An Online Doctorate for Researching Professionals: Program Design, Implementation, and Evaluation by Swapna Kumar and Kara Dawson  is a great book on a very hot topic. I would characterize this monograph as a scholarly case study. This means that it is in large part a detailed explanation of a 5 year old Education Doctorate (EdD) program from the University of Florida.  The book begins with a historical review of function and form of the doctorate program in Universities. I was surprised to hear that the very first Doctor of Education program was begun here in Canada at the University of Toronto. But it was soon followed by many doctorate programs – in professional subjects such as medicine, dentistry, law and of course education.

Kumar and Dawson make the point that a professional degree(s) exists to train professionals to make contribution and conduct research into the profession and to the citizens that they serve. It was not then, and is not now, designed to train students to be full time researcher scholars nor faculty members at Universities – this is what the PhD is designed for.  This all makes sense EXCEPT that the public and many students perceive the PhD to be a “better’ degree, so the pressure from students, the public and the Universities to move towards offering PhD programs- regardless of the need of either the academy or the profession.

I note the topic is hot, not only for this contention of what a professional doctorate is, how it differs from a PhD but also because of degree inflation. Many professionals desire (or are required) to have the advanced training and the status of a doctoral title. As noted the professional doctorate in education is hardly a new degree, but at least when I began doctoral studies in 1987, there were no EdD or PhD programs available in Canada that one could complete without ‘residence’ attendance on campus.  The EdD program that I worked in and helped design at Athabasca University was one of the first to enter this domain, but it was soon followed by many other programs including the subject of this case study.

The first thing I did after opening the book was jump to the chapter “Dissertations in the Online Environment”  The dissertation is a defining characteristic of any doctoral program and the most challenging to deliver, to support and to complete.  It is not particularly difficult to design a program of courses  that are delivered online or that use some blended approach. But the dissertation process is individualized. This  not only challenges the student to design and undertake quality, original research but also challenges the faculty as a great deal of one-to-one support and mentoring is required of the supervisor and then a committee of examiners.  The economy of scale of courseware all of a sudden disappears and faculty can be overwhelmed with the work- especially as the number of candidates/faculty creeps into two digits.

The book is chock full of examples of ‘good practices” and a description of the research tools used to validate them that emerged and were implemented in the UF program.  I should be pleased to note that the pedagogical approach is grounded in Randy Garrison, Walter Archer and my- Community of Inquiry model – with the addition of Shea’s ‘learner presence’. In addition the program focuses on building community (and measuring it using Rovai’s (2002) community instrument. However, these days I am more intrigued with ways to develop self-directed and self-driven learning programs.  But perhaps that is too much to hope for, given the intense context and content to be mastered and the high expectations of doctoral studies. Indeed, the authors provide a quote from one student who notes that they were prepared for the intellectual rigour of the program, but blown away by the “opportunity to work alongside such incredible peers that has been more rewarding and fulfilling than I could have imagined.”  This intense community benefits (and is nurtured) in an entry ‘boot camp’, annual F2F meetings and regular synchronous and asynchronous classes.  Perhaps the search for  of a recognized, self directed, self-managed, MOOC-like doctorate is Quixotic!

To summarize, this a great text and I am proud to see it added to the AUPress Issues in Distance Education Series.  It is a scholarly exposition of an innovative doctoral program and as importantly it validates the findings with survey, completion data and examples from the cohorts. It also serves as fine example of the type of study and reflection that should accompany all new educational innovations.

Congrats to Swapna and Kara!

What the FOLC is new in this article?

What the FOLC is new in this article?

Sorry, but I couldn’t resist spoofing, in the post title,  the unfortunate sound of the acronym for the “new” model proposed in this article. Now,  I’ve got it out of the way and can only suggest that if this “divergent fork of the Community of Inquiry model” is to survive, it needs a new English acronym.

This post is a critical review of  Democratizing digital learning: theorizing the fully online learning community model Todd J. B. Blayone, Roland van Oostveen, Wendy Barber, Maurice DiGiuseppe and Elizabeth Childs. International Journal of Educational Technology in Higher Education 2017 14:13
DOI: 10.1186/s41239-017-0051-4

First, let me get out the good things about this article stated. I love the fact that the authors published this in a peer reviewed,  Open Access journal (thanks to Roland van Oostveen for noting an error in my original post) . Second I love articles about the now venerable Community of Inquiry model because it is flattering to see this work live on, nicely adds to our citation rating indices and  because I share with Randy Garrison and Walter Archer an ongoing interest in constructivist models for online and blended education. And finally, as always conceptual arguments and calls for research are welcomed – especially if they follow with real research results!

First in a number of concerns with the paper. The basic claim is that the Fully Online Learning Community (FOLC) is a “divergent fork of the Community of Inquiry model”.  It seems the divergent claim is made on the basis that the revision is for FULLY online courses.  In fact no divergence is needed or called for as the original COI model was always based on fully online courses – blended courses – or at last the name hadn’t been invented in the 1990’s when we developed the COI model.  The authors may argue that the divergence stems from the integration of synchronous and asynchronous discussions. The original COI model was grounded in asynchronous threaded discussion, as the Internet did not support synchronous interaction in those days. However, Randy and I had been working since 1989 on synchronous delivery models based on group teleconferencing, (see  for example Anderson, T., & Garrison, D. R. (1995). Transactional issues in distance education: The impact of design in audio teleconferencing. American Journal of Distance Education, 9(2), 27-45.). We certainly thought the constructivist underpinnings of the COI could and would support synchronous communciations as well.

Second, is the claim that FOLC “responds to the limitations of distance learning and MOOCs (e.g., student isolation, low completion rates, etc.)”  and “the needs of transformative and emancipatory learning” and “responds to requests from some international partners for new models of learning aligned with democratic and socio-economic reforms. Both Randy and I had long argued and published about the need for distance education to use technologies to get beyond distance education, as perceived as one-way content dissemination to “education at a distance” based on social construction. Thus, the ‘new’ FOLC adds nothing new to our initial claims and desire to supplant individualistic models of correspondence models of distance education.  MOOCs and especially cMOOCs are much more than mere content dissemination as decried by these authors. Finally, the COI was and is a response to the need for new models of learning and the needs for emancipatory learning.  The only claim that is true is that the COI didn’t directly respond to the need for 21st Century learning competencies -mostly because these hadn’t been invented when we developed the COI model. Moreover, these newer ideas certainly fit within the original COI and its development and support by thousands of researchers in the past two decades.

The authors present a “revised model” as below

I can’t see anything new here beyond the original three presence Venn diagram of the COI model.  Both note the collaborative learning environment, both have social and cognitive presence and teaching presence is assumed in the organization and management of the digital space as the FOLC model (like the COI) is based on formal, institutionalized education.

The paper then goes on to provide conceptual scaffolding for a number of tending educational related theories or ideas – digital space; democratized learning and collective identity and responsibility, community and authenticity.  I don’t have any problems with these conceptual arguments and they could each be used to update and strengthen the original COI model. I really don’t see anything new here except for the inclusion of references and arguments that have developed since the COI model was first introduced.

The article then goes onto to propose a research agenda which is little more than a wish list of things that could or should be researched. We criticized this type of rather adhoc model of research agenda development in our Stöter, J., Bullen, M., Zawacki-Richter, O., & von Prümmer, C. (2014).  From the back door into the mainstream: The characteristics of lifelong learners.  In O. Zawacki-Richter & T. Anderson (Eds.), Online distance education: Towards a research agenda (pp. 421-457). Athabasca: Athabasca University Press. But again, nothing wrong with this list of things to do, but nothing new either.  Finally, the authors invite others to join them in this research process – all good stuff but….

I don’t think there is enough new here to claim a “divergent fork” merely by strengthening the original argument.

The Enigma of Interaction

The Enigma of Interaction

I’ve been fascinated by the role of interaction all of my career as both a student, a researcher and a teacher. Michael Moore’s famous article details the role of  the ‘big three’ (student-student, student-content, student-teacher) interactions and influenced Randy Garrison and I to explore the other 3 possibilities (teacher-teacher, teacher-content and content-content interactions).  I’ve written a number of summary articles, a recent article on interaction in MOOCs  and note that interaction serves as the primary indicator of ‘presence’ in the Community of Inquiry (COI) Model.

anderson-learner-teacher-content-theory-p58

Many, many research articles have shown significant and positive relationships between interaction and a host of outcomes including persistence, achievement and enjoyment. However, these studies are almost always correlational and sometimes based exclusively on student perceptions. These are useful methodologies but marred by challenges of proving causation. Did the interaction cause the positive outcomes (causation) or do motivated students both interact more and get better marks (correlation)?

Thus, I was pleased to see an interaction study in the latest issue of IRRODL that used a quasi-experimental study to examine the impact of student-teacher interaction. The article:

Cho, M., & Tobias, S. (2016). Should Instructors Require Discussion in Online Courses? Effects of Online Discussion on Community of Inquiry, Learner Time, Satisfaction, and Achievement. The International Review Of Research In Open And Distributed Learning, 17(2). doi:http://dx.doi.org/10.19173/irrodl.v17i2.2342

The study was set in the context of a US undergraduate, fully online course with between 25-30 students in each of three sections taught by the same instructor. In the first instance there was no discussion. In the 2nd, the teacher posted a weekly discussion question and students were obliged to post at least one answer and one comment per week (typical forced participation that brought down the wrath of friend Jon Dron in a recent post). In the final section the teacher actively participated in the weekly discussions. In all cases the teacher was readily accessible via email.

A strength of the study was the multiple measures of interaction effects. These included:

  1. completion of the COI Inventory – a Likert-scale, perception instrument derived from the original indicators of teaching, social and cognitive presence).
  2. Student satisfaction measured by 3 lLkert questions
  3. Time on task as represented by login time to the LMS
  4. Student achievement as measured by final grade. The authors wisely excluded the marks for participation awarded in instance2 and 3.

Perhaps the least surprising outcome was that perceptions of social presence were significantly different with, as expected, higher perceptions of social presence in the more interactive instances. Also not surprising is that teaching presence increased in the 3rd instance, but not significantly.

The results became both interesting and surprising on the final 3 measures.  In each of the three course sections, each with markedly different amounts of interaction, there were NO significant differences in terms of time on task (logged into Blackboard), student satisfaction or student achievement. There was a small (but not significant ) increase in student satisfaction in the 3rd instance with enhanced teacher participation.

The discussion section of this paper is also very good. They note that time requirements for participation required in the forums in instances 2 and 3 did not end up costing students more time – at least as measured by Blackboard logins.  Finally, they note the obvious – teacher participation did not lead to increased achievement – despite the assumed time commitment required of the teacher.

These results tend to reduce support for the importance a number of the types of student and teaching presence described and promoted in the COI model. But the results provide support for the ideas I promoted in my Interaction Equivalency Theory.  I proposed there that given high levels of one of the three levels of interaction, the other two could be reduced without loss of academic achievement.  I also noted in my 2nd thesis of that work that likely increased satisfaction would results if more than one of the three forms were used (in this study, there was an increase but it was not significant in student satisfaction across the instances) but that it would come at increased cost (usually time to both teachers and students).

The study also did not look at attrition, perhaps because the numbers were small. I know from experience at Athabasca, when teaching and peer interaction is drastically reduced in self paced and continuous enrolment designs, that attrition almost always increases.

This excellent study concludes with recommendations for practice which include the note that student-student and student-teacher interaction are just choices and shouldn’t be considered to be hallmarks of all online (or classroom) courses. Good learning design counts!

A Fourth Presence for the Community of Inquiry Model?

A Fourth Presence for the Community of Inquiry Model?

The Community of Inquiry has emerged as the most widely referenced (the seminal 1999 article approaches 3,000 citations) and arguably the most widely used model for constructivist based e-learning design and research. I’ve always thought that it’s greatest strength is its simplicity (only 3 major, but interacting components) and the way the model can readily be used by teachers to devise and evaluate online learning courses and by researchers to guide the development of research questions and data collection strategies.

In the late 90’s we were interested in showing empirically that emerging ‘new’ forms of interactive distance education could support the type of high quality learning that is possible (though certainly not always available) in classrooms. We wanted to provide evidence for Randy Garrison’s claim that this was a new mode of teaching and learning that was education at a distance – not high tech, traditional cognitive behavioural style distance education. Thus, we focused on a key component of constructivist learning –social presence. We also picked up on Randy’s earlier work (based on Ennes, Paul and Lipman’s work) on critical thinking to devise the phases of cognitive presence. Finally, though Walter Archer, Randy and myself were all active in informal adult learning, we realized that the activity we were focusing on took place in institutional contexts with students studying in degree programs. Thus, we wanted a focus on the critical design, facilitation and subject matter expertise components of teaching presence.

Perhaps we quit too early, as this post argues next, but we had created a parsimonious model that was easily illustrated in the now famous COI Venn diagram. I also recall the fluidity with which new indicators were added to each of the presences as we poured over the transcripts from asynchronous computer conference based courses.   In early days, it was easy to add, delete or reword indicators, but the three presences seemed to us then to account for all the major themes of successful online courses. A special call out here to Liam Rourke who worked as a graduate student on this project, and was responsible for much of this early identification and classification work. The COI work was especially enhanced with the development by Ben Arbaugh and colleagues of the COI survey, which made it much easier to gather perception data to measure each of the three presences.

We have never argued that the model identifies all possible components of successful formal education – either online or in the classroom. And perhaps not surprisingly, it wasn’t long before additions (and a few deletions) were suggested. For example, David Annand, (2011) suggested that social presence wasn’t really needed for effective teaching and learning.

A number of researchers picked up on the need for the contextual or interface “presence” and in the case of distance education for the participants to master the mediating technology. Gilly Salmon (2000) in her famous 7 step e-learning moderation model sees such technical support as a key component of each of her moderation steps. I was never that impressed with these arguments as every context – including classrooms, uses some combination of asynchronous and synchronous media to support teaching and learning. Thus, the “presence” of the media and the need for and skill with which teachers and learners adapt to it is a minor factor that is unique to each teaching and context and I thought would needlessly complicate the COI model.

First came the close to convincing arguments from Peter Shea and his colleagues that the COI model lacked awareness of the critical role that the learner plays in formal education. We all realize that the same learning context and interventions can affect different students with vastly different effect. Thus, Shea and Bidjerano (2010) postulated the need for Learner Presence to account for these important learner set of variables in either online or classroom education.

Marti Cleveland-Innes, Prisca Campbell (2012) and other of Marti’s colleagues next argued that “emotional presence” was notably absent from the original COI model. My rather lame excuse that 3 males from Alberta, were very unlikely to posit the existence of emotional presence, since “real men” in Alberta, don’t do ‘emotion’. Rienties and Rivers (2014) picked up on these ideas of emotional presence in a review study – Measuring and Understanding Learner Emotions: Evidence and Prospects. They who directly added a fourth element to create what technically is now no longer a Venn diagram since it does not show all possible interactions of all 4 components.   It is now a Euler model – see http://math.stackexchange.com/questions/1475/why-can-a-venn-diagram-for-4-sets-not-be-constructed-using-circles).

The most recent suggestion for a fourth presence comes from Lam (2015) who validated the existence of the original three presences, and then coined a new term for the type of learner agency that resonates with Shea’s “learning presence. Unfortunately she described this new addition to the COI as “Autonomy Presence”. Wikipedia explains that Autonomy comes from Ancient Greek: αὐτονομία autonomia from αὐτόνομος autonomos from αὐτο- auto- “self” and νόμος nomos, “law”, hence when combined, is understood to mean “one who gives oneself one’s own law” (Wikipedia). The word is used largely in the context of independence and freedom to make one’s own decisions. In educational context, this “autonomy” is valued to some degree, but as all students know, is severely curtailed by the edicts and wishes of the teacher. The indicators that Lam uses to identify and classify autonomy presence are however becoming increasingly important as the Internet provides additional or supplemental resources and communities that students can use to enhance, augment and validate their learning. (see below)

ishot-256

Terumi Miyazoe and I (2015) discussed this empowerment and the ability for students to increase student-student and student-content interaction in the context of my interaction equivalency theory in our 2015 paper Interaction Equivalency in the OER and Informal Learning Era.

It strikes me that the critical elements of learner, interface and autonomous presence flow directly from Alberta Bandura’s (1989) work on agency in which he described three types of agency in social cognitive theory. These are autonomous, mechanical and emergent interactive agency (p. 1175). The word agency evolved from Medieval Latin agentia “active operation,” Certainly the capacity for “active operation” can include most of the elements of interface presence since being productively active implies control over the environment. Shea’s reminder of the importance of the learning presence in the control of “active operation” is also subsumed in agency.

So my own suggestion in the search for the ‘missing’ element(s) in the COI model is to add agency presence to the COI trinity. This term is simpler than autonomous, builds on the seminal work of Bandura and captures the components mentioned by both Shea and Lam.

But where does that leave emotional presence? I argue that emotion is included in social presence (for example the indicator use of affective language) elements and in agency presence in line with both Bandura’s autonomous interaction – the capacity to recognize and use the power, insights and liability of emotional responses and his emergent agency in which emotions can be used to reach insights not accessible to those denying their existence or unable to deal with them effectively.

I haven’t validated this model empirically but it would likely include and consolidate many of the elements identified by Lam in her autonomous presence and Shea in his learning presence. And hopefully this addition would bring the COI model more in line with the emergent and networked resource ideas of modern connectivist theories.

References

Annand, D. (2011). Social presence within the community of inquiry framework. The International Review of Research in Open and Distributed Learning, 12(5), 40-56.

Bandura, A. (1989). Human agency in social cognitive theory. American psychologist, 44(9), 1175.

Cleveland-Innes, M., & Campbell, P. (2012). Emotional presence, learning, and the online learning environment. The International Review of Research in Open and Distributed Learning, 13(4), 269-292.

Lam, J. (2015). Autonomy presence in the extended community of inquiry International Journal of Continuing Education and Lifelong Learning, 81(1), 39-61.

Miyazoe, T., & Anderson, T. (2015). Interaction equivalency in an OER, MOOC and informal learning era. Best of Eden 2013 Issue – EURODL. http://www.eurodl.org/?p=special&sp=articles&inum=7&article=695.

Rienties, B., & Rivers, B. A. (2014). Measuring and understanding learner emotions: Evidence and prospects. Learning Analytics Community Exchange.

Salmon, G. (2000). E-moderating: The key to teaching and learning online. London: Kogan Page.

Shea, P., & Bidjerano, T. (2010). Learning presence: Towards a theory of self-efficacy, self-regulation, and the development of a communities of inquiry in online and blended learning environments. Computers & Education, 55(4), 1721-1731.