Thursday, 15 May 2014

Pointers on writing a #literature review from M. Hammersley

Seminar on reviewing literature in social and educational research given by Martyn Hammersley, CREET, the Open University.

Although literature is seen as an important part of the research process, there are some criticisms from non-academics on its transparency. Martyn provides an overview of practices one can consider as a researcher to make literature review chapters more accessible, both to researchers, policy makers and interested parties.

Systematic reviews and some of their challenges
What policy makers would like to see is a systematic overview, a synthesizing the studies, so including information on how much literature is covered, and whether specific consistent criteria have been adopted

Disciplinary fields and boundaries are much weaker now, then they were before. It is important to focus on literature that is relevant for your own research, and not necessarily limit yourself to what is connected to your particular field. But when you are going to write articles about your research, you need to focus on a specific field to be published in those journals with that particular focus.

Qualitative synthesis
Do systemic review and qualitative synthesis produce literature reviews, or are they forms of secondary analysis done by other researchers (do direct reading).

Another option in qualitative literature is the interpretive critique
  • Traditional reviews attacked for being in conflict with the basic presuppositions of qualitative inquiry, because they:
  • Assume a linear model of the cumulative development of knowledge, in which each study adds a new ‘brick in the wall’
  • Assume that research studies can be objectively assessed in terms of thie methodological adequacy and/or their representational varacity, and assume that these are the most important criteria of assessment (Hammersley 2013, ch.10) 
Key question to ask: what is my literature doing, what needs to be in there in order to prepare for what is to follow in the dissertation (main audience, define boundaries, making judgments about what is more or less relevant).
  • How are you going to go about finding the relevant literature
  • How to evaluate those studies?
  • How are the studies to be selected, and which are to be included in the review
  • How are the boundaries of what would be relevant studies to be defined
  • How is the review to be structured?
(Hart, 1998)

Functions the existing literature can serve in research:
  • It constitutes the context for the formulation and development of research questions
  • It will usually offer possible answers to those questions, and indicate what might count as adequate answers
  • It may suggest ideas and methods that culd be imployed
  • It will provide resources that can be relied upon in developing arguments and evidence in support of answers to research questions
While writing the literature you will have to use your own argumentation, and research goal, making use of the existing literature. But reviewing is more then simply providing a literature chapter, it is a process.
  • Reviewing the literature is a process
  • It goes on throughout any research, albeit in different forms
  • It must begin at the start, but will need to change in the light of changing research questions
Mapping relevant literature
In the early stages of research the task of searching for and reading relevant literature is primarily a matter of identifying what could be relevant, what significance it may have and how it might be used

There will be core literature that is very likely to be relevant, but also many other areas of literature, fairly indeterminate in character, that could be relevant.

Types of searching
  • Looking in catalogues, on library shelves, or in academic bookshops for relevant literature
  • Searching via electronic databases
  • Looking through or searching relevant journals, especially for review articles, 
  • Following up references in sources already found (this is a CORE option)
  • There is a tension between exhaustiveness and pragmatism
  • There is no perfect way to do this, there is always a trade-off. 
Types of reading
  • Skim reading (good to get an account of what is out there, the birds eye view)
  • Reading in search of specific kinds of information
  • Close or in-depth reading designed to understand and to assess the arguments and evidence put forward, and how these relate to the field of investigation (see e.g. hammersley, 1997)
  • Different reading strategies will be needed, at particular times, in dealing with particular articles and books, depending on the purpose they are serving. 
Writing a literature review
  • The purpose of a literature review chapter to provide a context and rational for the study
  • Avoid sequential paragraphs about each study: some degree of synthesis is needed
  • It is also important to evaluate the studies in methodological terms. Take care not to do this in a tendentious fashion: in other words, criticising those that don’t serve one’s purposes, while not critically assessing those whose finding some finds congenial or useful. 
Using the literature in other parts of a thesis, dissertation, or book
  • In an introduction (to help the reader understand what you are doing and why)
  • In a methodology chapter
  • In analysis chapter
  • In the conclusion
References
Hammersley, M. (1997) reading ethnographic research, second edition, London, longman
Hammersley, M. (2013). The myth of research-based policy and practice, London, sage.
Hart, C. (1998). Doing a literature review: releasing the social science research imagination, London, Sage.
McKinney, J. (1966) constructive typology and social theory, New York, Appleton-Century-Crofts
Oakley, A (2007). ‘Evidence-informed policy and practice: challenges for social science’ in Hammersley, M. (ed.). Educational research and evidence-based practice, London, Sage.

Questions:

How to combine interdisciplinary literature into a literature review
Thesis: is written for your examiners, and the examiners would be seen as the experts in their field, so their concerns and background will provide guidelines on what to write. On the other hand, some of the research you are conducting will be known to the examiners, but you need to write as though your readers do not know what they know. Supervisors help with that.

Question on emerging fields and lack of literature
What is published can be seen as literature, but also as data: if you have got people who play a role in the research context, then these people’s writing could be used to describe a wide spread view on the topic. Parallel fields and methods can be used to build the boundary for your research.

#MOOC papers: challenges, learner self-determination & #pedagogy

In the free online, peer reviewed journal of Merlot, a nice set of articles was published in the March 2014 issue.

Research Papers
  • Challenges to Research in MOOCs by Helene Fournier, Rita Kop, and Guillaume Durand PDF1
  • Participants' Perceptions of Learning and Networking in Connectivist MOOCs  by Mohsen Saadatmand and Kristiina Kumpulainen PDF16

Case Study
MOOCs: Striking the Right Balance between Facilitation and Self-Determination written by Tita Beaven, Mirjam Hauck, Anna Comas-Quinn, Tim Lewis, and Beatriz de los Arcos PDF31

Position Papers
  • MOOC Pedagogy: Gleaning Good Practice from Existing MOOCs written by Maha Bali PDF44
  • Teacher Experiences and Academic Identity: The Missing Components of MOOC Pedagogy written by Jen Ross, Christine Sinclair, Jeremy Knox, Siân Bayne, and Hamish Macleod PDF




Focusing on two
Choosing two articles of particular interest to me, I focus on the article on participant's perception of learning in a MOOC written by Mohsen Saadatmand and Kristina Kumpulainen

Abstract: Massive open online courses (MOOCs) challenge the mainstream of higher education and provide global learning opportunities to a huge number of students so they can learn anytime and anywhere. The value and applicability of the MOOC model in the current era of higher education and the nature of learning in such an open online format need to be investigated. This study focused on participants' experiences and perceived value of participation in connectivist MOOCs (cMOOCs) in terms of dealing with an abundance of resources and tools, learning activities, and network engagement. The results suggest a high extent of technology deployment for learning and interactions by the participants in cMOOCs. Creating networks and developing professional connections through networking technologies are advantages of participating in cMOOCs. The study's findings contribute to a better understanding of the nature of learning and participation in MOOCs from the perspective of students, who are the main stakeholders of such new learning experiences.

The study showed that participants develop self-organization, self-motivation skills and increase their technological proficiency.

Another article of interest to me was one that looked at self-determined learning (which is closely related to self-regulation and self-directed learning). The article is called: "MOOCs: Striking the Right Balance between Facilitation and Self-Determination " and is written by people of the Open University in the UK: Tita Beaven, Mirjam Hauck, Anna Comas-Quinn, Tim Lewis, and Beatriz de los Arcos

Abstract: recent research suggests that a growing proportion of formal learning occurs outside formal educational settings, where information and learning opportunities are mediated by technology. The rise of massive open online courses (MOOCs) in the last few years bears witness to this phenomenon. This contribution considers whether MOOCs afford a collaborative environment in which participants can develop the necessary literacy skills to become successful self-directed learners and members of online communities. It also discusses the extent to which self-determination and participatory literacy might be relevant for success in different types of MOOCs. The paper draws on data from OT12, an 8-week MOOC on open translation tools and practices run in 2012 by the Department of Languages of The Open University in the United Kingdom. The authors conclude that to conceive of MOOCs as environments where individuals coalesce around a common endeavor is to raise a series of under-explored challenges. For organizers, the challenge lies in learning design and facilitation, and the extent to which their assumptions about the participants match the learners' capabilities. For learners, the challenge rests in self-determination and participatory literacy skills.

Wednesday, 14 May 2014

eLearningGuild Online forum: integrating a #MOOC in your training environment

The eLearning Guild has wonderful online forums, and tomorrow another set of interesting sessions is planned on the topic of leveraging learning infrastructure for your learners and your organization, and will run 10 sessions on the subject during 15 and 16 May 2014.

The online forums are part of the eLearning Guild membership offerings, but you can register for individual sessions as well, although I can say it is worth becoming a member.

My session information can be found here, and just adding the description below:
MOOCs (massively open online courses) offer one more training-delivery format to increase organizational knowledge transfer. But to succeed with MOOCs, we must understand what has and has not worked so far. Then, it’s just a matter of setting up and rolling out a simple MOOC, using rapid iteration and evaluation to gradually build your own “powerMOOC” that fits within your training infrastructure. In short, MOOCs are similar to music and life: They only start making sense once you practice, practice, practice, and they are open to some initial chaos.
Participants in this session will examine what MOOCs can and—as yet—cannot do, and how you can use MOOCs to improve or supplement your existing training infrastructure. You’ll explore options for starting a MOOC, from developing your own platform, to using platform partners, to using your existing LMS. You’ll also learn about the extra learning dynamics that MOOCs offer, including more diverse learner interactions, meaningful social-media options, a ubiquitous learning set at the center, reaching international learners, and creating or strengthening a community.

My presentation is scheduled for tomorrow Thursday 15 May 2014, between 12 - 13.15 PM Pacific Time (which is 8 - 9.15 PM London time). Feel free to join, or browse through the slidedeck.



EU focus on startups: manifesto also for training startups

Neelie Kroes (vice-president of the European Commission) has done a lot of work to support EU initiatives, and I admire her for her push forward to combine ICT and education. Now she is calling out to all startups to sign the Startup Europe Manifesto and gather behind this European initiative to support and help grow your own startup.

The manifesto consists of 14 pages, and anyone interested in technology will recognize some of the emphasized points raised by Neelie Kroes and her team. You can read the English manifesto here, but the manifesto is also available in Greek, Italian, Spanish, German and French.

So have a look, and if you are an entrepreneur check-out the manifesto, see what it can do for you, and - as Neelie says - innovate and change the world.



Call for papers and presentations on #mobile and online learning

Interesting conference options for all of us researching mobile, online, and technology enhanced learning.

mLearn 2014 conference
Dates of conference: 3 - 5 November 2014
Location: Kadir-Has University, Istanbul, Turkey (which is a WONDERFUL location with GREAT researchers!)
Deadline: 19 May 2014
Submitting a paper can be done here.
The conference follows a double blind peer review process.

More about the conference:
Conference website can be found here.
mLearn was the first conference on mobile and contextual learning and has developed to be the premier meeting point for interested researchers, practitioners and decision makers busy with mobile learning around the world. Backed-up by the International Association for Mobile Learning (IAMLEARN) the conference has an impressive history of focus topics, keynote speakers and scientific contributions.

The conference programme will highlight keynote talks, symposia/workshops, plenary sessions, parallel presentations, roundtables and debates, special focus sessions, poster sessions, technology and product/service demonstrations. Submissions are invited for:

· Long papers (10 – 14 pages)
· Short papers (5 – 8 pages)
· Posters (2 pages)
· Workshops (3 pages)
· Tutorials (2 pages)
· Industry showcases (1-2 pages)
· Doctoral Consortium (4 pages)

Papers need to have at least 4 pages to be included in the proceedings. Submissions for mLearn 2014 are handled through EasyChair. All contributions will be reviewed in a double-blind peer-review process. All accepted papers and posters will published in the conference proceedings.You can view the full proceedings of mLearn 2012 here, the ones from mLearn 2013 here.


Sloan Consortium annual conference
Dates of conference: 29 - 31 October 2014
Location: Orlando, Florida
Deadline: 19 May 2014
Submitting a presentation can be done here.

More about the conference
Conference website can be viewed here.
The conference program will offer a full complement of presentations that reflect the implications for the field of specific e-learning experience and practices. Keynote and plenary addresses, as well as pre-conference workshops, featured sessions, information sessions, Best-in-Track presentations, and poster presentations will address blended learning, issues of diversity, international applications of online learning, open educational resources, social networking, online learning and community colleges, and K-12 online education as well as other topics of common interest.

Thursday, 1 May 2014

Exploring future #seamless learning strands for #MOOC

Last year Nilgün Keskin, Apostolos Koutropoulos, and myself stuck our heads together and wrote a research paper on Exploring Future Seamless Learning Strands for Massive Open Online Courses. There are quite a few research options to explore, so feel free to read the paper.

To provide an idea of what to expect, I gladly share the abstract below, the draft version of the article can be read here through Academia.


This chapter reviews the concept of seamless learning for Massive Open Online Courses (MOOC) based on the distillation of key factors from papers discussing and describing the mobile seamless learning (MSL) concept. The MSL concept was used as a starting point to explore how MOOC could be prepared for seamless learning and to explore future research options. There is a vast area of research to be explored related to seamless learning in MOOC. The authors belief that some of the challenges faced by MOOC , such as “dropout” rates, redefining learning activities to fit diversity of contexts, self-directed learning, collaborative content artifact creation, the mobility of the adult learners, and the “dip-in, jump-out” aspect of participation can be countered by researching and suggesting seamless learning designs and guidelines that fit both the adult learners and the MOOC realities. Investigating all the elements, challenges and benefits for providing seamless learning in MOOC environments will contribute to the  body of knowledge of contemporary online learning.

For those looking for references: de Waard, I., Keskin, N. O., & Koutropoulos, A. (2014). Exploring Future Seamless Learning Research Strands for Massive Open Online Courses.Handbook of Research on Emerging Priorities and Trends in Distance Education: Communication, Pedagogy, and Technology, 201.

Friday, 25 April 2014

Critical #skills define performances across multiple fields

Critical learning/reading/living is an acclaimed skill. With the internet becoming a global content delivery and discussion forum, this skill has become increasingly important for knowledge creation, filtering out crap and manipulation, or simply in order to try and construct your own voice in your own field of interest. As my Personal Knowledge Mastery class facilitated by Harold Jarche moves forward, this is my next reflective exercise. For last weeks topic was on: challenging ideas and why this is a good thing.
This process of constructive, critical action as an interesting journey that fits my current "where do I go from here in my personal and professional life", as such combine my PhD, with a military training option, and a Cate Blanchett interview mentioning doubt and self-reflection. It all fits together in my mind :-)

And for those looking for some great and well-grounded critique on TED talks, look at what the wonderful Audrey Watters writes on the subject (in short: TED talks are about flashing (entrepreneurial) ideas, not getting them questioned - thx for the link Harold!)

PhD journey and becoming more critical
Being critical is also a key aspect of any PhD or research project. Knowing which terms you use, why you select certain methodologies, whether they stand the test of critical analysis, what weaknesses/strengths they have. Looking back at when I started with my PhD I can see how I have strengthened my critical skills. The verbs I use, the arguments I make, the data I collect and how I analyse that data, everything is scrutinized and rightfully so, as this turns simple actions into conscious, meaningful acts. And in order to enhance these critical skills, feedback from colleagues and supervisors is more then helpful. This was not new to me, as I used it to evaluate eLearning and mobile projects in the past, but really improving that skill will have a profound effect on my future evaluations, and understandings. A clear gain from my PhD journey. 

The use of people trained in being critical in the military
In the PKM course an example from the military is given reflecting on the "Red Team University", a university which trains critical people to be send out into the field and use their critical skills to improve field actions and strategies (so those people question the military staff in order to strengthen tactics), here is the excerpt:. 

The school is the hub of an effort to train professional military “devil’s advocates” — field operatives who bring critical thinking to the battlefield and help commanding officers avoid the perils of overconfidence, strategic brittleness, and groupthink. The goal is to respectfully help leaders in complex situations unearth untested assumptions, consider alternative interpretations and “think like the other” without sapping unit cohesion or morale, and while retaining their values.More than 300 of these professional skeptics have since graduated from the program, and have fanned out through the Army’s ranks. Their effects have been transformational — not only shaping a broad array of decisions and tactics, but also spreading a form of cultural change appropriate for both the institution and the complex times in which it now both fights and keeps the peace.
- Andrew Zolli: HBR 26 Sept 2012 

Cate Blanchett and personal critical analysis as a means to grow in one's profession and life
When watching an interview for the Screen Actors Guild with Cate Blanchett on her performance in Blue Jasmine, in the end one of the questions from the public is on self-doubt and reflection. Although Cate Blanchett has performed numerous times on both theater and film stage, she clearly defines doubt and critical thought as defining her expertise, as fine-tuning her performance. A nice interview.

free book #OER integration in #k12 for #ict4d regions

While exploring OER with an edge options, I came across this free book published by the Common Wealth of Learning, edited by Ferreira and Gaultier, entitled Perspectives on Open and Distance Learning: Open Schooling with Open Educational Resources (OER): opening doors, creating opportunities. A great read which features OER cases from six countries — Botswana, Lesotho, Namibia, Seychelles, Trinidad and Tobago and Zambia — participating in this ambitious, ground-breaking project to train educators to create a bank of OER that could be used in both conventional and open schools by both school-age children and adult learners. Each country based its OER on its country curricula, but built in enough cultural and pedagogical flexibility to allow the OER to be used and adapted by other countries — epitomising the essence of OER. In addition, the training equipped the participants with the knowledge and skills to train current and future colleagues, thus contributing to the sustainability of the OER.

The project presented many challenges — technical, personal and logistical — for the participants and these are discussed openly and honestly in the country reports. It also brought a real sense of professional and personal achievement, and those who participated can be proud of their contribution to the development of OER for open and distance education. If we can continue to develop and maintain OER, we can continue to educate and to open doors.

The great part of this is the collaboration to get OER centralized across nations, and using it inside of a curriculum based system (which makes the OER open to qualitative evaluation, redistribution, cross-cultural affinity...). Just looking at the table provided by the Namibian OER team got me excited: a clear timeline of what has been done, how and what the main focus was.


Thursday, 24 April 2014

A bit of #mobile phone history 1922 and onward

A couple of days ago I got hooked on the British Pathé news reels, and here are three wonderful mobile phone related bits of movie. As an adapt mobile learning enthusiast and researcher, I just got so enthusiastic about these bits of moving history. And when looking at them I think: the same ideas are in all of our minds, whether the technology enables them or not.

The first dates back to 1922 and is called Eve's wireless, and it seems this movie accounts the "Home-O-Fone", which is based on the crystal radio (ah memories of my childhood electronic play-set that offered me a crystal radio as an easy bit of DIY option). In that movie you see two women walking down the street and letting 'hubby' know they will be late. Using a fire hydrant for grounding, and an umbrella as an antenna... great! And what do they phone? A record operator! Or at least it seems that way. The lady who first seemed like a phone operator puts on a record and presto, music can be heard in the street.



A second one links the mobile phone (in this case a car phone, 1946) with what would now most likely be seen as a hotspot. Two Italian (Naples) women park the car alongside the street, plug in a socket and use the car phone. A bit like finding a café with wifi to look at your mail :-)
The movie is called Rome: Auto Telephone, but the description says Napoli, Italy.



A third movie dates from 1946, and is entitled: Madame will you walk and talk. In this movie you see a woman making use of a (hefty) mobile phone option, to keep her (lady)friends on top of what is on sales or not, or getting a knowledgeable man to get the car going again, and the last scene of this movie has a homely feel (ducking behind my chair for the remarks that will no doubt be voiced by my feminist friends).

#OER #MOOC online learning papers from Open CourseWare conference

The Open Praxis special issue from the Open CourseWare Conferenence (OCW) 2014 that took place in Ljubliana, Slovenia is just published. This issue features a selection of papers. I gladly include the list of papers at the end of this blogpost, but first starting with an article and research that I found particularly useful.

The most interesting for my research and online learning interests was the one from Cohen, Omollo and Malicke which was an article on "a Framework to Integrate Public, Dynamic Metrics Into an OER Platform". The authors look at the usefulness of opening up meaningful analytics coming from shared Open Educational Resources (OER). I find this of interest, as it is part of something I want to investigate in relationship to peer/expert knowledge creation, MOOC, mobile learning. This paper provides an overview of what the university of Michigan, USA has done, but it can easily be rolled out to other educational and training institutes or organizations, even - in my view - to an international modus operandi.

The authors concluded with:
Metric-sharing is currency in relationships between OER-publishing-platforms and the faculty, staff, and students of universities and businesses who create OER. This is not the only benefit, but it has been a clear one for us: we are giving a population we have identified as a primary audience something they want. Our experience and user research confirm this.
The technical architecture an organization uses to host and reference OER is tied closely to the organization’s ability to share detailed usage data for its OER. Our use of the hierarchical structure of a Drupal-based platform allows us to easily provide metrics for individual courses or resources.
Metrics on a small scale are interesting, especially to their creators. Metrics can inform qualitative investigation, but they do not answer “why” questions (e.g. “why does this course have so many downloads compared to this other?”). To find analytics, metrics are necessary, but not sufficient.
Due to the structure by which OERbit platform stores metadata, Open.Michigan can group OER and its associated metrics in various ways. This positions Open.Michigan to progress from dynamic metrics to dynamic analytics in the future.
Much like seeing nodding and note-taking when you speak in front of an auditorium, seeing evidence of views, downloads, or comments where your OER are published is validation, evidence that there is some likelihood your effort provides real value to others. Having that evidence allows many to justify the additional effort it may take to openly license educational materials to supervisors and administrators. Open.Michigan’s sharing of individual OER metrics sustains development of open resources and allows an open education initiative, such as ours, to build strong relationships with its surrounding community and thus support the development and sharing of OER on a larger scale.

The above article matches in nicely with the OER and MOOC related article authored by Fernández and Webster (University of Madrid) which described "From OCW to MOOC: deployment of OERs in a MOOC, the experience of Universidad Carlos III in Madrid"

The emergence of Massive Open Online Courses (MOOCs) is focusing all its attention on open education. There  is growing interest in creating MOOCs, which can be done by transferring OCW courses to MOOC format. However, a series of doubts arise regarding the pros and cons implied in this transformation. In this paper we discuss the conclusions derived from our experience at Universidad Carlos III de Madrid with a widely disseminated OCW course that was satisfactorily converted into a MOOC. This experience has allowed us to compare two different models of open education initially based on the same content. We also analyze the difficulties incurred in the transformation process and present strategies to successfully carry out this change.

Other articles featured in this Open Praxis issue:

Wikiwijs: An unexpected journey and the lessons learned towards OERPDF
Robert Schuwer, Karel Kreijns, Marjan Vermeulen91-102
Public Expenditure in Education in Latin America. Recommendations to Serve the Purposes of the Paris Open Educational Resources DeclarationPDF
Amalia Toledo Hernández, Carolina Botero, Luisa Guzmán103-113
The potential social, economic and environmental benefits of MOOCs: operational and historical comparisons with a massive ‘closed online’ coursePDF
Andy Lane, Sally Caird, Martin Weller115-123
Formalising informal learning: Assessment and accreditation challenges within disaggregated systemsPDF
Rory McGreal, Dianne Conrad, Angela Murphy, Gabi Witthaus, Wayne Mackintosh125-133
Scenarios for the Use of OpenCourseWare in the Context of Student MobilityPDF
Frederik Truyen, Stephanie Verbeken135-144
From OCW to MOOC: Deployment of OERs in a Massive Open Online Course. The Experience of Universidad Carlos III de Madrid (UC3M)PDF
José Vida Fernández, Susan Webster145-158
Crowd-sourcing (semantically) Structured Multilingual Educational Content (CoSMEC)PDF
Darya Tarasowa, Sören Auer, Ali Khalili, Jörg Unbehauen159-170
An Architecture based on Linked Data technologies for the Integration and reuse of OER in MOOCs ContextPDF
Nelson Piedra, Janneth Alexandra Chicaiza, Jorge López, Edmundo Tovar171-187
A Framework to Integrate Public, Dynamic Metrics Into an OER PlatformPDF
Jaclyn Zetta Cohen, Kathleen Ludewig Omollo, Dave Malicke189-197