Teaching and Learning in a Net-Centric World

Is Google Scholar a Filter Bubble?

A major  goal of net-based  mass media is to customize the feed that is delivered to each viewer received a unique screen that matches their interest and more importantly their likelihood of purchasing some product or viewing some paid for message.  This phenomenon was labeled as “filter bubble” by author Eli Pariser – meaning that certain results are filtered out creating a bubble of unawareness that surrounds each of us.

I remember my first vivid encounter with these covert filters when I was building a web site some years ago for the Westwood Unitarian Congregation. I was flattered when I noticed that a Google Search started turning my site up not only on the first page of search returns but increasingly in first or second place. I naively imagined that our site was becoming the most popular Unitarian destination in Canada.  Sadly,  I came to realize that this top end response  was only being enjoyed by myself. Google searches filters had determined that I really liked that site (based on my subsequent keystrokes) and thus presented a filtered result of searches for Canada and Unitarian.  Obviously the search engine had established a personal profile for me and was feeding me what it thought would be of most interest to me.

More recently, the use of filters by Facebook to provide customized news feeds to individual users has raised both technical and ethical issues. The diagram below by TechCrunch demonstrates a small part of the filter system used by Facebook and other media outlets.

Facebook Filter bubbles

One can argue the value of these filters (how many ads for women’s perfume do I really need or want to see?) but they come a cost of reducing the variability that exists throughout societies and may leave us blind to ideas or events that we may  have both interest and expertise.

This is no more critical a problem than in academic research.  When doing any quality work and especially that associated with PhD study, the candidate as an obligation to purview all of the relevant literature.  Long gone are the days when this could be accomplished by a few afternoons in the periodical section of the library. Today this means searching through the academic databases – extracting and reading everything relevant to the topic.  This can be done using proprietary search indexes such as Social Science Citation Index (SSCI) or rival product Scopius, however I have long argued that these indexes discriminate against both new Journals in the discipline and especially those that are Open Access.

Google Scholar is my first choice for such searches for a number of reasons. First it providing broader coverage than its competitors that includes documents from the grey literature (conference papers, reports, white papers etc.). Second it indexes far more journals in the educational discipline than either Scopius or SSCI. Third, empirical tests have shown that the results are not significantly different when using any of these indexes (see Harzing, A.-W. K., & Van der Wal, R. (2008). Google Scholar as a new source for citation analysis. Ethics in science and environmental politics, 8(1), 61-73.)  Finally, and critically importance for scholars in developing countries and those non affiliated with a relatively rich university, is that access to Google Scholar search is free of charge (unlike SSCI).

So tying these two threads together (choice of search engine and covert filtering), leads to an obvious and important question. Does Google Scholar filter results?  Or can one expect different search results to arise when different scholars with different experiences, interests and use profiles?

I was pleased to hear that has question has been addressed and the results did not displease me (ie they made it past my filtering to be presented to you, in this blog!!). The study:

Yu, K., Mustapha, N., & Oozeer, N. (2016). Google Scholar’s Filter Bubble: An Inflated Actuality? Research 2.0 and the Impact of Digital Technologies on Scholarly Inquiry, 211.

compared Google Scholar research results using variety of default and advanced settings  (see abstarct below) and it concluded “that the filter bubble phenomenon does not warrant concern.” Unfortunately the chapter and the book are not open access however the main points can be seen from the Google Book abstract or the publishers preview.

Thus, my faith in and appreciation for the service provided by Google Scholar has increased.

 

 

 

ABSTRACT:

This chapter investigates the allegation that popular online search engine Google applies algorithms to personalise search results therefore yielding different results for the exact same search terms. It specifically examines whether the same alleged filter bubble applies to Google’s academic product: Google Scholar. It reports the results from an exploratory experiment of nine keywords carried out for this purpose, varying variables such as disciplines (Natural Science, Social Science and Humanities), geographic locations (north/south), and levels (senior/junior researchers). It also reports a short survey on academic search behaviour. The finding suggests that while Google Scholar, together with Google, has emerged as THE dominant search engine among the participants of this study, the alleged filter bubble is only mildly observable. The Jaccard similarity of search results for all nine keywords is strikingly high, with only one keyword that exhibits a localized bubble at 95% level. This chapter therefore concludes that the filter bubble phenomenon does not warrant concern.

 

Similar posts
  • Teaching at Jiangnan University, Wuxi... My 4 week trip to China is a week done, and I thought I would document the trip to date (you know us old guys have trouble remembering the details!). Four years I received a request to host and sponsor a PhD student from Bejing Normal School. Zhijun Wang soon worked her way into our [...]
  • Quality in Online Learning Presentati... I was asked to do a video conferencing talk to a meeting of three Mexican Universities yesterday. They are attempting to come up with a common set of criteria to define and measure the quality of their online courses. Perhaps I was not the best person to ask, as I have very mixed feelings about [...]
  • Order of Athabasca University Yesterday at Convocation in Athabasca, I was deeply honoured by my former colleagues at Athabasca by being installed into the Order of Athabasca University. Most other members have been individuals from the community who have made exceptional contributions to the University. I was the first Faculty member (other than Dominique Abrioux, who also served as [...]
  • Research–Practice Partnerships in Edu... My Google Scholar alert notified me that one of my articles was cited in an as yet not publisher preprint in Educational Researcher.  I don’t usually bother with articles hidden behind paywalls, but I was intrigued by the title: Coburn, C. E., & Penuel, W. R. (2016). Research–Practice Partnerships in Education: Outcomes, Dynamics, and Open [...]
  • What’s So New about the New Ath... Last week I gave the Sunday sermon at Westwood Unitarian Congregation here in Edmonton.  While trying to organize my book shelves, I noticed that I had nine different books on Atheism – many by authors labelled as “New Atheists”.  In most Unitarian Churches members are allowed and encouraged to present a sermon on a topic that [...]

2 Comments

  1. October 8, 2016    

    Hi! Thanks for this interesting post.

    Anurag Acharya, Google Scholar’s Chief Engineer, declared last year that they don’t change results based on user profiles. Everyone gets the same results for the same queries. They only change the order in which they appear depending on your preferred language (if your interface is set to Spanish, you get results in Spanish first, and so on). The full text links also change depending on the subscriptions of the institution from which you’re accessing Google Scholar

    https://youtu.be/S-f9MjQjLsk?t=53m

  2. November 6, 2016    

Leave a Reply

Your email address will not be published. Required fields are marked *

Subscribe to Virtual Canuck via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 329 other subscribers

My posts by Category

My Blog Archives

Subscribe

  • Twitter
  • LinkedIn
  • SlideShare
  • RSS Feed for Posts
  • Email

Follow me on Twitter