LibraryFind: System design and usability testing of academic metasearch system

Abstract

Using off-the-shelf search technology provides a single point of access into library resources, but we found that such commercial systems are not entirely satisfactory for the academic library setting. In response to this, Oregon State University (OSU) Libraries designed and deployed LibraryFind, a metasearch system. We conducted a usability experiment comparing LibraryFind, the OSU Libraries website and Google Scholar. Each participant used all three search systems in a controlled setting and we recorded their behavior to determine the effectiveness and efficiency of each search system. In this paper, we focus on understanding what factors are important to undergraduates in choosing their primary academic search system for class assignments. Based on a qualitative and quantitative analysis of the results, we found that mimicking commercial web search engines is an important factor to attract undergraduates. However, when undergraduates use these kinds of search engines, they expect similar performance to web search engines, including factors such as relevance, speed, and the availability of a spell checker. They also expected to be able to find out what kinds of content and materials are available in a system. Participants’ prior experience using academic search systems also affected their expectations of a new system.