University students’ heuristic usability ınspection of the national library of Turkey website

The purpose of this paper is to evaluate the usability of the National Library of Turkey website developed for all citizens in the country to retrieve information available in a wide range of areas.

The evaluation performed by 57 undergraduate university students involved the identification and analysis of usability problems in the selected website. The assessment process was mainly based on Nielsen’s Heuristics. The data obtained in the evaluation process were enriched using the System Usability Scale (SUS) and the Net Promoter Score (NPS) to conduct a more detailed analysis.

The participants identified many usability problems concerning the evaluated website and considered it as having low usability characteristics. The most violated heuristic item was found to be “consistency and standards” whereas the least violated heuristic item was “match between system and the real world.” The total number of the usability problems in heuristic evaluation correlated significantly and negatively with the SUS and the NPS results indicating that the more participants identified usability problems, the less they considered the website as usable and recommendable.

The participants were not usability experts, however they were selected from among the students who received the Human Computer Interaction course to ensure that they had sufficient information and experience concerning the evaluation of a website with heuristics. Besides, the study was limited to a small number of university students. The implication is that results of this study have potential to guide libraries, which plan to adapt themselves to the digital world by delivering web services, by addressing critical points influencing users’ points of views toward library websites and their usability evaluation result.

Depending on the changes in user habits regarding the retrieval of information, libraries have made considerable investments in web technologies to meet their users’ demands, and recently, digital libraries have begun to take over physical libraries. Users always need to perform tasks efficiently, effectively and satisfactorily when using websites. As one of the most crucial sources of digital materials, library websites are expected to have usable characteristics that satisfactorily meet user requirements. Therefore, the practical implication is that the findings of the study will guide designers, developers and practitioners in the development of library websites.

In the context of usability evaluation of digital libraries, this is the first study to analyze effects of usability problems identified by users during the heuristic inspection on their overall evaluation score and willingness to recommend the website to their friends or colleagues.