An eye-tracking-based approach to evaluate the usability of government portal websites in pilot smart cities

Abstract

Purpose

The study aims to pioneer an innovative approach for the evaluation of government portal websites (GPWs) by introducing an eye-tracking-based method. The research meticulously pinpoints and analyses the distinct usability issues and challenges that users encounter while navigating and interacting with GPWs.

Design/methodology/approach

This study devises an eye-tracking-based GPW usability evaluation approach, which focuses on the major functions (i.e. government information disclosure, government services and interactive responses) of GPWs. An Entropy Weighted Technique for Order Preference by Similarity to an Ideal Solution (EW-TOPSIS) method is employed to process eye-tracking indicator results for deriving GPW usability results.

Findings

The proposed approach is demonstrated to assess the usability of 12 GPWs in pilot smart cities in China, and it is found that most GPWs have lower-than-average usability. GPWs with low usability require more cognitive load that exhibit increased fixation and saccade. The comparisons among the GPW usability results from (1) the eye-tracking experiment, (2) questionnaire surveys and (3) the ready-made performance evaluation report validate the effectiveness of eye-tracking-based GPW usability evaluation.

Originality/value

The work contributes to shifting the GPW usability evaluation approach from a subjective judgment paradigm to an objective paradigm, as well as provides implications for enhancing GPW usability, including improving search function, reducing website complexity and prioritizing user needs.

Citation

Li, D., Zhou, H., Zhou, S., Huang, G., Ma, X., Zhao, Y., Wang, W. and Ng, S.T. (2023), "An eye-tracking-based approach to evaluate the usability of government portal websites in pilot smart cities", Engineering, Construction and Architectural Management, Vol. ahead-of-print No. ahead-of-print. https://doi.org/10.1108/ECAM-09-2023-0932