Analysis of the effects of perceived quality differences between adequacy for emergency remote education and return to traditional in-person education

This study aims to evaluate the suitability of emergency remote education (ERE) during the COVID-19 pandemic and subsequently during the return to in-person education (IPE), investigating aspects of perceived quality differences in these transitions that may have impacted the students’ learning process.

This study applied a 41-item instrument to undergraduate students in higher education institutions (HEIs) in Brazil. For the suitability group, 493 responses were collected, and for the return to IPE group, 187 responses were collected. Three calibration approaches were performed using item response theory, with the first two adjusting data independently, and the third one involving a multigroup estimation.

During ERE, students perceived an increase in course offerings, better organization of classes and more study materials. However, the larger volume of content posed challenges in class monitoring, content comprehension and concentration. Upon returning to IPE, students noticed more organized assessments and activities. They found favorable test environments and collaborative tasks with peers, but they experienced difficulties in accessing professors and with class/content organization.

By identifying the most suitable items for both teaching formats, HEIs can enhance teaching practices that are more satisfactory from the students’ perspective.

This study provides an item ranking procedure inspired by differential item functioning and differential test functioning statistics. In an atypical situation, the item ranking procedure demonstrated its ability to generate useful information for identifying and quantifying the longitudinal effects of perceived quality on students.