Performance Measurement and MetricsTable of Contents for Performance Measurement and Metrics. List of articles from the current issue, including Just Accepted (EarlyCite)https://www.emerald.com/insight/publication/issn/1467-8047/vol/24/iss/3/4?utm_source=rss&utm_medium=feed&utm_campaign=rss_journalLatestPerformance Measurement and MetricsEmerald Publishing LimitedPerformance Measurement and MetricsPerformance Measurement and Metricshttps://www.emerald.com/insight/proxy/containerImg?link=/resource/publication/journal/acc2b1577b301d89ebeedc3987d9a4cb/urn:emeraldgroup.com:asset:id:binary:pmm.cover.jpghttps://www.emerald.com/insight/publication/issn/1467-8047/vol/24/iss/3/4?utm_source=rss&utm_medium=feed&utm_campaign=rss_journalLatestMeasuring the value of online databases: a case study to validate an ROI modelhttps://www.emerald.com/insight/content/doi/10.1108/PMM-09-2021-0047/full/html?utm_source=rss&utm_medium=feed&utm_campaign=rss_journalLatestThe return on investment (ROI) model is a tool used to measure the financial benefits and costs of an investment, in this case, the investment in digital library resources. By applying this model to the AAU digital library resources, the study seeks to determine whether these resources are providing sufficient value for the investment made in them. The proposed ROI model has two distinct phases and utilizes two different sets of data to calculate the return on investment for a database subscription. In Phase I, the ROI is calculated based on the total number of downloads of full-text articles from the database during the academic year 2019–2020. This information is used to determine the financial returns of the database subscription costs. In Phase II, the ROI is calculated by examining the citations drawn from the Scopus database on a sample of 30 funded research projects for the College of Engineering during the year 2019. These data are used to determine the impact of the database subscription on research output and its contribution to the success of the College of Engineering's research projects. The two phases of the proposed ROI model aim to provide a comprehensive understanding of the value of the database subscription and its impact on both financial returns and research output. The findings of the study indicated different results between Phase 1 and Phase 2 of the study. The positive ROI in Phase 1 suggests that the investment in online databases has a good return for the AAU, as they are gaining almost a dollar for every dollar spent. However, the negative ROI in Phase 2 is concerning. It suggests that the investment in the IEEE database is not generating a positive return for the AAU and may even be costing the institution money. Overall, these findings highlight the importance of measuring ROI in academic libraries, particularly in Arab countries where resources may be limited. By understanding the impact of library investments on institutional outcomes, libraries can make informed decisions about where to allocate their resources and how to optimize their services to best serve their communities. The findings of the current study were based on data collected from a specific sample, therefore, the findings may not be generalized to other academic libraries. A similar study with larger and more diverse samples can help to validate and extend the results of this study. The findings of the study provide evidence that the proposed ROI model can be effectively applied in Arab countries and academic libraries in the Arab world, this could encourage more institutions in the region to adopt this model for evaluating their investments and projects. The study may also guide how to adapt the model to the specific cultural and organizational contexts of Arab countries.Measuring the value of online databases: a case study to validate an ROI model
Abdoulaye Kaba, Ghaleb Awad El Refae, Shorouq Eletter, Tahira Yasmin
Performance Measurement and Metrics, Vol. 24, No. 3/4, pp.121-132

The return on investment (ROI) model is a tool used to measure the financial benefits and costs of an investment, in this case, the investment in digital library resources. By applying this model to the AAU digital library resources, the study seeks to determine whether these resources are providing sufficient value for the investment made in them.

The proposed ROI model has two distinct phases and utilizes two different sets of data to calculate the return on investment for a database subscription. In Phase I, the ROI is calculated based on the total number of downloads of full-text articles from the database during the academic year 2019–2020. This information is used to determine the financial returns of the database subscription costs. In Phase II, the ROI is calculated by examining the citations drawn from the Scopus database on a sample of 30 funded research projects for the College of Engineering during the year 2019. These data are used to determine the impact of the database subscription on research output and its contribution to the success of the College of Engineering's research projects. The two phases of the proposed ROI model aim to provide a comprehensive understanding of the value of the database subscription and its impact on both financial returns and research output.

The findings of the study indicated different results between Phase 1 and Phase 2 of the study. The positive ROI in Phase 1 suggests that the investment in online databases has a good return for the AAU, as they are gaining almost a dollar for every dollar spent. However, the negative ROI in Phase 2 is concerning. It suggests that the investment in the IEEE database is not generating a positive return for the AAU and may even be costing the institution money. Overall, these findings highlight the importance of measuring ROI in academic libraries, particularly in Arab countries where resources may be limited. By understanding the impact of library investments on institutional outcomes, libraries can make informed decisions about where to allocate their resources and how to optimize their services to best serve their communities.

The findings of the current study were based on data collected from a specific sample, therefore, the findings may not be generalized to other academic libraries. A similar study with larger and more diverse samples can help to validate and extend the results of this study.

The findings of the study provide evidence that the proposed ROI model can be effectively applied in Arab countries and academic libraries in the Arab world, this could encourage more institutions in the region to adopt this model for evaluating their investments and projects. The study may also guide how to adapt the model to the specific cultural and organizational contexts of Arab countries.

]]>
Measuring the value of online databases: a case study to validate an ROI model10.1108/PMM-09-2021-0047Performance Measurement and Metrics2023-08-11© 2023 Emerald Publishing LimitedAbdoulaye KabaGhaleb Awad El RefaeShorouq EletterTahira YasminPerformance Measurement and Metrics243/42023-08-1110.1108/PMM-09-2021-0047https://www.emerald.com/insight/content/doi/10.1108/PMM-09-2021-0047/full/html?utm_source=rss&utm_medium=feed&utm_campaign=rss_journalLatest© 2023 Emerald Publishing Limited
Adjusting the library performance standards for consortia services: a case studyhttps://www.emerald.com/insight/content/doi/10.1108/PMM-04-2023-0010/full/html?utm_source=rss&utm_medium=feed&utm_campaign=rss_journalLatestThis study proposes a framework for performance measurement of library consortia services by implementing the indicators listed in ISO 11620. The framework is validated by using real data from HEAL-Link, the national consortium of Greek academic and research libraries to calculate the indicators. The paper reports on the related work regarding the services consortia offer to their members and the known methods and tools for assessing consortia services; the HEAL-Link case study, the aggregation and handling of data, is presented; ISO 11620 performance indicators for HEAL-Link services are calculated, and the results are discussed in terms of what was learnt- about the consortium, about measuring consortia services performance, and about the standard. ISO 11620 could be used to measure performance for assessing consortia services. The performance indicators’ results reflect the two major events (mergers and COVID pandemic) that took place during the time of the study. ISO 11620 offers a basic insight that could be well complemented with other tools and standards. The current study suggests that a widely accepted, easily applied, benchmarking ISO standard could be used to measure common consortia services’ performance, thus contributing to consortia assessment.Adjusting the library performance standards for consortia services: a case study
Thalia Gonda, Christos Papatheodorou
Performance Measurement and Metrics, Vol. 24, No. 3/4, pp.133-154

This study proposes a framework for performance measurement of library consortia services by implementing the indicators listed in ISO 11620. The framework is validated by using real data from HEAL-Link, the national consortium of Greek academic and research libraries to calculate the indicators.

The paper reports on the related work regarding the services consortia offer to their members and the known methods and tools for assessing consortia services; the HEAL-Link case study, the aggregation and handling of data, is presented; ISO 11620 performance indicators for HEAL-Link services are calculated, and the results are discussed in terms of what was learnt- about the consortium, about measuring consortia services performance, and about the standard.

ISO 11620 could be used to measure performance for assessing consortia services. The performance indicators’ results reflect the two major events (mergers and COVID pandemic) that took place during the time of the study. ISO 11620 offers a basic insight that could be well complemented with other tools and standards.

The current study suggests that a widely accepted, easily applied, benchmarking ISO standard could be used to measure common consortia services’ performance, thus contributing to consortia assessment.

]]>
Adjusting the library performance standards for consortia services: a case study10.1108/PMM-04-2023-0010Performance Measurement and Metrics2023-08-28© 2023 Emerald Publishing LimitedThalia GondaChristos PapatheodorouPerformance Measurement and Metrics243/42023-08-2810.1108/PMM-04-2023-0010https://www.emerald.com/insight/content/doi/10.1108/PMM-04-2023-0010/full/html?utm_source=rss&utm_medium=feed&utm_campaign=rss_journalLatest© 2023 Emerald Publishing Limited
Digital competence landscape in public libraries: examining the role of age and gender in the development of digital skillshttps://www.emerald.com/insight/content/doi/10.1108/PMM-03-2022-0012/full/html?utm_source=rss&utm_medium=feed&utm_campaign=rss_journalLatestAs part of the EFOP-3.3.3-VEKOP-16–2016-00001 “Museum and Library Development for All” project, a national representative digital literacy survey was conducted in Hungary's public libraries at the end of 2019. The aim of the present study is to provide a deeper analysis of the data collected during the survey to answer the question of the role of gender and age in the development of digital skills amongst librarians working in public libraries. This study was designed to answer the following four research questions: Are there levels of proficiency defined by DigComp 2.1 that are more specific to men or more specific to women? Are there areas of competence and competences that are clearly perceived as stronger or weaker for men or women? Are there areas of competence that are clearly influenced by age and others that are not or only moderately influenced by age? Which competences are clearly age-related, and which are not or only slightly affected by age? The main target group of the study were library professionals working in county libraries. The survey, based on the DigComp 2.1 (Gomez et al., 2017) framework, was conducted using an online questionnaire in the form of a self-assessment and explored four levels of digital literacy. A 30-question questionnaire was completed by 1,868 respondents. The sampling procedure was essentially stratified sampling. The large number of respondents and the sampling procedure combined with the representativeness of the sample meant that the results of the survey can be considered as generalisable to the whole Hungarian public library sector. Of the five competency areas assessed by the DigComp framework, librarians were found to be most competent in information and data literacy, and least competent in content development, according to the proportion of those with basic skills. 32 percent of women and 22 percent of men working in libraries rated their digital skills as basic, and both groups were weak or less weak in the same skills, with a few exceptions. At the intermediate level, there is a predominance of women. In the information and communication competency areas and in the content development and integrating and re-elaborating digital content in the content creation area, a high proportion of women consider their digital skills to be medium. Relatively few men rate their own competence in these areas as average. They are most likely to have advanced and highly specialised skills. The advanced level in DigComp2.1 implies, in addition to strong digital skills, the willingness and ability to help others, while the highly specialised level requires innovative and creative use of digital technology and knowledge transfer. These top two skill levels are more common amongst men. 34 per cent of men and 27 per cent of women have advanced skills, while 13 per cent of men and 6 per cent of women have highly specialised’s level. The age of librarians has only a minimal influence in certain areas of competence and for certain competences. Skills in the information and data literacy competency area are less age sensitive. For the data management competency, which requires more technological skills, a stronger correlation between age and skill levels is observed, especially for basic and highly specialised skills. In the communication competence area, the youngest age group of librarians has the highest percentage of advanced and the lowest percentage of basic level. The proportion of advanced learners decreases steadily as age groups progress and the proportion of basic learners increases at a similar steady rate. The effect of age on the content creation is much more modest than expected. Age clearly has an impact on the safety competence area. As age increases, the proportion of those at advanced level decreases and the proportion at basic level increases. Age also has a significant effect on the problem-solving competence area. One in two librarians in the 50 and 60s have only basic level skills, compared to one in four in the youngest age group and one in three in the 40s. Using the DigComp 2.1 framework, a digital competence survey of a whole professional group of library professionals working in public libraries in Hungary was carried out. The study provides new insights into the impact of gender and age as variables on digital competence.Digital competence landscape in public libraries: examining the role of age and gender in the development of digital skills
Maria Borbely, Margit Némethi-Takács
Performance Measurement and Metrics, Vol. 24, No. 3/4, pp.155-175

As part of the EFOP-3.3.3-VEKOP-16–2016-00001 “Museum and Library Development for All” project, a national representative digital literacy survey was conducted in Hungary's public libraries at the end of 2019. The aim of the present study is to provide a deeper analysis of the data collected during the survey to answer the question of the role of gender and age in the development of digital skills amongst librarians working in public libraries. This study was designed to answer the following four research questions: Are there levels of proficiency defined by DigComp 2.1 that are more specific to men or more specific to women? Are there areas of competence and competences that are clearly perceived as stronger or weaker for men or women? Are there areas of competence that are clearly influenced by age and others that are not or only moderately influenced by age? Which competences are clearly age-related, and which are not or only slightly affected by age?

The main target group of the study were library professionals working in county libraries. The survey, based on the DigComp 2.1 (Gomez et al., 2017) framework, was conducted using an online questionnaire in the form of a self-assessment and explored four levels of digital literacy. A 30-question questionnaire was completed by 1,868 respondents. The sampling procedure was essentially stratified sampling. The large number of respondents and the sampling procedure combined with the representativeness of the sample meant that the results of the survey can be considered as generalisable to the whole Hungarian public library sector.

Of the five competency areas assessed by the DigComp framework, librarians were found to be most competent in information and data literacy, and least competent in content development, according to the proportion of those with basic skills. 32 percent of women and 22 percent of men working in libraries rated their digital skills as basic, and both groups were weak or less weak in the same skills, with a few exceptions. At the intermediate level, there is a predominance of women. In the information and communication competency areas and in the content development and integrating and re-elaborating digital content in the content creation area, a high proportion of women consider their digital skills to be medium. Relatively few men rate their own competence in these areas as average. They are most likely to have advanced and highly specialised skills. The advanced level in DigComp2.1 implies, in addition to strong digital skills, the willingness and ability to help others, while the highly specialised level requires innovative and creative use of digital technology and knowledge transfer. These top two skill levels are more common amongst men. 34 per cent of men and 27 per cent of women have advanced skills, while 13 per cent of men and 6 per cent of women have highly specialised’s level. The age of librarians has only a minimal influence in certain areas of competence and for certain competences. Skills in the information and data literacy competency area are less age sensitive. For the data management competency, which requires more technological skills, a stronger correlation between age and skill levels is observed, especially for basic and highly specialised skills. In the communication competence area, the youngest age group of librarians has the highest percentage of advanced and the lowest percentage of basic level. The proportion of advanced learners decreases steadily as age groups progress and the proportion of basic learners increases at a similar steady rate. The effect of age on the content creation is much more modest than expected. Age clearly has an impact on the safety competence area. As age increases, the proportion of those at advanced level decreases and the proportion at basic level increases. Age also has a significant effect on the problem-solving competence area. One in two librarians in the 50 and 60s have only basic level skills, compared to one in four in the youngest age group and one in three in the 40s.

Using the DigComp 2.1 framework, a digital competence survey of a whole professional group of library professionals working in public libraries in Hungary was carried out. The study provides new insights into the impact of gender and age as variables on digital competence.

]]>
Digital competence landscape in public libraries: examining the role of age and gender in the development of digital skills10.1108/PMM-03-2022-0012Performance Measurement and Metrics2023-09-04© 2023 Emerald Publishing LimitedMaria BorbelyMargit Némethi-TakácsPerformance Measurement and Metrics243/42023-09-0410.1108/PMM-03-2022-0012https://www.emerald.com/insight/content/doi/10.1108/PMM-03-2022-0012/full/html?utm_source=rss&utm_medium=feed&utm_campaign=rss_journalLatest© 2023 Emerald Publishing Limited
Examining measurement invariance of an ICT literacy self-efficacy scale across gender: a comparative studyhttps://www.emerald.com/insight/content/doi/10.1108/PMM-03-2021-0014/full/html?utm_source=rss&utm_medium=feed&utm_campaign=rss_journalLatestDespite the ever-increasing importance of cultivating information, communication and technology literacy skills among college students, they have yet to be related to comprehensive measuring instruments. A glance at the empirical literature reveals that most pertinent scales have been confined to measuring Internet literacy skills, whereas educators in the 21st century advocate an inclusive conceptualization of ICT literacy. Such a comprehensive conceptualization embodies technical, critical, cognitive and emotional competencies. Additionally, more empirical evidence is needed to indicate gaps in testing measurement invariance of ICT literacy scales across genders or cultures. To that end, the current study aims to adapt and cross-validate an ICT literacy self-efficacy scale across gender by testing the measurement invariance using a multiple-sampling confirmatory factor analysis (MCFA). Furthermore, the current study aims to verify the ICT literacy self-efficacy scale's psychometric properties to establish its construct validity and understand the scale's underlying factorial structure. The current study has administered the scale to a cross-sectional sample of 3560 undergraduate students enrolled in six universities in the Sultanate of Oman. The results have revealed that the ICT literacy self-efficacy exhibits satisfactory indices of construct validity. On the other hand, the results of MCFA demonstrate that the differences in the goodness of fit indices between the nested models and the baseline model were below the cut-off criterion of 0.01, indicating invariance. Therefore, the scale has proved to be amenable for comparing genders on their ICT literacy self-efficacy using an one-way multivariate analysis of variance. The study has several implications for research and pedagogical practices. The study provides empirical evidence for establishing ICT literacy self-efficacy as a distinct high-domain construct of task-specific self-efficacy beliefs.Examining measurement invariance of an ICT literacy self-efficacy scale across gender: a comparative study
Maryam Nasser Al-Nuaimi
Performance Measurement and Metrics, Vol. 24, No. 3/4, pp.176-194

Despite the ever-increasing importance of cultivating information, communication and technology literacy skills among college students, they have yet to be related to comprehensive measuring instruments. A glance at the empirical literature reveals that most pertinent scales have been confined to measuring Internet literacy skills, whereas educators in the 21st century advocate an inclusive conceptualization of ICT literacy. Such a comprehensive conceptualization embodies technical, critical, cognitive and emotional competencies. Additionally, more empirical evidence is needed to indicate gaps in testing measurement invariance of ICT literacy scales across genders or cultures. To that end, the current study aims to adapt and cross-validate an ICT literacy self-efficacy scale across gender by testing the measurement invariance using a multiple-sampling confirmatory factor analysis (MCFA). Furthermore, the current study aims to verify the ICT literacy self-efficacy scale's psychometric properties to establish its construct validity and understand the scale's underlying factorial structure.

The current study has administered the scale to a cross-sectional sample of 3560 undergraduate students enrolled in six universities in the Sultanate of Oman.

The results have revealed that the ICT literacy self-efficacy exhibits satisfactory indices of construct validity. On the other hand, the results of MCFA demonstrate that the differences in the goodness of fit indices between the nested models and the baseline model were below the cut-off criterion of 0.01, indicating invariance. Therefore, the scale has proved to be amenable for comparing genders on their ICT literacy self-efficacy using an one-way multivariate analysis of variance.

The study has several implications for research and pedagogical practices. The study provides empirical evidence for establishing ICT literacy self-efficacy as a distinct high-domain construct of task-specific self-efficacy beliefs.

]]>
Examining measurement invariance of an ICT literacy self-efficacy scale across gender: a comparative study10.1108/PMM-03-2021-0014Performance Measurement and Metrics2023-09-08© 2023 Emerald Publishing LimitedMaryam Nasser Al-NuaimiPerformance Measurement and Metrics243/42023-09-0810.1108/PMM-03-2021-0014https://www.emerald.com/insight/content/doi/10.1108/PMM-03-2021-0014/full/html?utm_source=rss&utm_medium=feed&utm_campaign=rss_journalLatest© 2023 Emerald Publishing Limited
Exploring belonging through photovoice: examining the impact of space design on diverse student populations in an academic libraryhttps://www.emerald.com/insight/content/doi/10.1108/PMM-08-2023-0023/full/html?utm_source=rss&utm_medium=feed&utm_campaign=rss_journalLatestThis paper aims to uncover characteristics of physical spaces that evoke feelings of welcome and belonging in a diverse student population in an academic library. The photovoice method was used to allow research participants an active role in shaping research questions and collecting and analyzing data. The research reveals that space design significantly influences students' feelings of physical safety, emotional well-being and safety and ownership (or sense of belonging) in academic library spaces, thereby emphasizing the importance of considering space design in promoting student well-being and inclusiveness. This research used photovoice methodology to engage underrepresented student communities in providing input into the design of library spaces.Exploring belonging through photovoice: examining the impact of space design on diverse student populations in an academic library
Leslie Poljak, Berenika M. Webster, Renee Kiner
Performance Measurement and Metrics, Vol. 24, No. 3/4, pp.195-210

This paper aims to uncover characteristics of physical spaces that evoke feelings of welcome and belonging in a diverse student population in an academic library.

The photovoice method was used to allow research participants an active role in shaping research questions and collecting and analyzing data.

The research reveals that space design significantly influences students' feelings of physical safety, emotional well-being and safety and ownership (or sense of belonging) in academic library spaces, thereby emphasizing the importance of considering space design in promoting student well-being and inclusiveness.

This research used photovoice methodology to engage underrepresented student communities in providing input into the design of library spaces.

]]>
Exploring belonging through photovoice: examining the impact of space design on diverse student populations in an academic library10.1108/PMM-08-2023-0023Performance Measurement and Metrics2023-10-09© 2023 Emerald Publishing LimitedLeslie PoljakBerenika M. WebsterRenee KinerPerformance Measurement and Metrics243/42023-10-0910.1108/PMM-08-2023-0023https://www.emerald.com/insight/content/doi/10.1108/PMM-08-2023-0023/full/html?utm_source=rss&utm_medium=feed&utm_campaign=rss_journalLatest© 2023 Emerald Publishing Limited
Measuring the social impact of funded research over nonfunded: a case study of BRICShttps://www.emerald.com/insight/content/doi/10.1108/PMM-01-2023-0001/full/html?utm_source=rss&utm_medium=feed&utm_campaign=rss_journalLatestThe study showcases the social impact (online attention) of funded research compared to nonfunded for the BRICS nations. The key themes achieving online attention across the funded and nonfunded publications have also been identified. A total of 1,507,931 articles published across the BRICS nations for a period of three (03) years were downloaded from the Clarivate Analytics' InCites database of Web of Science (WoS). “Funding Acknowledgement Analysis (FAA)” was used to identify the funded and nonfunded publications. The altmetric score of the top highly cited (1%) publications was gauged from the largest altmetric data provider, “Altmetric.com”, using the DOI of each publication. One-way ANOVA test was used to know the impact of funding on the mentions (altmetrics) across different data sources covered by Altmetric.com. The highly predominant keywords (hotspots) have been mapped using bibliometric software, “VOSviewer”. The mentions across all the altmetric sources for funded research are higher compared to nonfunded research for all nations. It indicates the altmetric advantage for funded research, as funded publications are more discussed, tweeted, shared and have more readers and citations; thus, acquiring more social impact/online attention compared to nonfunded publications. The difference in means for funded and nonfunded publications varies across various altmetric sources and nations. Further, the authors’ keyword analysis reveals the prominence of the respective nation names in publications of the BRICS. The study showcases the utility of indexing the funding information and whether research funding increases social impact return (online attention). It presents altmetrics as an important impact assessment and evaluation framework indicator, adding one more dimension to the research performance. The linking of funding information with the altmetric score can be used to assess the online attention and multi-flavoured impact of a particular funding programme and source/agency of a nation so that necessary strategies would be framed to improve the reach and impact of funded research. It identifies countries that achieve significant online attention for their funded publications compared to nonfunded ones, along with the key themes that can be utilised to frame research and investment plans. The study represents the social impact of funded research compared to nonfunded across the BRICS nations.Measuring the social impact of funded research over nonfunded: a case study of BRICS
Sheikh Shueb, Sumeer Gul, Aabid Hussain Kharadi, Nahida Tun Nisa, Farzana Gulzar
Performance Measurement and Metrics, Vol. ahead-of-print, No. ahead-of-print, pp.-

The study showcases the social impact (online attention) of funded research compared to nonfunded for the BRICS nations. The key themes achieving online attention across the funded and nonfunded publications have also been identified.

A total of 1,507,931 articles published across the BRICS nations for a period of three (03) years were downloaded from the Clarivate Analytics' InCites database of Web of Science (WoS). “Funding Acknowledgement Analysis (FAA)” was used to identify the funded and nonfunded publications. The altmetric score of the top highly cited (1%) publications was gauged from the largest altmetric data provider, “Altmetric.com”, using the DOI of each publication. One-way ANOVA test was used to know the impact of funding on the mentions (altmetrics) across different data sources covered by Altmetric.com. The highly predominant keywords (hotspots) have been mapped using bibliometric software, “VOSviewer”.

The mentions across all the altmetric sources for funded research are higher compared to nonfunded research for all nations. It indicates the altmetric advantage for funded research, as funded publications are more discussed, tweeted, shared and have more readers and citations; thus, acquiring more social impact/online attention compared to nonfunded publications. The difference in means for funded and nonfunded publications varies across various altmetric sources and nations. Further, the authors’ keyword analysis reveals the prominence of the respective nation names in publications of the BRICS.

The study showcases the utility of indexing the funding information and whether research funding increases social impact return (online attention). It presents altmetrics as an important impact assessment and evaluation framework indicator, adding one more dimension to the research performance. The linking of funding information with the altmetric score can be used to assess the online attention and multi-flavoured impact of a particular funding programme and source/agency of a nation so that necessary strategies would be framed to improve the reach and impact of funded research. It identifies countries that achieve significant online attention for their funded publications compared to nonfunded ones, along with the key themes that can be utilised to frame research and investment plans.

The study represents the social impact of funded research compared to nonfunded across the BRICS nations.

]]>
Measuring the social impact of funded research over nonfunded: a case study of BRICS10.1108/PMM-01-2023-0001Performance Measurement and Metrics2024-01-29© 2024 Emerald Publishing LimitedSheikh ShuebSumeer GulAabid Hussain KharadiNahida Tun NisaFarzana GulzarPerformance Measurement and Metricsahead-of-printahead-of-print2024-01-2910.1108/PMM-01-2023-0001https://www.emerald.com/insight/content/doi/10.1108/PMM-01-2023-0001/full/html?utm_source=rss&utm_medium=feed&utm_campaign=rss_journalLatest© 2024 Emerald Publishing Limited
Measuring performance of metasearch engines to access information: an exploratory study based on precision metricshttps://www.emerald.com/insight/content/doi/10.1108/PMM-09-2023-0028/full/html?utm_source=rss&utm_medium=feed&utm_campaign=rss_journalLatestThis paper evaluates the precision of four metasearch engines (MSEs) – DuckDuckGo, Dogpile, Metacrawler and Startpage, to determine which metasearch engine exhibits the highest level of precision and to identify the metasearch engine that is most likely to return the most relevant search results. The research is divided into two parts: the first phase involves four queries categorized into two segments (4-Q-2-S), while the second phase includes six queries divided into three segments (6-Q-3-S). These queries vary in complexity, falling into three types: simple, phrase and complex. The precision, average precision and the presence of duplicates across all the evaluated metasearch engines are determined. The study clearly demonstrated that Startpage returned the most relevant results and achieved the highest precision (0.98) among the four MSEs. Conversely, DuckDuckGo exhibited consistent performance across both phases of the study. The study only evaluated four metasearch engines, which may not be representative of all available metasearch engines. Additionally, a limited number of queries were used, which may not be sufficient to generalize the findings to all types of queries. The findings of this study can be valuable for accreditation agencies in managing duplicates, improving their search capabilities and obtaining more relevant and precise results. These findings can also assist users in selecting the best metasearch engine based on precision rather than interface. The study is the first of its kind which evaluates the four metasearch engines. No similar study has been conducted in the past to measure the performance of metasearch engines.Measuring performance of metasearch engines to access information: an exploratory study based on precision metrics
Raj Kumar Bhardwaj, Ritesh Kumar, Mohammad Nazim
Performance Measurement and Metrics, Vol. ahead-of-print, No. ahead-of-print, pp.-

This paper evaluates the precision of four metasearch engines (MSEs) – DuckDuckGo, Dogpile, Metacrawler and Startpage, to determine which metasearch engine exhibits the highest level of precision and to identify the metasearch engine that is most likely to return the most relevant search results.

The research is divided into two parts: the first phase involves four queries categorized into two segments (4-Q-2-S), while the second phase includes six queries divided into three segments (6-Q-3-S). These queries vary in complexity, falling into three types: simple, phrase and complex. The precision, average precision and the presence of duplicates across all the evaluated metasearch engines are determined.

The study clearly demonstrated that Startpage returned the most relevant results and achieved the highest precision (0.98) among the four MSEs. Conversely, DuckDuckGo exhibited consistent performance across both phases of the study.

The study only evaluated four metasearch engines, which may not be representative of all available metasearch engines. Additionally, a limited number of queries were used, which may not be sufficient to generalize the findings to all types of queries.

The findings of this study can be valuable for accreditation agencies in managing duplicates, improving their search capabilities and obtaining more relevant and precise results. These findings can also assist users in selecting the best metasearch engine based on precision rather than interface.

The study is the first of its kind which evaluates the four metasearch engines. No similar study has been conducted in the past to measure the performance of metasearch engines.

]]>
Measuring performance of metasearch engines to access information: an exploratory study based on precision metrics10.1108/PMM-09-2023-0028Performance Measurement and Metrics2024-03-18© 2024 Emerald Publishing LimitedRaj Kumar BhardwajRitesh KumarMohammad NazimPerformance Measurement and Metricsahead-of-printahead-of-print2024-03-1810.1108/PMM-09-2023-0028https://www.emerald.com/insight/content/doi/10.1108/PMM-09-2023-0028/full/html?utm_source=rss&utm_medium=feed&utm_campaign=rss_journalLatest© 2024 Emerald Publishing Limited