#SciValFest2020 - Meet ICSR: Data analytics and responsible (biblio)metrics

In an increasingly competitive, complex and dynamic research environment, the needs for tracking and showcasing your research performance leads to weighing the options for investing in (or not) a Current Research Information System, or CRIS. But from interoperability with other systems to reporting needs and challenges to the “build or buy” dilemma, making the decision to implement a CRIS can present its own challenges.

In an increasingly competitive, complex and dynamic research environment, the needs for tracking and showcasing your research performance leads to weighing the options for investing in (or not) a Current Research Information System, or CRIS. But from interoperability with other systems to reporting needs and challenges to the “build or buy” dilemma, making the decision to implement a CRIS can present its own challenges.

In an increasingly competitive, complex and dynamic research environment, the needs for tracking and showcasing your research performance leads to weighing the options for investing in (or not) a Current Research Information System, or CRIS. But from interoperability with other systems to reporting needs and challenges to the “build or buy” dilemma, making the decision to implement a CRIS can present its own challenges.

Each year the date ranges available in SciVal are moved forward by one years to make the latest year of data available for use. In 2021, this will occur on June 15th. To help you prepare for the year range change, please join this webinar where SciVal Product Manager, Heesang Jeon will explain the changes you can expect with this release, along with handy tips on how to save your analyses with the current year ranges and use report templates to speed up the whole process.

Research assessment should not be centered solely on bibliometrics such as publication and citation metrics but should encompass other measures that address the broad range of assessment-related questions. These cover research inputs, outputs and outcomes, such as funding, collaboration, usage, commercialization and the adoption of innovation. As more diverse data sources and metrics are used, a richer and more informative picture of research emerges.

The International Center for the Study of Research (ICSR) was established by Elsevier in 2019 with a mission to further the study of research and thus to contribute to the evidence base supporting the practice of research strategy, evaluation and policy. In 2020, ICSR and Elsevier signed the Declaration on Research Assessment (DORA) and endorsed the Leiden Manifesto for Research Metrics, two internationally-recognized statements of best practice in responsible research assessment.

In this Library Connect webinar, Christopher Belter will discuss what responsible research assessment might look like in practice for a large biomedical funding agency. ICSR staff members Andrew Plume and Holly Falk-Krzesinski will then discuss the recommendations of both DORA and the Leiden Manifesto and their implications for Elsevier as well as for librarians and their users.

Introduction:
M.J. Tooey, Associate Vice President, Academic Affairs and Executive Director, Health Sciences and Human Services Library, University of Maryland, Baltimore
Presenters:
Christopher Belter, Program Analyst, Eunice Kennedy Shriver NICHD Development
Holly Falk-Krzesinski, Vice President, Research Intelligence, Elsevier
Andrew Plume, President, International Center for the Study of Research; and Senior Director of Research Evaluation, Elsevier

One of the primary purposes of the IR is to serve an institution’s faculty by representing the full breadth of their works. However, creating a comprehensive archive is one of the hardest, most burdensome challenges for IR managers.

Register now to learn about the new Scopus-to-Digital Commons harvesting API, which can save IR managers up to 90% of the time it typically takes to add faculty publication records into the IR.

Hear from two institutions, Michigan Technological University and Missouri University of Science and Technology, as they share their experiences using the API to populate their IRs and showcase their faculty’s work to the world.

Live audience Q&A will follow.

Presenters:
- Shandon Quinn, VP Product Management, Digital Commons
- Annelise Doll, Scholarly Communications and Repositories Librarian, Michigan Tech University
- Nancy Krost, Institutional Repository Coordinator, Missouri University of Science and Technology

Funding is a major priority for research institutions but finding and securing grants is a time-consuming and increasingly competitive process. To succeed you need to gain insight into the complicated funding landscape, discover hidden opportunities and make informed decisions.

It comes down to having the right information – the right insights – to select the bids best suited to researchers’ areas of expertise.

Elsevier’s Funding Institutional offers access to that vital information with over 21K active, multidisciplinary grants from a wide array of public and private funders from around the world, over 6.7M awards and over 5,300 funder profiles.

CERIF is the European standard for research information management maintained by the euroCRIS non-profit association in the Netherlands. CERIF exists to ensure that research information may be shared, exchanged and mined across Current Research Information Systems or CRISs of various kinds including institutional, subject-specific, regional, national and funder ones. The way this is achieved is via the definition of a harmonised relational entity data model that covers the main conceptual elements associated to research. People (researchers), organisations (institutions) and research projects are the core entities of the CERIF data model, to which a number of secondary ones are connected such as research publications, research instruments and facilities or research data and patents.

The presentation will describe the CERIF data model and show several of its applications to improve system interoperability, including the integration with the European OpenAIRE Open Science infrastructure.

With research funding waning, and competition increasing, institutions need every advantage to secure research funding. And with an average of 38 days’ work required to develop a proposal, increasing efficiencies and saving time are optimal. Learn how, working together, Pure and Funding Institutional offer institutions a new solution to the old problem of finding funding opportunities with the best chances for success.

Taipei Medical University’s Academic Hub / Pure Experts research system was established in January 2016 with the President’s support in order to underpin strategic planning goals. Up to now the system has cataloged 1,322 experts’ profiles including full-time professors and visiting staff from the Taipei Medical University(TMU) Healthcare System. The total number of the platform page views has reached around 3 million.

In the past year, we even received 90,000 page views a month. Through deep integration with SciVal from 2018, articles under the Pure group structure from organizations such as colleges, research centers, and entire universities, can be further analyzed using SciVal. In addition, the research metrics enable TMU to support fact-based decision making and faulty performance evaluation. The goal of the research management system is to boost TMU’s research visibility and propel international collaboration with TMU’s researchers.

This presentation sets out how we promote TMU’s Academic Hub / Pure Experts Research System to improve platform visibility, data integrity, and data accuracy. We accomplished this in a variety of ways, by conducting various activities such as training courses, international conferences, video recordings, and press releases. Furthermore, we commissioned a survey questionnaire to collect user behaviors including access channels, frequency of use, the purpose of use, system functional requirements, and system satisfaction. We also executed an analysis based on researcher's needs to evaluate the system user experience from a researcher's point of view. This will help us to plan our future applications of the system.

At Monash, managing Pure operations involves continually interacting with the changes in both Pure and other University systems as well as changes in business processes whilst keeping the system operational and up to date. In this session we will look into how we manage Pure, including the various integrations of Pure with upstream and downstream systems, the automations enabled to assist with user access management and the extensive testing processes followed as part of the release management.

We will also discuss some of the infrastructure improvements that have enabled us to have more flexible Pure environments, thereby enabling the business to rapidly onboard new processes and modules, without interrupting other ongoing projects within Pure. Monash University is one of the leading universities in Australia with over 86,000 students and 9,000 FTE staff. Research at Monash occurs over 10 Faculties, with approximately 10,000 outputs published per year, over 3500 funding applications submitted per annum and in 2019 were awarded the 3rd highest amount of research income in Australia from the 2 major national funding bodies.

The arrival of COVID-19 threw changes at many of us; a significant change being no longer able to interact with people directly and the rise of the "Zoom" meeting and virtual interactions.

Whilst this may have been a challenge for other Pure User Groups, the Australian and New Zealand (ANZ) Pure User Group have been meeting virtually for over 3 years.

Participaing in virtual meetings and managing a user group meeting virtually can have challenges such as getting user participation, allowing robust discussion, determining consensus on issues and managing the mute button.

This presentation will explore the challenges and offer some of the strategies which have been used by the ANZ Pure User Group to both encourage participation and allow for effective management of virtual meetings.

The University of Western Australia originally acquired Pure in 2014 as a Repository and source of truth for publication information. Since then, it has steadily expanded to include a greater breadth of information on researchers and has replaced the University’s contact directory for staff profile information.

The Research Office and Faculties in the University of Western Australia are increasingly relying on Pure to identify researchers by expertise and research area. Fingerprints have been a popular way to identify researchers in specific fields and for finding collaborators and mentors, as well as more recently, for matching researchers with funding opportunities.

Our team has been working closely with Elsevier to improve fingerprint aggregation in our researchers’ profiles. We will outline the advantages and limitations of using fingerprints.

During the early months of the COVID-19 pandemic, the submission rate to scholarly journals increased abnormally (e.g., more than 90% in Elsevier’s health & medicine journals). Given that most academics have been forced to work from home, the competing demands for home-schooling, child and other care duties might have penalised the scientific productivity of women. To test this hypothesis, we looked at submitted manuscripts and peer review activities for all Elsevier journals between February and May 2018-2020, including data on almost 6 million academics. Results showed that women submitted proportionally fewer manuscripts than men during the COVID-19 lockdown months. This deficit was especially pronounced among women in more advanced stages of their career. The rate of peer-review invitation acceptance showed a less pronounced gender pattern, with the exception of health & medicine, where women were also less keen to accept reviewing. Our findings indicate that the pandemic has already created cumulative advantages for men.

Performance measurement is a core driver for an organisational growth and can serve as an early institutional health check system. While the concept of a dashboard has been widely used in the private sector for years, the interest in business intelligence, data analytics, and data visualisation in relation to measuring individual academic performance expectations grew just recently.

This session will shed a light on Total Research Explorer (T-Rex) designed to monitor the individual progress against Performance Expectations for Academic Staff (PEAS) at the University of Canberra. We will focus on the dashboard structure, user experience design, and integration with external dynamic and static data sources.

Special attention will be devoted to the integration with the Pure Research Management System highlighting the potential issues and roadmap for future development.

The interoperability of persistent identifiers (PIDs) like ORCID and Current Research Information Systems (CRIS) like Pure manifests a global-scale research infrastructure, which enables trusted connections and serves as the foundation for Open Science. This presentation will give an overview on ORCID and Pure collaborations, specifically how the Pure community in the APAC region can benefit from adopting PIDs like ORCID to support the principles of Open Science.

Making science truly open relies on improving data quality and transparency, so that not only can researchers easily share their work, but research institutes can easily acquire the most accurate and up-to-date research information in an open and interoperable way. Such interoperability requires a robust, global-scale infrastructure that enables linkages between researchers, research institutions, publishers, and funding organizations.

The use of PIDs—like ORCID—along with a CRIS—such as Elsevier’s Pure—supports the research community in collecting, managing, analyzing and showcasing data about the research conducted at an institution. This is realized by research institutions asserting affiliations to researchers’ ORCID records, exporting other data to researchers’ ORCID records, such as other identifiers (like Scopus Author ID) or research outputs. Research institutes can collect information about their researchers like awards or works connected to the ORCID Registry by publishers or funders to curate data in Pure. Integrating ORCID iDs into Pure reduces administrative burden and allows research institutes to reliably link researchers with their contributions and affiliations, and to synchronize data between Pure and multiple platforms.

We constantly look at how to improve the metrics available to you. Authorship analyses and contribution to the UN SDGs are two such improvements happening in 2020.

In many disciplines, different types of authorship are indicated on the publication and can be used as a proxy of the researcher's contribution in the research done on the publication.

This session will introduce the new authorship metrics on SciVal, along with the SDG Research Mapping Initiative which is currently trying to improve the document to SDG mapping and builds upon last year's presentation.

Funders and publishers increasingly require research data related to publications to be shared openly. The University of Western Australia uses the Pure platform to provide a functional data publishing service to our researchers.

Our team within the University Library migrated research data from the open source DSpace platform to Pure in 2016. We were the first Australian institution to implement the Dataset Module within Pure and the journey has been has been somewhat different to that experienced by perhaps Europe or the United States.

Challenges have included DOI minting, harvesting metadata into Research Data Australia (RDA), bulk importing records via XML and adding externally-published dataset metadata into Pure. We are excited to present how we overcame our challenges including leveraging new developments in Pure (e.g. Data Monitor) to to gain a clear picture of UWA data being produced, enhancing the visibility of staff profiles and via RDA.

2020 will go down as a year to remember! This has forced us all to adapt and change. How do you stay connected while being physically disconnected? The ANZ Community Portal was step-up by Elsevier with this challenge in mind.

Its purpose to is to provide the ANZ community a place where experts can be found, existing research can be discovered, and research institutions can be highlighted. COVID impact is much wider that just the medical aspects, let's combine the individuals, work together and show case them in one location.

This presentation is about the challenges faced in setting this up, how it has been used and next planned steps. Research in its collaborative nature. Developing systems like this can only help to make that process easier.