M

https://docs.google.com/presentation/d/1RaoAwjtadk0j-QJJt-zflrVHRO1wdkQe5Fjwt-sgmiI/edit?usp=sharing

https://docs.google.com/presentation/d/1RaoAwjtadk0j-QJJt-zflrVHRO1wdkQe5Fjwt-sgmiI/edit?usp=sharing

Introduction

Transition from traditional to open science

Measuring research impact is a legacy of traditional science to credit important research over less important ones. 

Question is how does it fit in the open science concept?

Every research could be important at some point. The research that seems useless at the moment may lead to the next scientific breakthrough in future. 

Also people depending on their personal perspective may have different definitions of importance.

We believe what we should really care about in open science is the Quality and Relevance of a research to society demands.

How we can make sure science serves our society

We are dealing with hyperobject problems like global warming which are very hard to tackle with traditional science. 

It seems we need more radical and diverse scientific research to increase our chance to win our future.

How can we diversify scientific research?

Diversity is one of the main characteristics of human societies, people think differently, they have different passions, desires, and different agendas.

If we evaluate scientific research by their relevance to society demands we bring that diversity to science, and at the same time we let the science be more aligned with society needs.

Our solution

We introduced a measurement method to quantify the Quality and Relevance of a research to society demands. We did it in 4 steps:

1- Defining an impact index

We can create Communities Top Priority Distribution (CTPD) index which extracted from available surveying platforms like National Community Survey 

Each priority of the CTPD has weight which is calculated by surveying people's top most priorities. 

For example, 20% Economy in the above table means 20% of people consider Economy as their top most priority.

Also we can create micro indexes to target specific communities.

For example, the index SHE could include Safety, Health and Economy. The index ENS could include Education, Natural environment and Sense of community.

People have different priorities so it makes sense we let them create their own indexes. Some indexes may be quite radical, which is good because it addresses a real concern of the society.

In a democratic open science we want to make sure science also serves minorities.

For example, Theology and Spirituality might be an important demand from parts of the society which are not completely supported by traditional science.

2 - Adding context tags to research papers

Peer scientist reviewers who are experts in the same field add context tags to the research paper. We design software to help them to easily find relevant contexts.

This software uses natural language processing algorithms and decision tree classifiers to automatically read the paper and match relevant contexts and tags with CTPD items.

3 - Measuring the papers's quality

Peer scientist reviewers also can give a score of 1 to 5 to a research quality. This would be similar to other well-known quality score system.

We can use the existing open science platforms to record these quality scores along with the number of reviews.

4 - Calculating research impact on each index

We can calculate research impact on index X by following formula:

For example, for a research paper which:

Average review score: 3.5

Number of reviewers: 27

Relevant tags: Economy, Natural environment

Impact on CTPD calculated as 

3.5 x 27 x (0.2 + 0.14) = 32.13 

We only sum the Economy and Natural environment weight because they are common tags with CTPD index

Why should we use this measurement method?

• Research will be more aligned to the society demands
• Research will inherit diversity from human society
• It create an infrastructure for communities to directly support their favorite research
• It is more democratic and fair for scientists and society members
• It provides real time dynamic impact value which automatically updates after each peer review or change in society demands.

By reading https://www.earthdata.nasa.gov/learn/data-chats/data-chat-kaylin-bugbee I got idea about how open science works.

It all starts with baby step to register.

Then it's unbelievable how much I learned, met new people, discovered my capabilities and understood my limits during just two days.

Specially our organiser in Perth location provided us a relaxed, friendly and inspiring event. I felt fully supported during the event.

That was a memorable experience which pushed me to next level of my life.

The National Community Survey

Open Science Framework

Measuring research impact

#open, #science, #impact, #research, #society, #community, #scientists, #researcher, #paper, #open science