Tesis
Improving Knowledge Infrastructures: A case study of UNESCO’s Global Observatory of Science, Technology and Innovation Policy Instruments (Go-Spin)
Autor
Valenzuela, Maria Jesus
Aquaro, Alessia
Calve, Manuel
Carrillo, Eduardo
Frigerio, Catalina
Sandoval, Maria Paz
Institución
Resumen
This report represents the deliverable to the United Nations Educational, Scientific and Cultural Organization (UNESCO) and University College London (UCL) following a 9-month investigation of the Global Observatory for Science, Technology and Innovation Policy (Go-Spin)’s digital platform.
Go-Spin aims to close the knowledge gap related to STI capacities to address the Sustainable Development Goals. It focuses on developing countries and Least Developed Countries (LDCs) However, since its launch in 2018, the platform does not seem to have achieved the expected impact.
The study constitutes an assessment of the Go-Spin platform with the aim of diagnosing current issues and recommending actions to improve the platform’s methodologies and usability. To achieve its aim, the research used research-action methodology to conduct a practice-oriented case study
on Go-Spin. This involved evaluating its data journey, analysing its strengths and weaknesses, and assessing the platform’s usability based on the experience of data collectors, curators and users. The methodological approach included a Literature Review, semi-structured interviews and surveys.
The Literature Review covered academic literature, grey literature on Go-Spin and other digital knowledge repositories with a focus on STI. Based on the outcome of this process, the researchers presented a “State of Practice” covering the main aspects of the literature on Knowledge
Infrastructures (KI). This exercise uncovered a miscommunication between different knowledge repositories’ theories and a lack of tools for their assessment. Therefore, the report developed an "Assessment Tool for Knowledge Infrastructures", identifying three main interdependent pillars to
analyse Go-Spin: 1) Communities; 2) Technical Systems; 3) Sustainability. The Assessment Tool’s development is based on the premise that KIs can exist only thanks to the interaction between people and technical systems that ensure their sustainability over time. In order to build a pathway for the improvement of Go-Spin, researchers drew from the Theory of Change framework. The first step of the analytic process was to create an ideal version of Go-Spin using the assessment tool. Starting from the final goal’s framing allowed researchers to develop the ideal scenario without being constrained or influenced by current practices. The ideal goal was developed using the Assessment Tool and inputs from participants. In terms of Communities, the end goal is to have complete knowledge about stakeholders and targeted users as well as being clear about the platform’s objective and scope. It is also necessary for a KI to have participatory methodologies for data collection and delivery, communication and diffusion activities as well as interaction and cooperation with local and international institutions. In terms of Technical System, the ideal goal is to implement and monitor the FAIR and TRUST principles fully; to be an inclusive and accessible platform; to establish formal relations with related platforms, to ensure interconnectivity and interoperability; to have regular information flow and to encourage users’ interaction outside the platform. In terms of Sustainability, the ideal scenario for Go-Spin would be to use a taxonomy that is familiar for users and consistent with the ones used by other repositories; to collect data from comprehensive data sources; to utilise users’ inputs to target data delivery and data organisation; to provide more and better tools for users; and, to have an integral M&E strategy that focuses on operational aspects and the platform’s long term goal. The second step of the Theory of Change’s approach consisted in assessing with the Analytic Tool Go-Spin’s current capacities, actors and practices using data gathered from the LR, interviews and
surveys. Main findings related to the Communities aspect show that Go-Spin has a blurred objective, has not mapped its stakeholders, has identified but not characterised its users and lacks a targeted and consistent data delivery strategy. Furthermore, Go-Spin does not have a communication strategy and has a low institutional priority within UNESCO. Moreover, the programme is almost an isolated initiative within UNESCO1 and lacks alliances with external organisms. In regard to the Technical System, Go-Spin has low user-friendliness, difficult data traceability and limited information flow. Go-Spin has identified other relevant platforms but does not use them to link with complementary data. Findings related to Go-Spin’s sustainability show that
the methodology is stagnant and was not built in a participatory way. The platform does not update its information since 2018, and there is a low commitment of countries to the project. Data collection was supposed to rely on training workshops to help national focal points familiarise with the
methodology. Because of the lack of resources to conduct training workshops and the delay of the Paris Manual, a standardisation tool for the categorisation of STI policy, the data curator also became responsible for data collection through desktop research. Statistics monitoring of the
platforms is done solely through Google Analytics without direct interaction with stakeholders or an overall monitoring and evaluation strategy of the programme. Finally, for Go-Spin to transition from its current situation to the ideal scenario, the researchers built an intermediate pathway to describe the steps of such transition. The researchers constructed an intermediate pathway and recommended concrete actions taking into account real-world constraints faced by Go-Spin. These recommended actions target different aspects of Go-Spin by proposing: 1. The development of networking strategy to strengthen communities around Go-Spin and promote its use: Go-Spin needs to create stakeholder maps, social network analysis, personas, and use cases to evaluate different types of users’ needs and expectations. Better use of UNESCO’s regional and national offices can increase cooperation, create agreements and lead to the establishment of an interconnected community. Other recommended actions are the establishment of more comprehensive data collection process drawing from different data sources and the creation of a forum to increase information’s exchanges. 2. The establishment of KI system standards to facilitate platform use and sustain the community: By adopting international data management standards, such as the FAIR and
TRUST principles, Go-Spin facilitates data interoperability, improves its user focus and contributes to the adoption of a common taxonomy on STI policy. For this to be successful, GoSpin must incorporate new human resources to ensure the platform’s long-term relevance. Additionally, exploring automation processes for data collection could drastically increase the amount of data gathered. 3. The development of monitoring and evaluation plan for the continuous and sustainable development of Go-Spin: Starting with a clearly defined long term vision, GoSpin needs to engage with users and other stakeholders to develop learning processes and receive relevant feedback. These should be used to develop a structure’s monitoring and
evaluation strategy to ensure Go-Spin’s sustainability. Finally, the report acknowledges some limitations and assumptions related to the report, ranging
from resources availability, IT systems capacities, and political constraints, amongst others. The report invites for further research and assessment of these identified issues.