Multidimensional evaluation framework for science technology and ...

1 downloads 0 Views 2MB Size Report
**Applied Science Faculty, University of Campinas (Brazil). ***Department of Economics and Center for International Science and Technology Policy. (CISTP) ...
Paula Drummond de Castro*, Sergio Salles-Filho*, Adriana Bin** and Nicholas Vonortas***

*Department of Science and Technology Policy, University of Campinas (Brazil) **Applied Science Faculty, University of Campinas (Brazil) ***Department of Economics and Center for International Science and Technology Policy (CISTP), The George Washington University in Washington D.C. (USA)



methodological framework to evaluate ST&I Instruments: the Geopi Approach  STI instruments considered as policies and

programs 

the case of Biota Fapesp Program evaluation



overview of other experiences in Brazil e LA

1.

Theoretical concepts

2.

Geopi Approach

3.

Biota Fapesp case

4.

List of other applications

5.

Conclusions



indeterminacy



causality



multidimensionality



time lag

OI

?

OI

OI

Impact

Impact

OI

Impact

Impact

Impact

OI

OI

Impact OI

R

OI

R

?

Impact

ST&I Instrument

?

OI

OI

Impact OI

?

OI

R

OI

?

R

?

OI OI

OI Impact

Impact Impact

Impact

OI Impact Impact

Impact

Impact

OI Impact

Impact

OI

Decomposition Method  identification

+ Additionality Associated to Causality Attribution Method (AACAM)  measurement

1. Analysis of ST&I instrument goals 2. Decomposition of goals into terms 3. Transformation of terms into evaluation themes 4. Identification of

indicators and metrics to qualify and measure evaluation themes

5. Validation of indicator set by stakeholders

Goal: Terms:

Theme Indicator

to inventory and characterize the biodiversity of the State of São Paulo, by defining the mechanisms for its conservation and sustainable use

characterization of biodiversity

public policy

innovation

Advancement of knowledge

New species described

advancement of knowledge

support for making decisions characterization of biodiversity

economic potential of biodiversity

commercial use of biodiversity

technological development

training for research

research funding sustainable use of biodiversity

new sustainable technologies studies of the processes that generate biodiversity

research facilities

innovation

environmental policy and legislation

dissemination of knowledge

training of public and private organizations in monitoring biodiversity evaluating the effectiveness of conservation efforts in the state training for ex situ conservation

training of public and private organizations in the use of biodiversity

public policy

studies of the processes of biodiversity maintainers identifying priority components for conservation

training for valuing biodiversity and its services

development of methodological bases for environmental impact studies

training of public and private organizations in managing biodiversity estimations of biodiversity loss in the temporal and spatial scale

biodiversity conservation

advancement of knowledge

support for making decisions characterization of biodiversity

economic potential of biodiversity

commercial use of biodiversity

sustainable use of biodiversity research facilities studies of the processes that generate biodiversity

dissemination of knowledge

training of public and private organizations in monitoring biodiversity

evaluating the effectiveness of conservation efforts in the state training for ex situ conservation

training for research

research funding

new sustainable technologies

environmental policy and legislation

technological development

training of public and private organizations in the use of biodiversity

innovation public policy

studies of the processes of biodiversity maintainers identifying priority components for conservation

training for valuing biodiversity and its services

development of methodological bases for environmental impact studies

training of public and private organizations in managing biodiversity estimations of biodiversity loss in the temporal and spatial scale

biodiversity conservation

advancement of knowledge

support for making decisions characterization of biodiversity

economic potential of biodiversity

commercial use of biodiversity

sustainable use of biodiversity

new sustainable technologies

environmental policy and legislation

dissemination of knowledge

training of public and private organizations in monitoring biodiversity evaluating the effectiveness of conservation efforts in the state training for ex situ conservation

technological development

training for research

research funding

research facilities studies of the processes that generate biodiversity

innovation

training of public and private organizations in the use of biodiversity

public policy

studies of the processes of biodiversity maintainers identifying priority components for conservation

training for valuing biodiversity and its services

development of methodological bases for environmental impact studies

training of public and private organizations in managing biodiversity estimations of biodiversity loss in the temporal and spatial scale biodiversity conservation

advancement of knowledge Theme

ADVANCEMENT OF KNOWLEDGE support for making decisions

New species described of Newcharacterization records of taxa biodiversity Theses and Dissertations new sustainable Paperstechnologies Book chapter Books environmental policy and legislation Introduction of new lines of research on biodiversity dissemination of knowledge New research groups in the area of biodiversity Research facilities training of public and private organizations in monitoring biodiversity evaluating the effectiveness of conservation efforts in the state training for ex situ conservation

economic potential of Theme biodiversity

INNOVATION

use ofthe Resultscommercial obtained from research biodiversity Innovations generated from the results obtained sustainable use of Adopting biodiversity Institution Intellectual property rights Licensing/Assignment of IP rights studies of the processes Spin-off that generate biodiversity training of public and private organizations in the use of biodiversity

technological development Theme

TRAINING AND DISSEMINATION OF training for research THE RESULTS Courses Number of participants research funding Employed people Dissemination of results in the media research facilities Scientific events held Other forms of technicalinnovation scientific (websites, CDROM, etc.). public policy

studies of the processes of biodiversity maintainers identifying priority components for conservation

training for valuing biodiversity and its services

development of methodological bases for environmental impact studies

training of public and private organizations in managing biodiversity estimations of biodiversity loss in the temporal and spatial scale biodiversity conservation

Was there any variation on the zoological collection? ( ) No ( ) Yes, positively ( ) Yes, negatively

[If “yes”] How much was it? What was the influence of the program on this

variation?”

Botanical collection

Zoological collection Observed variation (%)

Library

Lab

Influence grade (%)

Equipament

35.0 30.0

% of influence

% of results

25.0 20.0 15.0 10.0 5.0 0.0

uence grade (%)

Observed variation (%)

Influence grade (%)

39 46

innovation (39)

Adopter

N

Public administration

20

Non-profit organization

9

University

8

Companies

2

Total

39

Number of Stabilished people

Scholarships

Hired

Influence Observed variation (%) Influence grade (%) grade (%)

R&D and Innovation Programs

Name

Agency

Young Investigator Award

FAPESP

Brazilian Small Business Program

FAPESP

Salles Filho et al. 2011a

FAPESP

Arruda et al. 2007

FAPESP FAPESP

Arruda 2008 Salles-Filho, 2009

INCAGRO (Peru)

Salles-Filho et al. 2010

FAPESP FAPESP

Bin et al. 2015b Castro et al. 2012

FAPESP

Salles-Filho et al. 2011b, 2011c, Castro 2011, Colugnati et al. 2014

Research Partnership for Technological Innovation Intellectual Property Program Public Policy Research Program Innovation and Competitiveness of the Peruvian Agriculture Program Scholarships Program Multiuser Equipament Program Biodiversity Conservation Research Program

Public Fund

Technological Development Fund for Telecommunications

Policy

Brazilian Informatics Law

Technologies Property rights R&D Project portifolio

Coffee/ certified reference materials

FUNTTEL Management Counsel CGEE

More details Colugnati, Carneiro, Salles-Filho 2011a; Bin et al. 2015a

Salles-Filho, 2009 Salles Filho et al. (2012)

IEA, INMETRO

Vegro, Franzaglia, Veiga-Filho (2009); Rauen et al. (2013);

Geographical indications / designations of origin

Embrapa

Capanema et al. (2013)

Energy sector

CPFL

Massaguer et al (2013)



indeterminancy



multidimensionality



causality



time lag (in progress)



participation of stakeholders



wide panorama of the STI performance



combination with others methods

THANK YOU! [email protected]

Suggest Documents