Regional Innovation Policies Evaluation and Benchmarking Preliminary analysis of documentation recei

1
Regional Innovation Policies Evaluation and
BenchmarkingPreliminary analysis of
documentation received and general presentation
of META RITTS Study - project on evaluating
effects and analysing implications of Swedish
RIS/RITTS
Agnieszka Turynska European Commssion DG
Enterprise
2
The direct and indirect results of the RITTS and
RIS-projects are not always clear to see and the
actual effects on regional and national
innovation policy and behaviour are sometimes
blurred1 although they might never have occurred
without RITTS/RIS
(META RITTS Study)
1in other words obscure
3
Figure 1. Structure of the META RITTS Study
First part
Statistical description of RITTS (ex ante)
International good practice case
Implications for
Sweden
Effect evaluation
of RITTS (ex post)
Second part
4
PRESENTATION PART ONE
Statistical description of Swedish RIS/RITTS
projects in the META RITTS Study (Ex-ante
evaluation)
5
META RITTS - Statistical description of RITTS
(ex-ante)

• The indicators in the first block are organised
  in 5 thematic areas
• 1) Innovation capacity of companies (research
  development (RD) as part of turnover,
  products younger than 5 years as part of
  turnover, characterisation of the most important
  products technically)
• 2) Companies growth indicators (growth in
  turnover, investments, number of employees
  and export)
• 3) Companies needs for innovation support
• 4) Transparency of regional support
  infrastructure
• 5) Companies co-operation with external actors

6
META RITTS - Statistical description of RITTS
(ex-ante)
Example
1) Innovation capacity of Swedish companies
7
META RITTS - Statistical description of RITTS
(ex-ante)
Example
2) Growth indicator (all growth fields put
together)
8
META RITTS - Statistical description of RITTS
(ex-ante)
Example
4a) Companies awareness of financial support
system (companies not aware of services)
9
META RITTS - Statistical description of RITTS
(ex-ante)
Example
4b) Companies awareness of technology transfer
services (companies not aware of services)
Even good support will not be used unless it is
easier to accessand more visible for the
companies searching for it
10
PRESENTATION PART TWO
Reasons why the historical situation of RIS/RITTS
reports cannot be compared
11

• Nature of problems encountered
• Lack of pertinent documentation (i.e. London,
  Flanders, Wales)
• Different methodological approaches to data
  gathering during phase one of RIS/RITTS some
  regions used only face to face interviews
  (Galicia, Shannon) without preparing
  questionnaires, others have utilised mixed1
  methods (Western Sweden, Lombardy)
• Huge differences in numbers of enterprises
  examined in questionnaire interviews
  (Lombardy 90, Western Sweden 800 companies
  answered the questionnaires, Galicia 50
  galician companies of divert sectors contacted)
• Sometimes the strongest impact was put on
  sectoral analyses sometimes the approach was
  more general
• Diverse approach to data processing (i.e.
  indicator on origins of impusles initiating
  innovation) indicators differ too much to be
  compared against each other

1face to face interviews, phone interviews and
questionnaires
12
Example
Origin of impulses initiating innovation
Impulses for innovation
Accident
Discussion circles
Publication
Co-worker
Miscellaneous
Business partner
Executive Management
0,0
10,0
20,0
30,0
40,0
50,0
60,0
70,0
80,0
90,0
Percent of enterprises
RAHM presentation
Clients
Lower Austria presentation
13
                   
Example
Origin of impulses initiating innovation
V5A - Starting from internal scientific research
or results commissioned from outside the company
V5B - Exploiting original ideas derived from
experience inside the company or drawn from
markets V5C - Stimulated by suppliers (machinery
or products)
V5D - Proposed or requested by purchasers V5E -
Proposed by customer at sub-supplier level V5F -
Starting from products or innovative
specifications produced by the competition and
seen on the premises of users V5G - Starting
from products or innovative specifications
produced by the competition and seen at trade
fairs or exhibitions V5H - Proposed by
consultants V5I - Proposed by public
institutions whose task is to help companies V5L
- Starting from ideas, proposals etc. thrown up
by business associations V5M - Starting from
ideas, proposals etc. thrown up by research
centres or universities
Lombardy presentation
14
Nature of problems encountered (cont.)

• Another reason why data cannot be compared is the
  fact that some regions presented data using
  percentages or numbers while the others used
  rather vague categories as for example small,
  average, significant. In the following
  example the region of Lombardy used percentages
  to show how many SMEs are satisfied with the
  level of support services offered by different
  organisations while Western Sweden presented it
  rather vaguely (bar length)

15
Example
Level of companies satisfaction with support
services
Western Sweden presentation
Lombardy presentation
16
PRESENTATION PART THREE
Effects evaluation of RIS/RITTS in Swedish
regionsas presented in the META RITTS
Study(Ex-post evaluation)
17
META RITTS - Effect evaluation of RITTS (ex-post)
Effect hierarchy
18
META RITTS - Effect evaluation of RITTS (ex-post)

• META RITTS evaluation categories - selected and
  limited to 4 areas of possible effects of the
  Swedish RIS/RITTS projects
• Effects of RIS/RITTS on regional and national
  innovation policy
• Effects of RIS/RITTS on the performance of the
  innovation supporting infrastructure
• Effects on individual organisations of the
  innovation system
• Effects on target groups (especially SMEs)

19
META RITTS - Effect evaluation of RITTS (ex-post)

• 1) Effects of RIS/RITTS on regional and national
  innovation policy (subcategories)
• New regional innovation strategy
• New regional programmes
• New national programmes
• New sector focus of innovation support

20
META RITTS - Effect evaluation of RITTS (ex-post)

• 2) Effects of RIS/RITTS on the performance of the
  innovation supporting infrastructure
  (subcategories)
• Better co-ordination of innovation supporting
  players
• Better need orientation of regional innovation
  system
• Improved interface between innovation supporting
  players and target groups
• Stronger position as regional innovation system
• Improved trans-national links
• Improved national links
• Increased quantity of innovation supporting
  services

21
META RITTS - Effect evaluation of RITTS (ex-post)

• 3) Effects on individual organisations of the
  innovation system (subcategories)
• Stronger position as individual player
• Improved collaboration with other players
• Improved need orientation of services
• Increased competence of delivering services

22
META RITTS - Effect evaluation of RITTS (ex-post)

• 4) Effects on target groups, especially SMEs
  (subcategories)
• Increased demand competence at companies
• Increased commitment of companies to participate
  in regional industrial

23
META RITTS - Effect evaluation of RITTS (ex-post)
Example
The example of Western Sweden RITTS ex-post
evaluation (1)
24
META RITTS - Effect evaluation of RITTS (ex-post)
Example
The example of Western Sweden RITTS ex-post
evaluation (2) on the basis of sub-categories
mentioned
1
1
1 no data available
25

• Summary and conclusions
• in case of the META RITTS Study it was possible
  in some extend to compare ex-ante situation of
  the innovation attitude and performance in the
  Swedish regions (however the results are
  limited)
• in this case it was possible, only because the
  common methodology and indicators were used
• in case of none-Swedish RIS/ RITTS regions
  situation is much more complicated because the
  methodology and indicators differ widely, what
  does not allow us to benchmark ex-ante
  situation of these regions at the time when
  RIS/RITTS projects started
• The META RITTS has also done evaluation of
  ex-post situation which has demonstrated that
  it is possible to define common indicators and
  methodology for benchmark exercise on regional
  level. However the methodology used and the
  results presented are criticable and need to be
  further improved and develop

26
Regional Innovation Policies Evaluation and
Benchmarking
Preliminary analysis of documentation received
and general presentation of META RITTS study
Agnieszka Turynska European Commssion DG
Enterprise