PERFORMANCE INDICATORS FOR SCIENCE EVALUATION The challenge of providing the Research Information Sytems (RIS) needed in the ERA: Needs of the science community

1
PERFORMANCE INDICATORS FOR SCIENCE EVALUATION
The challenge of providing the Research
Information Sytems (RIS) needed in the ERA Needs
of the science community a personal view

• H. Rauch
• Atominstitut der Österreichischen Universitäten
• Stadionallee 2, 1020 Wien

SCIENTOMETRIC ANALYSIS Pros soft
method unibased capable of improvement
Contras flops counting expert
dependent ISI dependent
2
Thomson Coop.
www.isinet.com
Institute for Science Information Headquater
Philadelphia/US Offices US, UK, Irland, Japan,
Singapore Employees 850 Total journals covered
8676
3
RANKING OF ...

• Nations
• Fields
• Int. Cooperations
• Institutions
• Journals
• Individuals
• etc.

absolute and relatives measures static and
time-dependent measures correlation measures
4
Austrian Physics Evaluation
F.Aumayr, TU-Wien, Nov.1999
5
Neutron Scattering Science
total
6
Neutron Activation and Therapy
General Comparison
Neutron activation
Neutron therapy
7
PHYSICS JOURNAL RANKING

• Impact Factor T1/2
• Rev. Mod. Physics 19.4 gt10 a
• Solid State Physics 9.8 gt10
• Advances Physics 9.37 gt10
• Phys. Rev. Lett. 6.29 5.4
• Phys. Reports 6.1 8.5
• Ann. Rev. Nucl. Part. Sci. 5.9 7.6
• Ann. Rev. Fluid Meth. 5.8
  8.5
• Mat. Sci. Eng. Res. 5.7 4.8
• Adv. Atomic Mol. Opt. Phys. 5.66 gt10
• Rep. Progr. Phys. 5.59 8.4
• .
• .
• .

8
Journal Ranking

• Impact Factor
• 1. Clin.Res. 58.28
• 2. Am.Rev.Immun. 49.5
• 3. Am.Rev.Biochem. 44.4
• 4. Cell 40.4
• 10. Nature 27.07
• 25. Rev.Mod.Phys. 19.4

9
Publications versus Citations
W.Glänzel, A. Schubert, Scientometrics 56(2003)357
10

• Ranking in GDP Ranking in articles Ranking in
  articles
• per capita
  per capita per GDP
• 1.) USA Switzerland USA
• 2.) Norway Sweden India
• 3.) Iceland Israel China
• 4.) Switzerland Denmark UK
• 5.) Canada Finland Russia
• 6.) Denmark U.K. Japan
• 7.) Belgium Netherlands Germany
• 8.) Ireland Canada France
• 9.) Austria Australia Brazil
• 10.) Japan New Zealand Italy
• 11.) Australia Norway Canada
• 12.) Netherlands Singapore Ukraine
• 13.) Germany USA Turkey
• . . . .
• . . . .
• . . . .

Different kinds of country ranking
11
World Region Publications
M.Batty, The Scientist 17(2003)16, 10
12
Citations per country
M.Batty, The Scientist 17(2003)16, 10
13
M.Batty, The Scientist 17(2003)16, 10
14
M.Batty, The Scientist 17(2003)16, 10
15
WORLD CITATIONS

• Country Share of World papers () Share
  of world citations ()
• US 34.6 49
• UK 8.0 9.1
• Japan 7.3 5.7
• Germany 7.0 6.0
• France 5.2 4.5
• Canada 4.5 4.5
• Italy 2.7 2.1
• India 2.4 0.7
• Australia 2.1 2.1
• Netherlands 2.0 2.2
• Sweden 1.7 2.1
• Switzerland 1.4 1.9
• P.R. China 0.9 0.3
• Denmark 0.8 1.0
• Finland 0.7 0.6
• Norway 0.5 0.5
• S. Africa 0.5 0.3
• New Zealand 0.4 0.4

16
Self-Citations
D.W.Arkans, Scientometry 56(1962)235
17
D.W.Arkans, Scientometry 56(1962)235
18
Proposal

• Founding of a
• European based
• Initiative on Scientific Information

(in cooperation with ISI?)
1st Step ESF-Program 2nd Step EU-Network
19
CONCLUSION

• Bibliometric methods contribute essentially to
  science evaluation
• Bibliometric methods can help to decide on large
  facility issues
• Bibliometric methods will become more important
  in future
• Experts can do bibliometric analysis only
• A European initiative could help

20
(No Transcript)