Best practice in assessing Research Excellence by Public Research - PowerPoint PPT Presentation

Best practice in assessing Research Excellence by Public Research Funders Quality over quantity!

The German Research Foundation (DFG) Who we are 1. The DFG is Germany‘s largest independent Basic Research Funding Agency 2. The DFG is an association of the German Universities and the large Research Organisations 3. The DFG receives its budget from the German Federal Government and the 16 German Länder (States) 4. The DFG is spending ~3 bn € per year on Bottom Up Research 5. The DFG is serving all fields of Science and the Humanities Best practice in assessing Research Excellence by Public Research Funders / Quality over quantity! – Dr. Tobias Grimm, DFG 2 Hongkong, June 5th 2019

Assessing Research Quality The role of publications Function and Purpose of Scientific Publications: ● Disseminate and safeguard Scientific Findings and Knowledge ● Attribute Creatorship/ Authorship and subsequently Reputation to the Scientists Funding facts: 1. Publicly funded Research usually results in Publications 2. Publications play an important role in assessing Public Research Best practice in assessing Research Excellence by Public Research Funders / Quality over quantity! – Dr. Tobias Grimm, DFG 3 Hongkong, June 5th 2019

Assessing Research Quality The role of publications Money Publications Research Findings / Knowledge Best practice in assessing Research Excellence by Public Research Funders / Quality over quantity! – Dr. Tobias Grimm, DFG 4 Hongkong, June 5th 2019

DFG Review Boards: Shares of Publication Types Humanities and Social Sciences s e s p n y o t i n t a o c i i t l a a b i c d u i e l p s b s DFG Review Board e m h r s u e d e e p p s l l c g o s h a a h i e a c e t s u r p / i r s i k g v a g l s a t e b c i i o n / t r a r v l s a g u s i a l a p t - r e n o o p o w n r n p g r n h a e e i r - n e t d t t a h o u e t o f t n a u m o a t M o r l A N D A A O P S P J I 4 4 4 1 2 1 1 1 1 5 1 -- Ancient Cultures History 5 5 5 1 2 1 1 1 1 2 2 -- 5 2 1 1 1 1 1 1 1 1 1 -- Fine Arts, Music, Theatre and Media Studies Humanities and Social Sciences 3 3 4 2 4 2 2 1 1 1 1 -- Linguistics 3 3 3 1 1 1 1 1 1 1 1 -- Literary Studies Social and Cultural Anthropology, Non- European Cultures, Jewish Studies and 4 3 3 2 2 1 1 1 2 2 2 -- Religious Studies 5 4 3 1 2 1 1 1 1 2 2 -- Theology 3 3 3 2 2 1 1 1 -- 1 2 -- Philosophy Educational Research 3 4 3 1 2 2 1 1 1 1 1 -- 2 1 5 1 1 1 2 1 1 2 2 -- Psychology 3 3 3 2 2 2 2 1 1 1 2 -- Social Sciences Economics 1 1 5 4 1 2 2 1 1 1 1 -- Jurisprudence 5 3 3 1 2 1 1 1 1 2 2 -- Best practice in assessing Research Excellence by Public Research Funders / Quality over quantity! – Dr. Tobias Grimm, DFG 5 Hongkong, June 5th 2019

DFG Review Boards: Shares of Publication Types Humanities and Social Sciences s e s p n y o t i n t a o c i i t l a a b i c d u i e l p s b s DFG Review Board e m h r s u e d e e p p s l l c g o s h a a h i e a c e t s u r p / i r s i k g v a g l s a t e b c i i o n / t r a r v l s a g u s i a l a p t - r e n o o p o w n r n p g r n h a e e i r - n e t d t t a h o u e t o f t n a u m o a t M o r l A N D A A O P S P J I 4 4 4 1 2 1 1 1 1 5 1 -- Ancient Cultures History 5 5 5 1 2 1 1 1 1 2 2 -- 5 2 1 1 1 1 1 1 1 1 1 -- Fine Arts, Music, Theatre and Media Studies Humanities and Social Sciences 3 3 4 2 4 2 2 1 1 1 1 -- Linguistics 3 3 3 1 1 1 1 1 1 1 1 -- Literary Studies Social and Cultural Anthropology, Non- European Cultures, Jewish Studies and 4 3 3 2 2 1 1 1 2 2 2 -- Religious Studies 5 4 3 1 2 1 1 1 1 2 2 -- Theology 3 3 3 2 2 1 1 1 -- 1 2 -- Philosophy Educational Research 3 4 3 1 2 2 1 1 1 1 1 -- 2 1 5 1 1 1 2 1 1 2 2 -- Psychology 3 3 3 2 2 2 2 1 1 1 2 -- Social Sciences Economics 1 1 5 4 1 2 2 1 1 1 1 -- Jurisprudence 5 3 3 1 2 1 1 1 1 2 2 -- Best practice in assessing Research Excellence by Public Research Funders / Quality over quantity! – Dr. Tobias Grimm, DFG 6 Hongkong, June 5th 2019

DFG Review Boards: Shares of Publication Types Life Sciences s e s p n y o t i n t a o c i i t l a a b i c d u i e l p s b s DFG Review Board e m h r s u e d e e p p s l l c g o s h a h a i e a c e t s u r p / i r s i k g v a g l s a t e b c i i o n / t r a r v s a g l u s i a l a p t - r e n o o p o w n r n p g r h a e n e i r - n e t d t t a h o u e t o f t n a u m o a t M o r l A N D A A O P S P J I 1 1 5 2 3 2 1 1 1 1 1 -- Basic Research in Biology and Medicine Plant Sciences 1 2 5 3 4 3 2 2 2 1 2 -- Life Sciences 1 1 5 2 2 1 1 1 1 1 1 -- Zoology 1 2 5 3 4 4 2 2 1 1 1 -- Microbiology, Virology and Immunology Medicine 1 1 4 1 3 1 1 1 1 1 2 -- 1 1 5 2 2 2 1 1 1 1 1 -- Neurosciences Agriculture, Forestry and Veterinary 1 2 5 2 2 3 1 1 1 1 2 -- Medicine Best practice in assessing Research Excellence by Public Research Funders / Quality over quantity! – Dr. Tobias Grimm, DFG 7 Hongkong, June 5th 2019

DFG Review Boards: Shares of Publication Types Alternative publication types Natural Sciences Non publisher publications Audio-visual media Images/ graphs Journal articles DFG Review Board Software/code Data packages Monographs Anthologies Pre-prints Patents Other 2 2 5 2 2 2 1 2 1 1 1 -- Molecular Chemistry Chemical Solid State and Surface Research 2 2 5 2 2 2 1 2 1 1 1 -- 1 2 5 2 1 2 1 1 1 1 1 -- Physical and Theoretical Chemistry Analytical Chemistry, Method Development 1 1 5 1 2 1 1 2 1 1 1 -- (Chemistry) Biological Chemistry and Food Chemistry 1 1 5 2 2 1 1 2 1 1 1 -- 2 2 5 2 2 2 1 3 1 2 1 -- Polymer Research Condensed Matter Physics 1 2 5 3 3 2 2 2 1 1 1 -- Optics, Quantum Optics and Physics of Natural Sciences 1 2 5 4 2 2 2 2 1 1 2 1 Atoms, Molecules and Plasmas Particles, Nuclei and Fields 1 1 5 5 3 3 3 2 1 1 2 -- Statistical Physics, Soft Matter, Biological 1 2 5 3 3 2 2 2 1 1 1 -- Physics, Nonlinear Dynamics Astrophysics and Astronomy 1 1 5 4 2 3 2 1 1 1 1 -- 4 2 5 5 2 2 2 1 1 2 1 1 Mathematics Atmospheric Science, Oceanography and 1 2 4 1 1 2 2 1 1 1 1 1 Climate Research 2 2 5 2 1 1 1 1 1 1 1 -- Geology and Palaeontology 1 2 4 2 3 2 2 1 1 1 1 -- Geophysics and Geodesy Geochemistry, Mineralogy and 1 2 5 1 3 1 1 1 1 1 1 -- Crystallography Best practice in assessing Research Excellence by Public Research Funders / Quality over quantity! – Dr. Tobias Grimm, DFG 1 1 5 1 3 2 2 1 1 1 1 -- Geography 8 Hongkong, June 5th 2019 Water Research 1 1 5 1 2 1 1 1 1 1 1 --

DFG Review Boards: Shares of Publication Types Engineering Sciences Alternative publication types Non publisher publications Audio-visual media Images/ graphs DFG Review Board Journal articles Software/code Data packages Monographs Anthologies Pre-prints Patents Other Production Technology 1 2 4 1 2 1 1 2 1 1 2 -- Mechanics and Constructive Mechanical 2 2 3 1 1 2 2 2 1 1 1 3 Engineering Process Engineering, Technical Chemistry 1 1 5 2 4 4 4 5 2 2 1 -- Engineering Sciences Heat Energy Technology, Thermal Machines, 1 1 5 2 4 4 4 5 2 2 1 -- Fluid Mechanics 1 2 5 2 2 2 2 3 1 1 1 -- Materials Engineering 1 2 5 3 1 4 2 2 1 1 1 4 Materials Science 1 1 3 1 2 2 2 2 2 2 1 -- Systems Engineering Electrical Engineering and Information 2 3 4 3 4 3 3 4 2 2 1 -- Technology 1 1 2 4 5 2 5 1 4 4 1 -- Computer Science Construction Engineering and Architecture 1 1 2 4 5 2 5 1 4 4 1 -- Best practice in assessing Research Excellence by Public Research Funders / Quality over quantity! – Dr. Tobias Grimm, DFG 9 Hongkong, June 5th 2019

Assessing Research Quality The role of publications Best practice in assessing Research Excellence by Public Research Funders / Quality over quantity! – Dr. Tobias Grimm, DFG 10 Hongkong, June 5th 2019

The incredible usefulness of Journal Publications You can count and do calculations on them Scopus-Search, 2019/05/19. Figure out the better scientist: Honjo, Tasuko Allison, James P. Kyoto Houston Documents 632 350 Cited by (No. of) documents 36.322 29.901 Co-authors 1.739 1.506 h -index 124 111 Total citations 63.187 49.622 https://www.scopus.com/authid/det https://www.scopus.com/authid/detail.u Link ail.uri?authorId=36013822600 ri?authorId=7401475344 Best practice in assessing Research Excellence by Public Research Funders / Quality over quantity! – Dr. Tobias Grimm, DFG 11 Hongkong, June 5th 2019