archive-nl.com » NL » C » CWTS.NL

Total: 127

Choose link from "Titles, links and description words view":

Or switch to "Titles and links view".
  • The Metric Tide almost six months on: Still riding the wave?
    both earlier in 2015 and after the July publication that the company could administer a reliable metrics based REF at a fraction of the costs of the 2014 REF the peer review based assessment cost approximately 230 million to administer Were such recommendations to be adopted they would surely run counter to several of the Metric Tide s core criteria for responsibility For instance calls for humility i e metrics should not replace peer review are one obvious aspect such a move would discard Likewise this would mean ignoring the report s concerns about robustness of data namely that extant indicators and data infrastructures are simply not yet strong enough to support metric driven evaluation across the board And in terms of transparency could commercial providers really be trusted to make their data collection and analyses open to public scrutiny Despite these concerns since the Autumn the door for a metrics based REF has been left open as a whole raft of reviews into the governance and funding of higher education sector have been initiated including the dismantlement of the REF s administering body HEFCE and into the exercise itself Initial speculation about substantial efficiency changes to the HE sector were sparked back in September when Business minister Sajid Javid decided to hire management consultancy firm McKinsey and Co to perform a whole scale funding review of the Department for Business Innovation and Skills the governmental department out of which universities are run Although details of McKinsey s report have been kept closed in light of substantial cuts across Whitehall departments the continued funding of quango HEFCE and by extension the REF were very obvious candidates for reforms A Green Paper released on 6 November authored by Jo Johnson announced plans to keep the REF but confirmed the dismantlement of HEFCE and setting up of the Office for Students in its place The Green Paper indicated the Metric Tide s conclusions over responsible metrics would be considered but also stated we should champion better and more effective use of data and metrics In late November Chancellor George Osborne the minister in charge of economic and financial matters announced in his autumn statement to parliament that recommendations made in an independent review of Research Councils another area of the system being shaken up would be implemented including an independent review of the REF On Monday 7 December it was announced this review would be carried out by a senior figure possibly a former vice chancellor or someone from industry and be separate in scope from the Metric Tide report A week later this figure was announced as Lord Stern an academic economist and current president of the British Academy Although the date of the next REF has been signalled as 2021 in light of these tremors what the exercise would look like in terms of methodology is not at all clear By 16 January 2016 we may well know a bit more This marks the deadline for submissions of follow up

    Original URL path: http://www.cwts.nl/blog?article=n-q2v254&title=the-metric-tide-almost-six-months-on-still-riding-the-wave (2016-02-06)
    Open archived version from archive


  • NIH's new citation metric: A step forward in quantifying scientific impact?
    NIH team were right this would represent a major step forward in the development of bibliometric indicators of scientific impact However the NIH team significantly overstates the value of the RCR metric The most significant weakness of the RCR metric is the lack of a theoretical model for why the metric should provide properly field normalized statistics In fact it is not difficult to cast doubt on the theoretical soundness of the RCR metric The metric for instance has the highly undesirable property that receiving additional citations may cause the RCR of a publication to decrease rather than increase Imagine a situation in which we have two fields economics and biology and in which journals in economics all have a journal citation rate of 2 while journals in biology all have a journal citation rate of 8 Consider a publication in economics that has received 5 citations These citations originate from other economics publications and these citing publications refer only to economics journals The field citation rate of our publication of interest then equals 2 and consequently we obtain an RCR of 5 2 2 5 Now suppose that our publication of interest also starts to receive attention outside economics A biologist decides to cite it in one of his own publications Apart from this single economics publication the biologist refers only to biology journals in his publication Because biology journals have a much higher journal citation rate than economics journals the field citation rate of our publication of interest will now increase from 2 to for instance 5 2 1 8 6 3 obtained by assuming that 5 6th of the publications co cited with our publication of interest are in economics and that 1 6th are in biology The RCR of our publication of interest will then decrease from 5 2 2 5 to 6 3 2 This example shows that receiving additional citations may cause a decrease in the RCR of a publication Especially interdisciplinary citations received from publications in other fields characterized by different citation practices are likely to have this effect Publications may be penalized rather than rewarded for receiving interdisciplinary citations Many more comments can be made on the theoretical soundness of the RCR metric For instance one could criticize the use of journal citation rates in the calculation of a publication s field citation rate If a publication is co cited with a publication in Science its field citation rate will depend on the journal citation rate of Science which in turns depends on the citations received by a highly heterogeneous set of publications since Science publishes works from many different research areas It then becomes questionable whether a meaningful field citation rate will be obtained However rather than having a further technical discussion on the RCR metric I will focus on two other claims made by the NIH team First the NIH team claims that RCR values are well correlated with reviewers judgments Although the NIH team has put an admirable amount

    Original URL path: http://www.cwts.nl/blog?article=n-q2u294&title=nihs-new-citation-metric-a-step-forward-in-quantifying-scientific-impact (2016-02-06)
    Open archived version from archive

  • Welcome to our new CWTS blog
    blog Sarah de Rijcke Ludo Waltman Paul Wouters November 3rd 2015 No comments about How important is the number of citations to my scientific work really How is evaluation influencing knowledge production Should my organisation support the DORA declaration When does it not make sense to use the h index What does a competitive yet conscientious career system look like What is the relation between scientific and social impact of research How can we value diversity in scholarship If you now and then think about this kind of questions this blog is something for you Our CWTS blog brings together ideas commentary and book reviews about the latest developments in scientometrics research evaluation and research management It is written for those interested in bibliometric and scientometric indicators and tools implications of monitoring measuring and managing research and the potential of quantitative and qualitative methods for understanding the dynamics of scientific research This a moderated blog with a small editorial team consisting of Sarah de Rijcke Ludo Waltman and Paul Wouters The blog posts are written by researchers affiliated to CWTS Opinions on the blog are those of the individual authors We very much welcome the feedback and comments of our readers Though we encourage you to post your comments on the blog itself you can of course also e mail us We retain the right to remove inappropriate comments We hope you will enjoy reading our blog About Sarah de Rijcke Assistant professor and coordinator of the Evaluation Practices in Context EPIC working group Her research focuses on the growing use of assessment procedures and bibliometric indicators in scientific and scholarly research and the effects on knowledge production About Ludo Waltman Researcher and coordinator of the Advanced Bibliometric Methods ABM working group Ludo s research interests focus on bibliometric methods

    Original URL path: http://www.cwts.nl/blog?article=n-q2u2c4&title=welcome-to-our-new-cwts-blog (2016-02-06)
    Open archived version from archive

  • CWTS as data producer for EU research and innovation policies
    EU research and innovation policies CWTS as data producer for EU research and innovation policies January 28th 2016 CWTS and INCENTIM KU Leuven were selected by DG Research Innovation of the European Commission to provide a wide range of high quality science and technology indicators Starting in January 2016 and during the next three years CWTS will produce and update a wide range of bibliometric data and performance indicators aimed at contributing to evidence base of quantitative information for European research and innovation policy debate A key aspect of this project is the analysis of scientific and technological outputs within key technology domains at the level of countries groups of countries and global regions Some of CWTS information products will be included in high profile EU reports on research and innovation such as the Innovation Union Scoreboard the Research and innovation performance in the EU and the Science Research and Innovation Competitiveness Report The bibliometric indicators will provide insights on the scientific performance and collaboration patterns across countries regions and institutions considering different fields of science Dedicated methods metrics and indicators will focus on open access publications gender equality and research mobility Our CWTS project team consists of Rodrigo Costas Ed Noyons Erik van Wijk Inge van der Weijden Thed van Leeuwen Bert van der Wurff and Alfredo Yegros coordinator Recent months January 2016 2 December 2015 1 November 2015 3 October 2015 1 September 2015 7 July 2015 4 All months January 2016 2 December 2015 1 November 2015 3 October 2015 1 September 2015 7 July 2015 4 June 2015 2 May 2015 3 April 2015 4 March 2015 2 February 2015 3 January 2015 2 December 2014 2 November 2014 3 October 2014 3 September 2014 4 July 2014 2 June 2014 1 May 2014 7 April

    Original URL path: http://www.cwts.nl/news?article=n-q2v274&title=cwts-as-data-producer-for-eu-research-and-innovation-policies (2016-02-06)
    Open archived version from archive

  • Alfredo Yegros joins a new European study on University-Business Cooperation
    web browser News Alfredo Yegros joins a new European study on University Business Cooperation Alfredo Yegros joins a new European study on University Business Cooperation January 28th 2016 Alfredo Yegros will participate in a new project funded by the European Commission on University Business Cooperation entitled University Business Cooperation in Europe drivers challenges and opportunities to be conducted during the years 2016 2017 This project will build on the largest study completed so far into European University Business Cooperation which was undertaken during the years 2010 2011 http www ub cooperation eu As part of the project two major studies will be conducted to better understand University Business Cooperation in Europe incorporating both the perspective of the Higher Education Institutions HEIs as well as the business perspective Likewise a series of 50 good practice case studies on University Business Cooperation will be completed and a set of recommendations of European policy will be developed CWTS will focus on designing a University Business Cooperation monitoring tool The Science to Business Marketing Research Centre S2BMRC at Münster University of Applied Sciences MUAS in Germany will lead the project Other project partners are Ingenio CSIC UPV University of Ljubljana University Industry Innovation Network UIIN Technopolis Group Limited European Association of Institutions in Higher Education and Eurochambres Recent months January 2016 2 December 2015 1 November 2015 3 October 2015 1 September 2015 7 July 2015 4 All months January 2016 2 December 2015 1 November 2015 3 October 2015 1 September 2015 7 July 2015 4 June 2015 2 May 2015 3 April 2015 4 March 2015 2 February 2015 3 January 2015 2 December 2014 2 November 2014 3 October 2014 3 September 2014 4 July 2014 2 June 2014 1 May 2014 7 April 2014 8 March 2014 2 February 2014

    Original URL path: http://www.cwts.nl/news?article=n-q2v264&title=alfredo-yegros-joins-a-new-european-study-on-university-business-cooperation (2016-02-06)
    Open archived version from archive

  • Prestigious fellowship Sarah de Rijcke at TU Munich
    TUM s institutional strategy to promote top level research in the Excellence Initiative by the German federal and state governments TUM IAS awards Fellowships to distinguished researchers and gives them the necessary time and financial support to explore new venues to develop novel research areas and to establish intensive international collaborations Target Group of the Anna Boyksen fellowships are outstanding scientists from outside TUM who intend to explore gender and diversity relevant problems with regard to the natural and engineering sciences together with a TUM research group The fellowship period will be devoted to prolonging the collaboration with prof Ruth Müller at the Munich Centre for Technology in Society MCTS TUM The joint project for the Anna Boyksen Fellowship will analyze interactions between evaluation criteria and knowledge production in the engineering sciences Objectives Provide an overview of existing evaluation procedures and policy initiatives for the engineering sciences in the Netherlands and Germany Identify best practices on the basis of secondary document analysis Develop a suitable empirical approach to analyze the particular values enacted in evaluation systems in the engineering sciences and the positive adverse effects of performance indicators on knowledge production in engineering Carry out an in depth project in the engineering sciences on the basis of this empirical approach The study will most likely be comparative and will consist of at least two case studies in our respective national contexts Draw out differences between the new findings and results from our own previous research in the life sciences social sciences and law Integrate these analyses into refined ways for responsible application of evaluative metrics in engineering fields Recent months January 2016 2 December 2015 1 November 2015 3 October 2015 1 September 2015 7 July 2015 4 All months January 2016 2 December 2015 1 November 2015 3 October

    Original URL path: http://www.cwts.nl/news?article=n-q2v244&title=prestigious-fellowship-sarah-de-rijcke-at-tu-munich (2016-02-06)
    Open archived version from archive

  • Workshop on excellence policies in science (June 2-3 2016)
    Workshop on excellence policies in science June 2 3 2016 November 25th 2015 Both national and European science systems witness the rise of excellence policies with funding instruments offering selective support for high performing research groups or research organisations The scholarly literature about excellence initiatives in science is growing but many contributions focus on specific policies without developing a broader theoretical understanding of this kind of policy instruments in general In order to improve the debate about the advantages and adverse effects of excellence policies a more theoretical understanding is needed of these policies and their effects on scientific practices The Rathenau Instituut and the Centre for Science and Technology Studies CWTS co organise a scientific workshop on 2 3 June 2016 aiming to develop a theoretical understanding of excellence policies in science analyse the effects of excellence policies on scientific practices compare policies and their effects on scientific practices across national science systems We welcome contributions from a range of disciplines including science policy studies science and technology studies political science higher education studies innovation studies and sociology and anthropology of science Please see the call for papers for more details The program committee consists of Sarah de Rijcke CWTS Laurens Hessels Rathenau Instituut Mitchell Young Charles University Prague Submit an abstract to Laurens Hessels l hessels rathenau nl Deadline 11th of January 2016 Recent months January 2016 2 December 2015 1 November 2015 3 October 2015 1 September 2015 7 July 2015 4 All months January 2016 2 December 2015 1 November 2015 3 October 2015 1 September 2015 7 July 2015 4 June 2015 2 May 2015 3 April 2015 4 March 2015 2 February 2015 3 January 2015 2 December 2014 2 November 2014 3 October 2014 3 September 2014 4 July 2014 2 June 2014

    Original URL path: http://www.cwts.nl/news?article=n-q2v234&title=workshop-on-excellence-policies-in-science-june-2-3-2016 (2016-02-06)
    Open archived version from archive

  • Barend van der Meulen as endowed professor Evidence for Science Policy
    Centre for Science and Technology Studies at Leiden University Van der Meulen combines the professorship with his work at the Rathenau Instituut Science Policy increasingly important Barend van der Meulen is an expert on the relationship between science policy and the science system Van der Meulen The importance of scientific research for the future of society and the economy makes science policy increasingly important In recent years we have seen more and more interest in scientific knowledge and the organization of scientific research in politics and public media This implies it is essential to have solid and reliable knowledge about the functioning of the research system and impacts of science policies Melanie Peters director of the Rathenau Institute I am very pleased we could establish this chair at Leiden University The chair gives us additional opportunities to further develop our scientific methodologies Paul Wouters director of CWTS The knowledge Barend van der Meulen brings about the functioning of the scientific system and policy fits perfectly in the broadened research agenda of the CWTS After all we don t limit ourselves any longer to measuring science with indicators We are particularly interested in new research practices and how they are evaluated Barend s rich knowledge and experience is therefore particularly welcome About the Rathenau Instituut The Rathenau Instituut supports public debates and political decision making on science and technology Research topics include the dynamics of science policy research funding academic careers and the social impact of research Studies of the institute are widely used by policymakers and in the public debate on science Note to editors For more information please contact David Redeker temporary press officer d redeker rathenau nl tel 070 342 1566 and 06 44588969 Recent months January 2016 2 December 2015 1 November 2015 3 October 2015 1

    Original URL path: http://www.cwts.nl/news?article=n-q2u2a4&title=barend-van-der-meulen-as-endowed-professor-evidence-for-science-policy (2016-02-06)
    Open archived version from archive



  •