Download publication

External Publication

Bias against novelty in science: a cautionary tale for users of bibliometric indicators

Research which explores unchartered waters has a high potential for major impact but also carries a higher uncertainty of having impact. Such explorative research is often described as taking a novel approach. This study examines the complex relationship between pursuing a novel approach and impact.

By: , and Date: June 9, 2016 Topic: Innovation & Competition Policy

Viewing scientific research as a combinatorial process, the authors measure novelty in science by examining whether a published paper makes first time ever combinations of referenced journals, taking into account the difficulty of making such combinations.

They apply this newly developed measure of novelty to all Web of Science research articles published in 2001 across all scientific disciplines. They find that highly novel papers, defined to be those that make more (distant) new combinations, deliver high gains to science: they are more likely to be a top 1% highly cited paper in the long run, to inspire follow on highly cited research, and to be cited in a broader set of disciplines.

At the same time, novel research is also more risky, reflected by a higher variance in its citation performance. In addition, the authors find that novel research is significantly more highly cited in “foreign” fields but not in its “home” field.

They also find strong evidence of delayed recognition of novel papers and that novel papers are less likely to be top cited when using a short time window. Finally, novel papers typically are published in journals with a lower than expected Impact Factor. These findings suggest that science policy, in particular funding decisions which rely on traditional bibliometric indicators based on short-term direct citation counts and Journal Impact Factors, may be biased against “high risk/high gain” novel research. The findings also caution against a mono-disciplinary approach in peer review to assess the true value of novel research.


Warning: Invalid argument supplied for foreach() in /home/bruegelo/public_html/wp-content/themes/bruegel/content.php on line 449
View comments
Read about event More on this topic

Past Event

Past Event

Competition Policy and Extraterritoriality

An in-depth look at competition policy.

Speakers: Guntram B. Wolff and Jean Pisani-Ferry Topic: Innovation & Competition Policy Location: Bruegel, Rue de la Charité 33, 1210 Brussels Date: October 16, 2018
Read about event More on this topic

Upcoming Event

Nov
21
14:00

Competition Policy for the digital age

How can competition policy adapt to market changes caused by new technologies, digital platforms and big data companies?

Speakers: Ana Botin, Jorge Padilla and Tommaso Valletti Topic: Innovation & Competition Policy Location: Bruegel, Rue de la Charité 33, 1210 Brussels
Read article More by this author

Parliamentary Testimony

European Parliament

Brexit and industry & space policy

Testimony before the European Parliament's Committee on Industry, Research and Energy (ITRE).

By: Reinhilde Veugelers Topic: European Parliament, Innovation & Competition Policy, Testimonies Date: September 25, 2018
Read article More on this topic More by this author

Opinion

Japan must boost R&D to keep rising Chinese rivals at bay

As China shifts into a more advanced industrialised economy, Japan has slowly but surely lost to some of its comparative advantages to its rival. One possible solution to help the government keep pace would be to concentrate research and development efforts on a few key sectors where Japanese players still hold a large competitive lead.

By: Alicia García-Herrero Topic: Innovation & Competition Policy Date: September 20, 2018
Read about event

Past Event

Past Event

China's digital economy

How to measure China's digital economy?

Speakers: Alicia García-Herrero, Claudia Vernotti and Reinhilde Veugelers Topic: Global Economics & Governance, Innovation & Competition Policy Location: Bruegel, Rue de la Charité 33, 1210 Brussels Date: September 17, 2018
Read about event

Past Event

Past Event

Bruegel Annual Meetings 2018

The 2018 Annual Meetings will be held on 3-4 September and will feature sessions on European and global economic governance, as well as finance, energy and innovation.

Speakers: Maria Åsenius, Richard E. Baldwin, Carl Bildt, Barbara Botos, Maria Demertzis, Benjamin Denis, Lowri Evans, Mariya Gabriel, Svend E. Hougaard Jensen, Joanne Kellermann, Jörg Kukies, Emmanuel Lagarrigue, Philippe Lespinard, Rachel Lomax, Dominique Moïsi, Jean Pierre Mustier, Ana Palacio, Jean Pisani-Ferry, Lucrezia Reichlin, Norbert Röttgen, André Sapir, Johan Van Overtveldt, Martin Sandbu, Margrethe Vestager, Reinhilde Veugelers, Nicolas Véron, Thomas Wieser, Guntram B. Wolff and Georg Zachmann Topic: Energy & Climate, European Macroeconomics & Governance, Finance & Financial Regulation, Global Economics & Governance, Innovation & Competition Policy Location: Brussels Comic Strip Museum, Rue des Sables 20, 1000 Brussels Date: September 3, 2018
Read article Download PDF

External Publication

Export and patent specialization in low carbon technologies

The low-carbon technology sector is going through a period of disruptive innovation and strongly increased investment, which is likely to continue. Global investment in new renewable power is the largest area of electricity spending. The political momentum to combat climate change was reinforced in the Paris Agreement, when almost every country in the world agreed to aim for carbon neutrality in the second half of the century.

By: Robert Kalcik and Georg Zachmann Topic: Energy & Climate, Innovation & Competition Policy Date: August 7, 2018
Read article Download PDF More on this topic More by this author

External Publication

The impact of artificial intelligence on employment

Technological development, and in particular digitalisation, has major implications for labour markets. Assessing its impact will be crucial for developing policies that promote efficient labour markets for the benefit of workers, employers and societies as a whole.

By: Georgios Petropoulos Topic: Innovation & Competition Policy Date: July 31, 2018
Read article More by this author

Parliamentary Testimony

European Parliament

Economic benefits of the Digital Single Market

Testimony before the European Parliament Committee on the Internal Market and Consumer Protection (IMCO).

By: J. Scott Marcus Topic: European Parliament, Innovation & Competition Policy, Testimonies Date: July 18, 2018
Read about event More on this topic

Past Event

Past Event

Should we revisit the patent system for pharmaceutical products?

Analysis of the legal issues with the current IP system for regulated market authorisations for pharmaceutical products, as well as its economic effects.

Speakers: Arno Hartmann, Christian Jervelund, Margaret K. Kyle, Roberto Romandini, Bruno van Pottelsberghe, Amaryllis Verhoeven and Reinhilde Veugelers Topic: Innovation & Competition Policy Location: Bruegel, Rue de la Charité 33, 1210 Brussels Date: July 9, 2018
Read article More by this author

Parliamentary Testimony

European Parliament

The potential impact of Brexit on ICT policy

Testimony before the European Parliament's Committee on Industry, Research and Energy (ITRE).

By: J. Scott Marcus Topic: European Parliament, Innovation & Competition Policy, Testimonies Date: June 27, 2018
Read article More on this topic

Blog Post

Robots, ICT and EU employment

Disruptive technologies based on ICT, robots, and artificial intelligence have transformed labour markets through their important effects on employment. As the number of industrial robots continues to rise, our results imply that some measures to facilitate workforce transition and accommodate the rise of automation might be needed to maintain satisfactory labour market outcomes.

By: David Pichler, Georgios Petropoulos and Francesco Chiacchio Topic: Innovation & Competition Policy Date: June 15, 2018
Load more posts