EGU Blogs

From impact factors to impact craters

Day 2 in the Big Brother house (aka the European Geosciences Union General Meeting). There’s no where near enough beer, and tensions are getting high. A horde of angry horses have invaded the lower levels, and taken the President of Austria hostage, with demands of lowering the Fair Straw Tax.

But throughout all the acid-fuelled hysteria, two events have stuck out so far today. The first was a workshop discussion on open access publishing for early career researchers (ECRs), hosted by a new Editor for the EGU’s publishing house, Copernicus. Unfortunately, this event confirmed a lot of the current issues with the development of open access policies globally, in that there has been a serious communications breakdown about the effects the policy transitions, particularly in the UK now that Research Councils UK’s (RCUK) open access policy has come into play (April 1st), will have on how and where ECRs can publish. Here are comments on several of the more prevalent points raised:

The misconception that Gold-route open access publishing requires you to pay, up front, an Article Processing Charge (APC). Gold open access is immediate open access publishing, under an appropriate license (CC-BY, according to the RCUK) – of all global open access journals, the APC median and mode is zero. The commercial publishers, who don’t have institutional backing, and largely out-dated models of publication, still charge exorbitant prices (up to $5000 in cases), as they are established names, with a track record of successful publishing. They also happen to operate many of the middle-tier ranked journals, based on impact factors (a journal-based metric that measures the average citations of the journal’s articles over two years), which makes them attractive to scientists in terms of where to publish.

This is a prominent issue at the moment within academia. How do you avoid falling into the trap that journal title and impact factor mean anything about the quality of your research, and at the same time reach the audience who you want to (i.e., those in your field who read those journals). My response to this is that if you can’t reach the people who you want without having to submit to a particular journal, you’re not trying hard enough and under-estimate alternative non-subject specific methods of dissemination. Conferences and direct emails are a great way of distributing your research to the right audiences, as well as hosting them on your department or research group or personal website. RSS feeds of non-subject specific journals make discoverability a piece of cake nowadays. Using a combination of these methods, I don’t see any reason why your research can’t hit your intended audience.

With respect to impact factor as a mode of quality assessment on an individual basis, I’m just gonna leave this here: http://occamstypewriter.org/scurry/2012/08/13/sick-of-impact-factors/. Along with this, it means that there’s no longer any excuse to conform to relevant policies and publish open access. Dissemination of research has never been easier in this digital age, and we have to kick the impact factor habit (RCUK has explicitly stated that IF won’t be used as an assessment metric). Alternatives such as ImpactStory and AltMetric are tools that are a step on the right path towards diving ‘true impact’ of research by providing more details about how the research has been picked up and distributed.

Other things to consider with respect to cost are models like PeerJ, a new initiative where you can have a personal and unlimited publishing account, with open peer review, for $299; BioMed Central, PLoS and others offer fee waivers for anyone who can’t afford APCs (PLoS have never rejected a fee waiver, to my knowledge); developing countries have special circumstances recognised by many publishers that make research freely available to them anyway (see PNAS and Nature Publishing Group), and, er, a lot more stuff that I can go into more detail after the ‘Demystifying Open Access’ session on Thursday evening here, which I’ll be part of as an ECR with knowledge of open access (caveat: I’ve never been published in a peer-reviewed journal, yet).

So yeah, lots of discussion about open access that indicates, to me, that people who are OA advocates, who work on the policy front-line, and those who are generally involved in the discussion must work harder to communicate the changes and issues with those who the policy changes will have the greatest impact on. So on from impacts of publishing to impacts of an entirely new kind!

In case you’ve been living in a hole for the last few weeks, a 10,000 tonne, 17m wide meteor slammed into Russia on February 15th, injuring more than 1000 people, and making a pretty loud bang, and spanking the Earth with the power of nearly 1000 Hiroshima bombs (about 400 kila-tonnes). On the same day, another meteor struck completely unrelated to this one at Chelyabinsk, but the difference being that it wasn’t a surprise, caught on a video of the dashboard of some lucky driver, but had been monitored for over a year, giving somewhat more of a warning than a few seconds.

Bulk fragment of the Cherbarkul meteorite (Credit: C. Mayer / F. Jourdan; Western Australian Argon Isotope Facility, Curtin University)

Known as the ‘Russian Fireball’, which also happens to have been Lenin’s bedroom name, the geochemistry of this extra-terrestrial rock star has began to be unravelled. Analysis of albite (one end-member mineral of plagioclase feldspar, which has a sodium-calcium solid solution) reveals to us the age and formation of the rock, as well as the impact history and secondary processes that occurred within the asteroid. Pretty neat eh, I guess chemistry does have it’s uses. Slightly cooler though, is what the science team had been doing to develop their understanding of how impact craters develop, by creating experimental impact craters in the lab and comparing the crater morphology to learn about speed, angle of impact, density, effect of substrate, and how to make large holes in your boss’ wall.

Close up on the interior of a fragment of the Cherbarkul meteorite (Credit: C. Mayer / F. Jourdan; Western Australian Argon Isotope Facility, Curtin University) (click for larger)

An International Monitoring System acquires data about sound activity from around the Earth. Although not explicitly geared towards detecting atmosphere-penetrating projectiles, the system does detect anomalous sound sources, such as from accidental explosions (*glances at North Korea*), meteorite entries, volcanic eruptions, earthquakes, severe storms, and the coming of Cthulhu. On this occasion, the impact was heard from more than 20 infrasound monitoring stations from around the globe; not particularly useful as a warning system, but still pretty cool. These stations can also be used to estimate the energy release from impacts.

Close up on the fusion crust surrounding a fragment of the Cherbarkul meteorite (Credit: C. Mayer / F. Jourdan; Western Australian Argon Isotope Facility, Curtin University) (click for larger)

To finish, and a rather controversial point, when asked if we needed to invest more in developing early-warning and detection systems for near-Earth objects, one of the panellists, Alexander Deutsch (University of Munster, Germany), remarked that we don’t, as we already have sufficient data to monitor all dangerously-sized projectiles. Apart from the Russian Fireball, apparently. Do we need to invest more in a global monitoring system?

Close up on the melt rock found within a fragment of the Cherbarkul meteorite (Credit: C. Mayer / F. Jourdan; Western Australian Argon Isotope Facility, Curtin University) (click for larger)

Avatar photo
Jon began university life as a geologist, followed by a treacherous leap into the life sciences. He spent several years at Imperial College London, investigating the extinction and biodiversity patterns of Mesozoic tetrapods – anything with four legs or flippers – to discover whether or not there is evidence for a ‘hidden’ mass extinction 145 million years ago. Alongside this, Jon researched the origins and evolution of ‘dwarf’ crocodiles called atoposaurids. Prior to this, there was a brief interlude were Jon was immersed in the world of science policy and communication, which greatly shaped his views on the broader role that science can play, and in particular, the current ‘open’ debate. Jon tragically passed away in 2020.


2 Comments

  1. Hi Jon,

    IF’s…

    In an ideal world I’d love to agree with your thoughts – but sadly there are many facets of academia that worship IF’s. Some UK REF panels will use IF’s and citation indices to make their judgements – and if you’re not REF’able (in the eyes of the interview panel – see below), getting a permanent academic job in the UK is a stiff ask..

    And thats because some faculty – especially those from maybe from Engineering of harder science backgrounds – that sit on interview panels are used to using citation indices and the IF of journals that applicants have published in when making decisions. If you have two applicants equally matched in terms of ability, but one has publications in better ‘scoring’ IF journals.. that may be how the choice is made.

    In a related issue (citations instead of IF), in the US some institutions require a minimum H index value in order to get tenure.. which is really tough IMHO.

    All of which of course don’t necessarily reflect the quality of the research – but they are ways in which IF and citation indexes are used in academia… irrespective of RCUK..

    Tom

    • Avatar photo

      Hi Tom,

      REF sub-committees are expliclity forbade to use journal IFs (see http://www.ref.ac.uk/faq/researchoutputsref2/) and the RCUK update yesterday drilled home that IFs were not to even be considered in any aspect of RCUK-funded research. Yeah, there are some people who still worship IFs, which is fine as a journal assessment metric, but as Stephen points out, and has many times since, if you’re using it as an individual assessment metric then you’re “statistically illiterate”, and in fact by not kicking the habit, and not communicating why it’s a valueless metric in this sense you’re simply propogating the sickness that is currently crippling academia. The overwhelming irony is that it’s actually the people who are making these decisions (senior scientists) who recognise the issue, but continue to say ‘everyone will use IFs anyway’, so what they do will make no difference anyway. It has to be a community-driven habit kicking, and unless we communicate more effectively, especially to ECRs, about the folly of IFs, nothing’s gonna change and we’re going to keep assessing science in the most non-scientific way possible.

      In the UK too, HEFCE and Wellcome Trust at least have dismissed the value of IFs. Funders and many scientists, especially ECRs to get the issue and how to combat it (simply by not using IFs); it’s just a case now of getting other people on board.

Comments are now closed for this post.