Archive for the ‘Uncategorized’ category

Chickens and eggs

March 4, 2011

Which comes first, the love of science or the understanding of it? In my opinion this is a bit of a chicken and egg situation. If you do not appreciate and understand how amazing science is, why would you want to learn more about it? And if you do not learn about it, how can you appreciate its true wonders?

I recently had a discussion in which I defended the importance of scientists going into teaching. I’ve also been doing quite a bit more in the way of public engagement type activity, as some of you may have noticed from my last post about the British Science Association event. I started this because I think it is important to ensure scientific literacy and appreciation in everyone, kids and adults alike. My experience and observations doing it have been great, and they have been thought-provoking.

Many of the comments we’ve received during the science-busking events we’ve done have gone along the lines of “Better than science in school”, “I’m really into science and this is great”, “Why don’t we learn about this in school?” Many adults assumed that the event was aimed at their kids and not for them, because “Science is for kids, it’s something you learn in school”, which is a shame because what we are trying to show is how vital science is for everything that you do, it surrounds us and is integral to our lives. Now you can argue that the busking is not the best way to reach the adults, and this may be right, but the attitude still persists and must, I feel, be addressed.

Science teaching is really important because it contains the message about the significance of science in everything. But the way that science is taught in many schools (especially due to over-zealous health and safety concerns) means that the wonder and amazement is difficult to convey. I’m not an expert in education and I don’t have direct answers to this, but I am sure that is would help if impressionable minds could be impressed with amazing things that science can do. It would also help if parents believed that science was important and conveyed this attitude to their children. It might help if science was not just one lesson in a list of english, maths, french, science, PE, etc. Science comes into all of these subjects and could be demonstrated in all of the lessons rather than as a rather abstract thing to be  learned by rote. There have been various attempts to do this and I am sure that some of them are successful. As I said, I’m not an expert. But you can tell by the state of society today and the media in particular, that many people have no interest in or understanding of science. So what’s going wrong?

Instead of targeting the kids, we could start with the people in charge, those with the power to make a difference. Ask them to promote the importance of science, and the importance of having a future generation as well as a current generation of scientifically literate people. They don’t all need to be scientists, but understanding the scientific method will help in so many ways in different parts of society. But if science continues to be taught in a way that makes it difficult to be enthusiastic about it, none of this will have much effect. We will just be imposing dull lessons on our kids, who will probably then hate science forever.

And how do you convince the policymakers etc. of the importance of something that they have hated since childhood and that only a minority wants to study?

As ever I would love to hear what you think – do we aim to start with the chicken or the egg? Or something entirely different? And what is the most effective way for one person to make a difference in this regard – should I write to my MP (who seems most uninterested in scientific questions in general) or go into teaching? (this is not a serious career-change question as I would make a terrible teacher but as a means to make a difference it certainly has potential).

The ins and outs of peer review

August 23, 2010

Throughout the whole saga of the UEA email debacle I noticed how little understanding there seemed to be in the media or the general public of how peer review works and what it can achieve. In that particular case a good understanding of peer review could have led most people to realise that there was at least a good possibility that nothing dodgy was going on at all at UEA, as I have written before. But even within science there is debate about peer review, how it works, whether it works, if it should be changed. So I thought that as an ex-editor of a peer-reviewed journal it was about time I put my own personal views forth, as well as hoping to educate those less familiar with the topic.

Firstly I had better define what is meant by a peer in this context. Academics are usually the ones subjected to peer review so peers are other academics or occasionally industrialists researching related or similar subjects. This fact in itself brings up one of the criticisms of the peer review system – namely, these people are often in competition so how fair is it allowing them to judge the quality of their competitors’ work?

Peer review is used not only in journal publications but also to decide upon the award of financial grants e.g. by the government funding agencies such as the EPSRC. I’m going to use examples from journal publishing but you can see how the principles apply equally to both.

In brief, here’s how it (should) work: Researcher does research, writes it up accurately and submits it to a journal for peer review. Journal editor sends paper to two or more peers, who provide their opinions (reports)  on how good/relevant/useful the research is and on how it can be improved. Journal editor then makes a decision based on these opinions about the suitability of the work for their particular journal, and passes the comments of the peers (referees) along with his/her decision to accept/reject/ask for revisions on to the author.

Depending on the journal and the area of science you are working in, the qualities being looked for will change as will the ability to appeal any decision made, but broadly speaking any editor will look for the work to be a) original i.e. not done before and b) ethically sound (not stolen, plagiarised, harming animals unecessarily, etc.), as well as c) in keeping with the expectations of the readers of the journal in terms of what kind of research they expect to read there. Of course some would claim that there is also d) will this enhance my journal citation record? to consider, though I would argue that this falls into c) as readers will cite work that they find appealing and relevant to them.

All things being fair and equal, the peer reviewers should provide an unbiased report that explains what is new, why it is important, how this leads on from previous work etc. The journal editor, not being an expert in everything, is more or less dependent on the reviewer comments. Some editors are researchers in their own rights, which means they have expertise in certain fields but can never have it in all fields. Editors develop a feeling for how much they can trust certain individuals and how much emphasis to put on any single report. Editors have the final say, so they must also be incorruptible. This may sound like a hard quality to find, but the point is that an editor who is partisan or seen to be partisan will lose the respect of their community and no-one will want to publish in their journal. Being seen to be partisan will therefore destroy the journal as well as the editor’s reputation. Therefore it is on the impartiality of the editors that the fairness or otherwise of the peer review system relies.

It also relies on the reviewers first and foremost to give fair and impartial advice. To this end often reviewers are promised anonymity so that their names are not revealed to the paper authors. This should mean that they can say exactly what they think without fear of recriminations. I have spoken with many many authors who believe that they are able to identify their reviewers for a particular paper. 9 times out of 1o they are incorrect. And I have lost count of the number of times I have been asked “Why didn’t you use the referees I suggested, they know about this area and the referees you picked clearly don’t” (always for a paper I have rejected on referee advice). At least half of the time, I HAD used the suggested referees. This shows you that anonymity does, at least to an extent, offer the protection and fairness it promises.

Misconduct isn’t always detected by this method – as evidenced by high profile, systemic cases of this such as Marc Hauser, Woo Suk Hwang, Jan-Hendrik Schoen, etc. But it sometimes is – these are the many cases that the public and even the scientists do not see.

However there are flaws to the system – no-one thinks it is perfect. Peer review is simply (for most people) the lesser of the known evils. And no-one has really come up with a satisfactory method that is better. And so it persists. There are variants on what I have described, the so-called single-blind peer review (single because only one side of the equation is anonymous  – the reviewers know who the author is and this could affect their judgement). Firstly there is double-blind peer review. I don’t actually know of anyone who uses this as a large-scale, functioning system. I am told that it is virtually impossible to achieve, as most authors will give themselves away, if not by their writing style then by their chosen references (most people will tend to self-reference). Even if this could be avoided, because research is often presented at conferences before it is published, identification of the authors would still be possible.

Another system was trialled by Nature (their findings can be read here); that of open peer review. Here peers are asked to give their opinions without anonymity. While this is a system used by several medical journals including the renowned BMJ, Nature’s trial did not meet with an overwhelming welcome and the process was abandoned. It seems that scientific researchers were more comfortable with the devil they knew, as Nature found that from many disciplines, papers were not even submitted to the trial.

So why do people dislike the system so much? In my opinion, a large part of their unhappiness arises simply because an anonymous reviewer has “rejected” their work. The only system that could improve on this would be to publish everything in the place to which it is originally submitted. And hopefully most of you can see the problem with that idea. But there are other, more valid reasons to dislike peer review as it stands. Decisions are based usually on the opinions of two or three selected people. If a subject is controversial (as in climate change!) then the outcome of the review process will depend to a large extent on the choice of the referees, and thus on the editor’s personal opinion about the work (remembering that editors are suuposed to be impartial and may not be experts) and their familiarity with the field. If I get a controversial sounding paper I can easily facilitate its publication by selecting reviewers who I know to be in agreement with the views expressed. Or I can prevent it being published by selecting reviewers who I know will disagree with it. Or, if I am not familiar with the field, I might do either of these simply by accident, and not realise what I am responsible for. None of these options are really ideal. For me, the fairest solution here would be to send the paper to pro and counter referees and ask them to assess the paper as fairly as they can, then base my decision on their advice, the way they express it, what I know of those people, and necessary further consultations with non-experts who have an interest in the case e.g. a board member for the journal. If the decision is still not clear, an argument (and this is one that I have personally made) would be to publish the paper and let the community decide what to make of it. This might mean a few papers are published that later prove to be wrong, but until it can be clearly decided if this is the case, the benefit of doubt might be the fairest option. Such a course of action assumes that the editor is familiar with the community involved, and does not have any strong beliefs about the matter his/herself (or is able to suppress these). And is primarily concerned with fair treatment rather than with citations. (Publication of a controversial paper might result in increased citations because later authors cite it to agree/disagree with it, but then again it might not.) All of these are qualities that are probably quite rare in editors these days, but in my opinion they are the most important ones to look for when choosing your journal.

I also had a longstanding discussion with one particular author who claimed that he would not publish with a certain publisher because they did not treat his work fairly. Instead he preferred another publisher who apparently did treat him fairly. Now think about this carefully, it goes back to my initial comment about why people dislike peer review. I happened to have knowledge of both publishers and the treatment that author received at both of them, and I can state categorically that the publisher that actually treated him more fairly was in fact the one he would not publish with, because they dared to reject his work when advice said that it was not up to scratch; in other words, they treated him just like everyone elseand took each paper on its relative merits. The other publisher presumably took the view that keeping him happy was more important than publishing a couple of dud papers, as he would produce many more that were not duds and would prefer to publish there in future. They therefore gave him preferential treatment that a young researcher starting out would not receive, simply because of who he was.  Is this fair? No, but it is what happens in life so perhaps it is not surprising that publishing should be any different; we are all judged by our past mistakes and triumphs. I would expect an employer to prefer to employ a candidate with a lot of positive experience on their CV rather than a complete beginner or someone with only a history of failures. And yet peer review, in it’s finest and fairest form, asks us to take each paper on its merits and without considering the history or future of the author. Should we be using a system that does not reflect true life with which to make decisions that will affect lives?

Ultimately peer review revolves around the editor and/or publisher of the work and it is these people/places that should be under scrutiny if the system is to be improved, as well as the authors and reviewers.

I expect that anyone who has managed to get to the end of this little lot will have something to say about it. I hope you will comment, and I welcome the discussion.

Wow – I can see a long way from here

May 18, 2010

Hello. This is a post to introduce myself and my blog to the world.

Imagine you are a very small thing, a dwarf or a beetle or even smaller (but try and limit your sense of even smaller to something that actually has eyes, please, or you will destroy the rest of my analogy). You find a huge creature, something giant in your view. It can see a long way, further than you have ever even imagined. It tells you all about the wonders it can see. But you want to see with your own eyes, so slowly, laboriously, and with lots of help, you climb up the giant and look to see what you can see from the dizzy heights.

What you can see is a lot. You may not understand it all, certainly not at first. The giant has a bit of explaining to do. But at some point you realise that actually, because you are sitting on the giant’s shoulder, your eyes are higher up than its eyes are, and you can see further still. You could never have done that if you were still on the ground, you needed the giant’s help, but now you are the one who can see the most amazing wonders.

I’m sure that by now you get the point. The analogy I’m using is not a new one, according to the very reliable Wikipedia, it wasn’t even the illustrious scientist Isaac Newton who was the first to use it but a 12th century philosopher called Bernard of Chartres. It has even been used by others for their slogan before – you may have used a certain search engine to help you find this blog. But I like the idea of something small and beetle-like (myself, or maybe you) being able to see more and further than the things I know and understand to be huge and amazing, simply by working with those things. Some people prefer to sit on the ground and deny the existence of the wonders that can be seen from the shoulders of the giants, simply because they don’t like the giant. This blog is not for you. This blog is for those of you interested in my notes from the shoulder of the giant.

I will the first to admit that I may not understand everything I see from here – that’s where you the community as the giant come in – you can help me to understand those things better, and communicate them better to those beetle-like beings on the ground who may be just starting the long climb up. Because that’s how we can make the giants even taller, and raise up the beetles/dwarves/Lilliputians even higher, so they can see even more than we can, and pass on their notes to the future.

As you might have gathered, I’m actually not a beetle at all (finding a beetle capable of typing would be an impressive feat) but a simple PhD chemist interested in science and communicating it. I’ve been working in the area of chemistry and science now for a good few years, and have met a lot of great, sincere, and hardworking people who are part of the effort to climb up the giant, and to raise the giant onto a hill. I admire their hard work in the face of  adversity. This blog represents a snapshot of my views. Where I can, I will back up my views with evidence, but it’s always going to be my interpretation of what I can see. If you think I am misrepresenting your case, maybe I just haven’t understood it. That might be my fault for being just plain dim, or it could be that you haven’t stated your case sufficiently clearly enough – in my experience both are quite likely. In any case, I’ll try not to make personal attacks or judgements – if you think I am doing so please give me the benefit of the doubt and just let me know how you feel. I can be contacted on blog@sciencecarol.com