tag:blogger.com,1999:blog-29059245.post2460440000864370080..comments2024-03-25T02:33:41.590-05:00Comments on FemaleScienceProfessor: Wearing Two Hats: Editor & ReviewerFemale Science Professorhttp://www.blogger.com/profile/15288567883197987690noreply@blogger.comBlogger20125tag:blogger.com,1999:blog-29059245.post-32313231862857159852011-02-12T21:15:47.192-06:002011-02-12T21:15:47.192-06:00May be the reviewers can sink the paper as well, j...May be the reviewers can sink the paper as well, just because of competition?Funny Researcherhttps://www.blogger.com/profile/02971957974804668620noreply@blogger.comtag:blogger.com,1999:blog-29059245.post-43886318161683929662011-02-11T09:59:33.179-06:002011-02-11T09:59:33.179-06:00After waiting forever and a day for initial review...After waiting forever and a day for initial reviews and then re-reviews, I would kill for an editorial review and a decision...Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-29059245.post-54213360346788926742011-02-11T07:26:58.898-06:002011-02-11T07:26:58.898-06:00Do you ever get such complaints from female academ...Do you ever get such complaints from female academics? What is the gender distribution of complainers would you say?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-29059245.post-45255300416490590402011-02-10T22:14:08.613-06:002011-02-10T22:14:08.613-06:00OK, I'll do one or more editor-themed posts ne...OK, I'll do one or more editor-themed posts next week.Female Science Professorhttps://www.blogger.com/profile/15288567883197987690noreply@blogger.comtag:blogger.com,1999:blog-29059245.post-40192842045216527792011-02-10T21:58:27.538-06:002011-02-10T21:58:27.538-06:00"If an editor wanted to sink a paper, there a..."If an editor wanted to sink a paper, there are much more efficient ways to do this than to spend the extra time required to expand editorial comments into a review"<br />FSP, it would be interesting to hear about this in one of your blogs;Fahad Saeedhttps://www.blogger.com/profile/07400114521689497308noreply@blogger.comtag:blogger.com,1999:blog-29059245.post-48690892043010418392011-02-10T18:07:06.271-06:002011-02-10T18:07:06.271-06:00As ANON 11:01:00 AM,
I should point out that not ...As ANON 11:01:00 AM,<br /><br />I should point out that not all of my reviews are fence sitting. I simply mean that when I do need to sit on the fence I am providing information about the paper but expecting the editor to make a decision based on an opinion about the journal in addition to my conclusions about the paper.<br /><br />My bad for being too brusque earlier!Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-29059245.post-58281884100713498182011-02-10T18:03:42.852-06:002011-02-10T18:03:42.852-06:00Anon at 12:33:00 PM,
I am very happy and capable ...Anon at 12:33:00 PM,<br /><br />I am very happy and capable to judge the merits of a paper but not necessarily the alignment of said paper with the editorial guidelines of the journal. I see nothing wrong with saying "The analysis in this paper is solid and interesting and novel but the topic is pure conjecture so I am not sure if it is suitable for publishing in Journal of Concrete Applied Science". The editor can then make an editorial decision about suitability. Many journals that I regularly publish in (not just referee for) change their editorial slant faster than I notice.<br /><br />But, as I indicated, I have seen responses from rejected authors saying "Editor is biased! Referee said the analysis was novel ... "Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-29059245.post-80603110513248344332011-02-10T16:02:36.105-06:002011-02-10T16:02:36.105-06:00I'd love to be the reviewer and editor of my p...I'd love to be the reviewer and editor of my papers. I'd give myself an A+ every time haha. It's too bad I have to work with B's and C's, but I guess that's life. Also, I think added unneeded citations is kind of a waste of time, but what can you do? Anyway, great read.Warlawhttps://www.blogger.com/profile/14174205954784652182noreply@blogger.comtag:blogger.com,1999:blog-29059245.post-24226728956338010112011-02-10T14:09:50.913-06:002011-02-10T14:09:50.913-06:00Continuing with the topic of anonymous 11:01AM and...Continuing with the topic of anonymous 11:01AM and 12:33AM, I have a question.<br /><br />As a reviewer, I try to give an opinion whenever I can. Sometimes it's hard to give an opinion because even though I understand the paper, and I can check it's correct, it's hard to me to judge whether it's appropriate for the particular journal. I still think such a review is helpful, since I took the time to check all the math in it, something that is not trivial at all (if it's trivial, then it's safe to say that the paper should be rejected!)<br />Am I wrong in thinking this? <br /><br />In other words: Is a detailed review that gives no final decision useless?mathgirlnoreply@blogger.comtag:blogger.com,1999:blog-29059245.post-57567939148712447452011-02-10T14:08:50.673-06:002011-02-10T14:08:50.673-06:00FSM: Even though I haven't been an associate e...FSM: Even though I haven't been an associate editor for a journal, but I can imagine the frustration of such a situation, which I believe is far from being rare. That's yet another reason your job as an associated editor is difficult, and I empathize.<br /><br />Regarding your question, I would prefer the editor to write a positive review than to wait for much longer. But my interest is not the same as the interest of the peer-reviewing system.<br /><br /><br />Anonymous (2/10/2011 10:43:00 AM): I agree that there are various sources of bias. The goal of a peer-reviewing system, one could say, is to have a low-bias, low-variance assessment of the quality of the paper. Other sources of bias are existent for sure.<br /><br />Let's see the situation here: Roughly speaking, adding the number of reviewers (including the editor herself) decreases the variance of the final result, but it adds to the bias. Which is the more dominant term?<br /><br />I think one can empirically study it in a simulated peer-reviewing process.<br />A simple example might be like this: The researcher picks a text that states some facts. He asks reviewers to read it and answer a questionnaire. Then we have two scenarios: In the first, the editor reads the text then reads the answers to the questionnaire from the reviewers, and then fills the questionnaire herself. In the second experiment, the editors reads the text, answers the questionnaire herself, reads the questionnaire of the others, and then re-answer the questionnaire.<br />If there are objective answers to the questions, then one can potentially measure the effect of this bias.<br /><br /><br /><br />Anonymous (2/10/2011; 11:01:00AM): I almost do the same. When I review, I see my job as evaluating pros and cons of the paper and providing evidence for them. Then the goal of the editor, I assume, is to compare my evidence with other reviewers', and aggregate them in an unbiased way. The editor should understand the paper to the extent that she can understand the points of the reviewers, but having a personal opinion changes everything in an unpleasant way.<br />It is like asking the judge to be the prosecutor or defense lawyer too.SoloGenhttp://www.SoloGen.netnoreply@blogger.comtag:blogger.com,1999:blog-29059245.post-29105090042914242492011-02-10T13:49:21.202-06:002011-02-10T13:49:21.202-06:00That's a great topic for a post.. maybe next w...That's a great topic for a post.. maybe next week.Female Science Professorhttps://www.blogger.com/profile/15288567883197987690noreply@blogger.comtag:blogger.com,1999:blog-29059245.post-23072125292492124602011-02-10T13:17:10.360-06:002011-02-10T13:17:10.360-06:00FSP: When I review papers for journals where I usu...FSP: When I review papers for journals where I usually publish, I always wonder if the fact that I'm a good reviewer (on time and constructive) helps me with the editors whenever I make my own submissions. I am not implying I am expecting a freebie, but I always wonder if editors are more patient with authors that are good reviewers for the journal and less patient with people like the one you described in your comment.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-29059245.post-33154153665953541022011-02-10T12:33:43.576-06:002011-02-10T12:33:43.576-06:00@Anonymous above: you are a very unhelpful referee...@Anonymous above: you are a very unhelpful referee, why don't you just tell the editor you don't want to do the job, rather wasting your time giving he/she no information on which to make a decision. The best reviewer is one who gives a firm *opinion* backewd up of course by evidence. The editor's job is to evaluate your evidence, and hence your opinion, and that of the other referees. Not to start again from scratch.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-29059245.post-8573249243108026792011-02-10T12:31:58.640-06:002011-02-10T12:31:58.640-06:00A week later, he said it would take a few more day...A week later, he said it would take a few more days. Then he said "no later than tomorrow". The next day, it was "this afternoon or evening". After that, he stopped responding to my e-mails and phone calls. Nothing. I waited a bit. Nothing. What to do? <br /><br /><br />Why didn't you call the Dept and ask to speak to the Professor? (pretend to be a student so he would pick up)<br /><br />Would be funny to chat to the guy in person or if you can get him on the phone?<br /><br />"What happened?"Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-29059245.post-62778232990410115152011-02-10T11:01:45.497-06:002011-02-10T11:01:45.497-06:00SoloGen,
I write fence-sitting reviews in a way t...SoloGen,<br /><br />I write fence-sitting reviews in a way that requires the editor to make a decision based on their interpretation of either the paper or the journal or, possibly, both. This is particularly true for "applied" papers that are "theoretically applicable" at best. I leave it to the editor to make an editorial decision. I believe that is their job and that some subsequently rejected authors would say the editor was "biased" in their interpretation of my mostly positive review.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-29059245.post-65406434332228383972011-02-10T10:50:57.729-06:002011-02-10T10:50:57.729-06:00I serve as an associate editor for a journal in my...I serve as an associate editor for a journal in my field; when i was recruited to the position i was told that the editor-in-chief wanted 'strong editorial hands' - meaning that i am expected to make decisions based on my own review and the outside reviewers. In my own career, I have always preferred this experience as an author, because it does so well at creating clarity amidst conflicting reviews. As an editor, I like it because sometimes reviewers miss a larger, big-picture issue, particularly if they are very closely engaged in the authors field, and it allows me to raise that issue. I have not received angry tirades over my few years in this job, although I did get an angry reaction to a manuscript that I triaged.Monishanoreply@blogger.comtag:blogger.com,1999:blog-29059245.post-53003808549412741402011-02-10T10:43:03.452-06:002011-02-10T10:43:03.452-06:00I'm always happy to read these posts on your e...I'm always happy to read these posts on your experiences as an editor. It makes me feel like maybe I'm not entirely hopeless, as a relatively new associate editor. I have already reviewed many manuscripts that I have handled as an editor, because I can't get a second review in reasonable time, because the two reviews strongly disagree, because both reviews are superficial, because I suspect the ms might not be a good fit for the journal but lack confidence that the reviewers will pick up on this. My input ranges from a formal review to "In addition to the reviewers comments, you also need to address X, Y, and Z." In fact, right now on my to do list is "Just review the damn thing myself." <br /><br />And seriously. Bias? This is nothing compared to potential bias when I decide if the ms goes out to review, when I pick the reviewers (including reviewers that you oppose), when I give the reviewers special instructions, when I interpret the reviews and make the final decision. That's the bias you should worry about!Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-29059245.post-90695003512423044972011-02-10T09:55:02.106-06:002011-02-10T09:55:02.106-06:00Here's an example from the last time I was bot...Here's an example from the last time I was both editor and reviewer of a ms: I did not yet have the minimum number of reviews in hand for a ms, but a late reviewer said he could send the review in 2 weeks. He said that he had the review mostly done and just need a bit more time but he was traveling and couldn't finish it right now. I said OK. Two weeks later, he asked for another week (or two), with a promise that this was the last delay. He again said that the review was almost done. I asked him to upload his existing review, even if he felt it was incomplete, rather than delay further. He did not want to do this. A week later, he said it would take a few more days. Then he said "no later than tomorrow". The next day, it was "this afternoon or evening". After that, he stopped responding to my e-mails and phone calls. Nothing. I waited a bit. Nothing. What to do? Start the review process again with an entirely new reviewer, with the possibility of dragging out the review for months? I did the review. The late reviewer never sent any review at all.<br /><br />As an author in a case like that, would anyone rather wait for another independent review rather than having a review by the editor? Does your answer depend entirely on whether the editor recommends acceptance or rejection?Female Science Professorhttps://www.blogger.com/profile/15288567883197987690noreply@blogger.comtag:blogger.com,1999:blog-29059245.post-6066404657053322702011-02-10T01:15:04.950-06:002011-02-10T01:15:04.950-06:00The possible problem is the framing of other revie...The possible problem is the framing of other reviews based on the editor-reviewer's own review. In this case, the editor "interprets" other reviews in a way that is biased.<br />I expect that there are not many editor-reviewers who "reject" the paper when they act as the reviewer but ultimately accept the paper because other reviews have been positive.SoloGenhttp://www.SoloGen.netnoreply@blogger.comtag:blogger.com,1999:blog-29059245.post-85670146764556646572011-02-10T00:31:25.791-06:002011-02-10T00:31:25.791-06:00In my field, it's typical to get three reviewe...In my field, it's typical to get three reviewers, sometimes two if one is too slow. When I published my PhD work, the journal paper came back with four reviews. One consisted of just "You should add citations to these papers: (insert a few papers on really quite distantly related topic by associate editor for my sub-field of the journal field)". My supervisor rolled her eyes but we twisted the lit review and put in the mostly irrelevant citations.<br /><br />So you may be right for your journal, but there is at least the potential there for some conflict of interest.Dr. Confusednoreply@blogger.com