Friday, April 23, 2010

What I Don't Know

When I advise undergrads about graduate schools, I take into account the usual things, such as what the student thinks might be his/her specific interests for graduate research (and therefore which schools are good in that field). I also consider my opinions about which places have good advisers in that field, based in part on what I know about the previous experiences of graduate students working with a particular adviser or group of advisers.

And of course it is important whether the student is certain he/she wants to go directly into a PhD program, definitely wants to stop after the MS, or maybe will do an MS first and then see how things go (leaving open the option of a PhD later).

If the student has any personal issues that restrict options to a geographic area or to a set of universities that would also be suitable for the continuing studies or employment of a significant other, I can adjust my recommendations as necessary.

Although I do not claim to be a perfect match-maker between students and grad programs, I have done pretty well over the years in terms of helping students find a program that matches their scholarly interests, personalities, and other personal preferences.

I still have things to learn, though. This year I learned the following:

1. The economic crisis has shifted the ground at some schools so much that places that used to offer decent financial packages for stipends, tuition, and benefits now cannot. I don't know the details of the economic situations at particular institutions (although, for state universities, I can sort of guess based on what state they are in), but I wish I knew more so that I could have adjusted my recommendations accordingly.

Example: A talented undergrad asked for my advice about graduate schools. We talked about options on more than one occasion, and I suggested that he go to a conference in the fall, sit in on a range of talks in the fields in which he had an interest, and meet some people. At the conference, I introduced him to some potential advisers at one particular school that I thought was a really good fit for him. I knew that the professors to whom I introduced him were excellent scientists and also great advisers who cared about their students. The student talked to them at length and got very excited about the research possibilities. That institution was his top choice for a graduate program.

He applied and was accepted, he visited the department, and .. the financial offer was so inadequate that there might as well not even have been one. The student would have had to get a job and take out loans to make it through grad school (just as he had done as an undergrad), and no one should have to do that in the physical sciences.

If I had had any idea how bad the offer would be, I would not have made this "match". And I would have suggested that the student apply to many more places than he did. He had applied to more than one, but by mid-April, his options were few and unappealing. This was shocking because he is an excellent student and should have had his pick of graduate programs.

I felt like I had made a serious error in my advising, with possibly grave consequences. The story has a happy ending, though. I sent out some e-mails and found a colleague who was still looking for a graduate student and was pleased to have a strong recommendation of a possible candidate; the student now has a good financial offer at a really good place with a dynamic research group. It was only by luck, however, that I was able to fix my error and help work out a good solution.

Next year I will try to be better informed about economic issues before making strong recommendations. I feel very sorry for faculty in economically distressed departments that can't put together decent financial offers, but students need to look out for their personal economic situations as well. Those of us advising students on potential graduate programs can't just send them off an economic cliff because we only consider our usual criteria when making recommendations.

2. I have never really considered time-to-degree as a factor in my recommendations of certain graduate programs or advisers. These are difficult data to evaluate for a program or a particular faculty adviser; there are so many factors, including many related to the student. Even so, I learned this year of a particular program/adviser that I previously enthusiastically recommended owing to the interesting research and research environment, but now this place is off my list because the time-to-degree for many students is twice what it should be.

If a student asks my advice about that place I won't say "Don't even consider it", but I will strongly recommend that they talk to other students, look into the time-to-degree issue, and consider very carefully whether they want to invest what might be an unusually long time in their graduate studies. Students should do that anyway, no matter where they apply, but having this information in advance will affect my specific suggestions of graduate schools.

I hope all those involved in the grad admissions process this year -- professors and students -- had as successful a year as possible given the economic situation. I am happy with how things turned out for me and my research program, although I made my usual gamble and accepted more students than I thought would actually accept. They never all accept; except when they do. This year they all did. This has never happened to me before. That's fine, though. They all got good financial offers of guaranteed support, we are going to have fun, and we are going to be writing more proposals than we expected.

Thursday, April 22, 2010

To What End?

It is time for the Evil Reviewer anecdote to which I alluded in a post last week.

Colleagues and I submitted a manuscript about our Transformative Science to Awesome Journal. We were pleased to make it to the review process in a journal that summarily rejects most submissions.

We waited. And waited.

The reviews came back. The identities of both reviewers were very clearly stated in the reviews. Famous Scientist 1 loved the paper. Famous Scientist 2 hated the paper. We were allowed to revise the paper.

We revised the paper, taking into account the more rational of Famous Scientist 2's comments and providing a rebuttal to those we considered unreasonable.

The paper was re-reviewed by the same reviewers. This took a long, long time. Nearly a year had gone by before we received the second round of reviews back.

Famous Scientist 1 loved the paper even more. Famous Scientist 2 hated the paper even more. The paper was rejected.

The primary author (not me) protested. In fact, he was enraged because FS2's comments were rather inflammatory and his most serious criticisms were demonstrably untrue. One comment was that the questions we addressed were not of interest, and the methods we used were flawed.

We argued against the criticisms and other comments that could be demonstrated to be untrue, using citations of recent papers about the ongoing, unresolved debate on the topic of our research. The editor agreed to send the manuscript to a third reviewer who would have access to the previous reviews and correspondence.

Reviewer 3 (whose identity is not known to us) could not believe that FS2 would deliberately shoot down the paper unless he had solid, scientific reasons to do so. The editor's decision to reject the paper (again) hinged in large part on this belief that FS2 was an "honorable" man.

In the meantime, FS2 was busy. He reproduced our results, addressing the same questions (which he had stated were of no interest to anyone) and using methods he had criticized as flawed in our work. He submitted his own manuscript on this same topic to another journal. This fact came to our attention by chance.

What to do?

My colleague, now even more enraged, was able to document the existence of this "new" manuscript, complete with date of submission, showing that at the very same time FS2 was taking an unusually long time with the review of our manuscript, he initiated research on the same topic, submitting his own manuscript soon after his second, savage review of our manuscript. My colleague wrote a long, detailed letter to the editor.

The issue remains unresolved, but it is unlikely to have a happy ending for anyone.

Fortunately, in the case of our beleaguered manuscript, none of us authors are at a career stage that hinges on having a high profile publication. We think the science in the manuscript deserves publication, and we think we deserve credit for the ideas and applications in the paper, but it doesn't really matter where the paper gets published.

It is difficult for me to understand the level of ego? enmity? selfishness? depravity? that would drive someone to say that our research was worthless, and then immediately turn around and work on that same topic using the same methods (and !surprise! get the same result). We have all lost respect for Famous Scientist 2.

This episode made me wonder:

Was it really worth it to him to do this just so that he could be "first" to publish these results?

What am I supposed to think about the other papers by this Famous Scientist? I don't doubt that much of his existing work represents his own ideas, although now I wonder if he has ever done something like this before. I have met him and I know him to be a very smart and creative scientist. He doesn't need to steal the work of others.

Do they have "responsible conduct in research" workshops at his institution? Does he attend them and feel gnawed by guilt at his unethical conduct or does he glaze over in boredom at the case studies of postdocs in biomedical labs, thinking that none of this relates to him?

How open should I be with other colleagues, students etc. about this situation? Assume that there is no reasonable possibility that we misinterpreted FS2's actions and that there is solid evidence for the scenario outlined here. Being silent about the situation might allow him to continue in his evil ways, potentially doing real harm, but openly accusing someone of dishonesty (however much documentation I may have in my files) sets up a situation of "Which person do you believe?". The answer might well be "Famous Scientist 2" (as we saw in the review process).

Is FS2 pleased with himself that he was apparently successful at getting our paper rejected, or does he feel any discomfort at all about his tactics? Or maybe it is all just a game to him, and he feels satisfaction that he has apparently "won" this round?

I don't know. In my career, I have seldom experienced anything so blatantly inappropriate associated with a manuscript review, so I prefer to think that this is a relatively rare situation. I regret that I can never again contemplate this Famous Scientist's work without a hostile suspicious feeling.

I hope that our paper will eventually be published and appreciated for its interesting science, primarily the work of my colleague, who deserves full credit for his creativity, hard work, and persistence.

Wednesday, April 21, 2010

Summer Time

It is with some reluctance that I am diving yet again into the fraught topic of

Professorial Use of Summer Time.

Yesterday's theme was money. Today's theme is students.

As part of my continuing effort to explain Academia from the point of view of a (mostly) well-meaning professor and adviser, let's consider the summer situation of a professor on a 9-month appointment at a research university.

Although I in no way condone the rude behavior of professors who apparently seem strangely pleased to inconvenience students who want to defend their thesis or take a preliminary exam in the summer (e.g., by refusing to participate in these events during the summer), I will throw out for discussion a few of the relevant issues from the professorial point of view.

At my institution and others like it, professors are not required to teach or do institutional service in the summer. That is the principle behind our being paid for 9 months of work rather than 12. Nevertheless, it is not uncommon for students and others to think it entirely reasonable that professors be available in the summer for committee meetings, exams, and so on.

Another frequent comment is that professors who make a decent 9-month salary should be happy with that. After all, we can have our 9-month salary paid out over 12 months, so it is just like being paid for 12 months. The reasoning seems to be that the actual amount of each pay check doesn't matter as long as you continue to get paychecks in the summer.

Is there another profession in which it is widely believed that those in that profession should work without pay for several months of the year just because they make a decent salary? Wouldn't it be a great way to keep health care costs down if medical professionals volunteered their services for 3 months of the year? Their salaries are high enough; why shouldn't they donate their time and expertise? And what about lawyers? Couldn't they work pro bono a few months of the year?

I am satisfied with my 9-month salary and pleased when I can get paid for at least some of my research time in the summer, but I disagree with those who think that we professors are greedy if we want to be paid for the work we do in the summer, that professors who work in the summer don't deserve to be paid in the summer, or that professors should automatically be available in the summer at the times that are most convenient for the students.

That last statement is obnoxious, but I mention it because, although the vast majority of graduate students are very hard-working, I have seen more than a few cases in which a student procrastinated throughout the academic year, spent a lot of time being involved in hobbies and social activities, and then needed to take an exam in the summer. That's the kind of thing that can rankle even moderately nice professors who are otherwise on board with working without pay in the summers and being available to help students.

In fact, most of my colleagues volunteer some or all of their time in the summer, and many of us are happy to do so. We don't stop being advisers just because it is summer. Most of us also know that it is in everyone's interest that students get the help they need, make progress in their research, and pass the various milestones (exams) in a timely way. Sometimes it just works out that summer is the best time for an exam or defense. And certainly if a student needs to defend in the summer in order to move into a particular job, the vast majority of professors I know would show up for a summer defense if at all possible.

Like most of my colleagues, I work in the summer and I enjoy it. Except when blogging, I don't obsess about my summer salary, or lack thereof, and I spend a lot of time with students of various sorts, whether or not I am paid to do so.

Even so, I do not want my summer time to be taken for granted or wasted. And I do not want my university to proscribe my research and advising activities in the summer (the topic of yesterday's post). Furthermore, if it's not asking too much, although I am of course enjoying the fabulous fun to be had in the waning phase of the academic year, I would like summer to come soon, please.

Tuesday, April 20, 2010

Giving Less Than 100%

Here is how I think the summer salary (from grants) thing should work:

If I can get some summer salary from a grant, that's great. If I can't or if I need to spend my summer salary on another grant-related research activity, that's fine. No matter what my summer salary situation is during the 3 months when the university does not pay my salary, I advise my graduate students, I advise my undergrad researchers, I write new grant proposals, I go to conferences, I read, I think, I write papers, I discuss Science with various colleagues, and I even occasionally think about what I will teach in the fall. I basically do whatever I think is best for my researchers and our research program and my overall job as a professor. I adore having this flexibility. For me, one of the excellent things about being a professor is that there is an extended interlude in the year when I have a lot of freedom to set my own schedule and priorities.

Here is how my university thinks the summer salary (from grants) thing should work:

If faculty get summer salary from a grant and are paid at their usual salary rate for a specified time period, they can do nothing other than activities related to that grant: no writing of papers unrelated to that grant, no research activities unrelated to that grant, no travel to conferences unrelated to that grant, and certainly not any writing of proposals for a new grant.

During that time, we aren't even supposed to spend significant time with graduate students who are not supported on the same grant that pays our summer salary for that time block. We are supposed to say "Xavier, I'm sorry, but I can't help you with that until next month when I am no longer being paid summer salary" or "Benita, we should discuss that before July 7 because after that I can't talk to you about your research until August 12", but "Omar, yes of course we can meet this afternoon. You and I are being paid on the same grant right now."

And what about graduate students who want to defend their thesis in the summer? They'd better find out the summer funding situations of all their committee members or they are out of luck entirely. It would be better to have a committee comprised entirely of faculty with no summer salary from sponsored grants because these faculty can do whatever they want.

Although one might think it is in the best interests of the university that faculty write grant proposals and give papers at conferences, woe betide faculty with proposal deadlines or conference abstract deadlines in the summer.

And what are we supposed to do about reviewing or editing manuscripts and proposals during this time?

I can see the reasoning behind not paying someone from a particular grant while they are working on another project. I don't like it if the policy is going to be interpreted so strictly as to prohibit legitimate professional activities, but I can understand the principle. What really bothers me, however, is when the definition of the working day is not confined to standard hours and faculty are not even supposed to do other work, including write proposals, in their free time -- nights and weekends, for example. Apparently whatever time we work, whether it is 40 hours or 168 hours a week, that time belongs to the grant that is paying us, and we can work on no other projects, not even in the wee hours of the morning while sitting on the porch with a laptop and some friendly cats. The grant owns all our working time, however much that is.

And in fact, if we are working, we should be working in an "approved site", which does not include homes, cafes, or the various nooks we find to work while our offspring are engaged in enriching structured activities (sports, music etc.).

I don't get that either. Is the assumption that if we are not sitting at our desks, we are likely to be lying on a beach somewhere? If we were allowed to work at home, do the ethicsmeisters fear that faculty would interpret this as permission to do "research" in posh night clubs and resorts (and charge the expenses to our grants)?

A widely held view among physical scientists is that our biomed colleagues would do just that, and, in fact, that without these strict policies, they would all be paying themselves double so that they could support their cocaine habits, even though they force their grad students and underpaid postdocs to manufacture most of their own personal drug supplies in their research labs. {<-- attempt at joke}.

The good news is that we are allowed to attend a conference in the summer if the theme of the conference is related to the grant that is paying our salary at that time. I am confused about this, though. If we attend a conference to present a paper on the topic of the grant that is paying our salary, are we allowed to attend other talks, even if they are off-topic? Can we chat with colleagues about other research? Will we be banned from the poster sessions because they are rife with unethical possibilities for viewing graphic depictions of unrelated research?

The people who tally effort have run amok.

The solution, of course, is to claim effort at <100% during any time period that requires working on multiple projects, advising various students, writing new proposals, or attending a conference.

That's doable. Instead of being paid x weeks of summer salary at 100% effort on a grant, I can be paid at a lower % effort for longer. And then I can have the kind of summer that I want to have, and everyone benefits: my research group, my university, my cats, and me.

Problem solved? Maybe in practice, but the policy that necessitates these accounting games makes me want to gnash my ears.

Monday, April 19, 2010

If I Have to Stare at One More CV This Year..

This year I somehow I ended up on four (4) committees that review Other Faculty and their research ideas, accomplishments, and/or productivity. This seems excessive to me, but there are at least 2 explanations for this turn of events:

1. The usual reason for senior FSPs: There are so few female full professors in the physical sciences-engineering-math that we get called on quite a lot to serve on certain committees. Sometimes I just say no because I don't have the time (or interest), but sometimes I feel that it is important to say yes. This accounts for one of the committees this year.

2. There is a very nice, competent, hard-working, smart, and generally awesome staff person in charge of organizing some of these committees, and whenever she asks me to serve on a committee, I find that I can't say no. This accounts for 2 of the committees this year.

I have no explanation for the 4th committee, other than I felt that I should do it so that I had a voice in some things about which I would probably otherwise have complained.

I sort of followed my "conservation of committee mass" rule of quitting a committee if I add a new committee. The only one I added without quitting another was the least time-consuming of the four.

In none of these cases, when asked to be on one of these committees (or when I agreed to be nominated for an elected position), did I think "OK, but I really don't want to be on that awful time-wasting committee". I was lucky in that, I guess. I felt that all these committees were in some way worthwhile.

I am pretty sure that I would have said nyet if asked to be a committee that I felt a great reluctance to join because I thought it would be even more boring than most committee assignments or because I didn't think it was a good use of my time. I suppose that is a selfish, but any guilt I might feel is completely assuaged by my awareness of how much time I devote to institutional service.

When asked to be on a committee, do your criteria for accepting vs. declining to be on the committee depend on your prediction of whether you would find the committee interesting and/or a good use of your time, or does your sense of duty and academic citizenship triumph over such selfish concerns?

Friday, April 16, 2010

Talk Talk

If you are a graduate student (or an undergraduate student involved in research):

How much do you discuss research or other academic topics with your fellow students outside of classes and seminars?; e.g., at lunch or other social opportunities? A lot? Occasionally? Never? (you can also answer according to the situation when you were a student, if your students days are over)

How much do you discuss research with other students?
All the time
Quite often
Now and then
Rarely
Never
pollcode.com free polls

As I described in a recent post, when I was a student, my fellow students and I talked about Science a lot. Some of venues for talking/socializing were faculty-free (some of the grad office space, late night pub excursions), and others involved faculty (late afternoon pub excursions).

It was good to have some informal discussions with faculty, but we also valued our faculty-free times and spaces. In fact, I think these student-only Science discussions were particularly important for me.

As I have surely described at some point in the past, it was after a particularly brutal one-sided "discussion" with one of my committee members that I started the collaboration that resulted in my first paper with another graduate student. This professor had savagely belittled my research and ideas, told me I was stupid and ignorant (in those exact words), and expressed great pessimism that I would ever get a graduate degree of any sort, in part because he was going to vote "fail" at my defense. I staggered back to the grad office area and sat, stunned, on a couch in the common area.

A senior grad student, whom I didn't know well because he was in a somewhat different subfield of research, saw me and asked why I seemed so down. I told him that Professor Z hated my ideas and thought I was an idiot. He said "That is actually a good indication that you might be right. Tell me your ideas." So I did. He was quiet for a few minutes, and then said "I think you are on to something. Let me tell you about some of my work that relates to what you're thinking." So he did, and this started a series of discussions over the course of months. We developed our complementary ideas, tested them, wrote things, sketched things, and eventually published a paper in a journal I thought would be out of my reach as a graduate student.

I credit this grad student with saving my career. I don't know if I would have quit grad school, but I was seriously considering it.

Most conversations among students are not life-changing like that one, but they are nevertheless important ways to develop your ideas and your communication skills. When I started grad school, I had never really had an intellectual debate about Science before. I didn't really know how to argue -- not in the sense of having a hostile disagreement, but in the sense of organizing arguments (evidence) to support an idea or to figure out how to test an idea.

I also had to learn that arguments were not (necessarily) person. You could lose a scientific argument, but still enjoy the debate, emerge with your self-esteem intact, and learn something important.

Although some of my fellow grad students were quite aggressive and skilled at these discussions, I definitely was not, but I learned a lot by having discussions and debates. I do not think I ever would have learned this from my professors, in part because it wasn't until I was a senior grad student that I started to feel comfortable expressing my opinions in anything approaching an assertive and confident way.

If you are a student in an intellectually stimulating, interactive department: that's great. You are lucky and you will learn many important things. Don't worry if you start out not having much to say, but listen and learn and participate as much as you can. Eventually you will be one of the confident senior grad students or postdocs, but the transformation won't happen by magic. Start talking now!

If you are a student in an environment that for some strange reason does not involve academic discussions outside of the classroom and you want to change that: Find at least one other person who feels the same way you do. Maybe more will join in. Don't let the we-don't-talk-about-work people make all the rules about acceptable topics of conversation. Don't worry if they frown at you. It's fine if there are some times and places when people want a break from intense discussions about work, but this should not be an all-encompassing rule that excludes all such conversations from lunch time, coffee breaks, and other opportunities like that.

In any academic unit, it should be possible to find people who are passionate about their research and studies and who want to talk about what they are working on and learn what others are doing.

Thursday, April 15, 2010

Burnt Out - Help

Below is an e-mail message from a reader. I have responded to the e-mail privately, but I hope some readers can also help with advice or other support.

Dear FSP,

I'm about to quit research because I can't take the sexism anymore. Would you still try and convince me to stay?


I'm recently recovering from a rape assault, and as a result am finding it impossible to cope with sexism in the workplace. I feel like my reaction to this sexism is completely justified, but that I might not have found it so overwhelming had I not been going through this particularly difficult time.


I'm at the point where just going to work is emotionally draining and I am actively considering quitting. The main reason for my choice is sexism, not other difficulties which exist with a career in academia. I fear I may be throwing research away because I'm going through a very difficult time recovering from the rape assault.


In the last year, I've been so upset by this, that the quality of my work has degraded. I'm a postdoc, so one unproductive year is important. Given the sexism and rumors that exist in the workplace, I can't imaging discussing the rape and its effect with anyone at work.


The sexism I'm talking about is both indirect (witnessing patronizing comments about women and porn which is openly accepted at my workplace) and direct (patronizing comments about my gender, sexual advances from PhD adviser, sexual harassment from colleagues at every institution I've been at - in one case it was violent, victimization when I complained).


Thanks for your time and any advice you may have. Feel free to post this letter on your blog (not my email address).


Sincerely, Burnt out astronomy.


PS: Thanks for your amazing (and depressing) blog.

Wednesday, April 14, 2010

Preferred People

Some journals ask authors for a list of possible reviewers, and some also ask for a list of reviewers to avoid. Are these lists useful to editors? Who should be on these lists? If someone is listed as a person who should not be asked for a review, can the editor still ask that person for a review?

In my experience, these lists are advisory only. They are suggestions of some people with the necessary expertise to review the manuscript. If the author has particular opinions about issues other than expertise (e.g., objectivity), these may also be a factor in deciding which individuals to list as preferred reviewers and which, if any, to request not be asked to review.

If authors list the obvious reviewers, I have no problem picking at least one from their list of suggested reviewers, maybe even two if that makes sense and I would have asked these people anyway. In most cases, though, I try to find at least one reviewer who is not listed. If you want to increase the chances that a certain expert person will be selected, a possibly good strategy is to leave that name off your list. Whether this strategy is good or not depends on the editor's editorial habits. You may well not be aware of what these are, so in fact probably the best strategy, if required to provide a list of suggestions, is to make a sincere list of expert people.

As an editor, if I don't think the list of suggested reviewers is reasonable, I may not select any from the list. Some authors seem to believe that the editor will or must pick from their list, and they stack the list with their close colleagues and friends in their own department. This is not a good strategy because (1) it probably won't work; and (2) why give the editor reason to question your judgment and ethics?

There are certain research topics that involve feuding research groups, and the authors in each group believe (in some cases with justification) that those in the other group(s) will not give an objective review. These groups always list those in the other(s) in the do-not-review column. If I know something about the debate and the people involved, I either respect this request or I don't, depending on the people and the situation. In most cases, however, I respect the list, but if I do happen to select a reviewer from the do-not-review request list, I remain alert (as always) for any possible problems with the review, including apparently unsupported negative criticisms or what seem to me to be overly harsh reviews of matters for debate (as opposed to problems with the data or observations).

Reviewers do not decide whether a manuscript is accepted or rejected; they make recommendations. The editor decides whether the reviews are reasonable and makes the decisions, so a negative review may not be fatal.

The manuscript management system with which I am most familiar makes it very clear what author preferences are in terms of reviewers to select or avoid. Not long ago, however, I was a guest editor for a journal that used a different system, and I found this other system difficult to navigate. At first I didn't even see that there was a place for authors to list their reviewer preferences; the list was rather hidden. Also, the journal had an inefficient system for selecting reviewers for manuscripts in guest-edited issues, so I was unable to select reviewers directly. For two different manuscripts, reviewers who were on the authors' lists of reviewers to avoid were in fact asked to review the manuscripts. Both returned very constructive, overall positive reviews in which each also made their identity obvious to the authors.

In one case, the authors were enraged that a reviewer had been selected against their recommendations. They complained to the main editor. They wrote a rather nasty letter to me. This was puzzling because the reviewer gave them a very useful and positive review; there was absolutely nothing in that review that indicated a problem with objectivity. Did they just dislike on principle the fact that this person had been allowed to give input? There was nothing time sensitive in their manuscript; nothing that needed to be kept secret from certain people in advance of publication; nothing even very controversial. In fact, it was a solid but rather prosaic paper that I spent a huge amount of time editing because the writing was so bad. The authors were in error to believe that just by listing the objectionable person on a list meant that the editors were bound to comply. I probably would have respected their wishes had I known them and had I ultimate control over reviewer selection, but I was not compelled to do so.

In the other case, the authors were pleased that they had gotten such a positive review from someone they feared would not be objective. They later started corresponding with the reviewer about their mutual research interests, and sent a nice thank you letter commending the editorial work of my colleagues and me.

Some journals ask for a reason why an individual is included on a to-be-avoided list of reviewers; some funding agencies request this information as well. If there is a reasonable explanation for why an individual should not review a manuscript, then an editor may be more inclined to comply with this request.

It can be difficult to explain some of these reasons, though. Unless you are an established researcher with a long track record of publishing, you probably don't want to write "This person hates all of my papers and always gives a negative review" because it raises the question of whether all of your papers are really bad. Something vague like "conflict of interest", however, is an all-purpose, vague-but-possibly-effective reason, should you be required to provide one.

So:

Are these lists useful to editors? Yes and no. Not really. Sort of.

Who should be on these lists? People with expertise. People who are not your close friends and colleagues.

If someone is listed as a person who should not be asked for a review, can the editor still ask that person for a review? Yes.

Tuesday, April 13, 2010

Let's Review

Why review manuscripts?

Reviewing can be a deeply unsatisfying experience if you end up mired in bad writing, spending a lot of time making detailed and insightful comments for an editor and authors who will ignore all of your criticisms and suggestions. Reviewing can also be a very positive experience in which you help improve the content and presentation of a possibly interesting and important (or at least useful) paper, learning something in the process, and accumulating the respect of authors and editors.

In the comments of yesterday's post, Dr. Doyenne provided a nice list of reasons why reviewing can be worthwhile for the reviewer. You should check out that list, but I have also included some of the items, in modified and supplemented form, here. Some of them are most applicable to new researchers, but can apply to reviewers at any career stage.

1. You learn a lot useful things about writing, science (or whatever), and publishing. You may even learn more about the technical aspects of manuscript writing, organizing, and publishing from a bad manuscript than from a good one, so don't assume that you've wasted your time just because the manuscript your reviewed was a travesty.

2. You will learn what is appropriate (or at least typical) in terms of length, level of detail, and subject matter for particular journals. You should get an idea about these things by reading published papers, but reviewing can help make all this more clear. For example, a common criticism of manuscripts submitted by recent PhD students is that a manuscript "reads too much like a thesis chapter". This isn't an issue if you write your thesis chapters as manuscripts, but in some cases the thesis contains much more detail than a manuscript should. Even though doctoral students surely read many published articles and should get some idea of what is an acceptable level of background material, somehow it is different when you are writing your own manuscript. If you start looking at manuscripts (even your own) through the eyes of a reviewer, you get better calibrated, saving yourself some criticism when you submit your own manuscripts.

Furthermore, some journals provide a checklist or series of questions for reviewers to fill out as part of the review. As an editor I find these lists rather useless, but they do provide some structure and continuity to a review. For the reviewer, these may give an idea for what kinds of things are considered important, in general or for a particular journal. You may also learn about this kind of thing from other means during the review process, and these may help you organize and target your own manuscripts better.

3. Once you have some experience reviewing, you can better deal with reviews of your own manuscripts, especially if there are (very) negative comments. If you are encouraged to resubmit a manuscript, you may have a better idea for how to craft the letter to the editor, explaining any reviewer comments you decided to ignore. If the editor knows you as a diligent and thoughtful reviewer, this opinion might help you in discussions with that editor about the fate of your own manuscripts.

4. If you are a reliable and thoughtful reviewer, editors may return the favor by trying to make the manuscript review process as efficient as possible for you. If you submit a lousy manuscript, the editors are unlikely to give you a break just because you are a good reviewer, but a grateful editor might feel inclined to handle your manuscript soon after the reviews come in rather than letting it languish in their inbox for a while.

5. In some fields, for some journals, editors are influential people and it can be a good thing to come to their attention as a bright and thoughtful person. This can be helpful not just with your own manuscript submissions, but just in general in terms of your visibility and professional standing in your field.

Note, however, that not everyone shares this view that editors can be important people in their fields. A few years ago, I was in a committee meeting during which one of my fellow committee members, an outspoken professor with strong opinions, tried to sink the nomination of a particular candidate for an award by noting that the candidate was an editor of a journal and this meant that the candidate was a "has-been" whose research career was so washed up that he was now an editor instead of a real researcher. He announced that most editors are "losers". There was silence in the room, so he said "I'm guessing that there are a lot of editors in this room and that you all now hate me." I said "I don't know about the others, but I'm an editor and I hate you." (In fact, I didn't hate him at all, but it felt good to say it.)

6. And finally, reviewing is considered Professional Service, a component of a faculty job at many institutions. You can list on your CV or faculty activity report or tenure dossier the journals for which you have done reviews. If editors are requesting reviews from you, this is a sign of professional visibility, and in many fields that is a good thing.

As I've written before, if you submit manuscripts, you should review manuscripts. If you review manuscripts, you should do a careful and constructive job, finding a good balance between sharing your expertise and not sharing any irritation or biases that are not appropriate to display in a review. If you are angry at an author because they gave you a bad review or you hate their former adviser or whatever, don't do the review.

I hope this is a semi-convincing list of the various reasons why reviewing can be useful for the reviewer beyond the content of the manuscript. These reasons will be cold comfort when you are deep into a ghastly manuscript, but realize that somewhere, somehow, someday, it is better to be a constructive and thorough reviewer than a mean and/or lazy reviewer.

Monday, April 12, 2010

Editorial Opinions (2)

It is completely understandable that some people who are new to reviewing manuscripts may lack confidence in their reviews and wonder whether they are commenting on the "right" things in the "right" way and in the "right" amount of detail. It might be comforting for these uncertain reviewers to see the comments of the other reviewers to gauge whether they are on track with their own review.

Consider, though, that the content and styles of reviews vary a lot from reviewer to reviewer because reviews should vary a lot. It isn't necessarily such a good thing, then, if your review comments correspond well with those of other reviewers. In fact, if you commented on completely different things that the other reviewer didn't consider or notice, this could make the reviews even more useful to the author(s) and editors.

As an editor, I try to select reviewers who will examine a manuscript from different points of view. Of course different reviewers should be able to detect any major flaws in a manuscript, but beyond that, I want different reviewers to comment on different aspects of a manuscript. Otherwise, why get more than one review?

Doing a review is not a test that you pass or fail as a reviewer. You are providing a service to your professional community by sharing your expertise.

What should a review contain?

Reviews should provide a thorough and constructive critique of the content of a manuscript, focusing in particular on the data, analysis, and/or ideas that form the basis of the work. You should consider whether you think the interpretations are justified, making it clear whether something is objectively "wrong" or whether you just don't like it.

I am not impressed when a reviewer says "This is wrong" about something in a manuscript but doesn't explain why and doesn't provide any suggestions about better alternatives or ways to get at a not-wrong result. If you want your review comments to be considered by the editor and the author, you need to back up any criticisms as much as possible. It also helps to be polite. Your comments will be taken more seriously if you write "I do not agree with the interpretation that A follows B, and suggest instead that..." as opposed "These people are seriously stupid if they think that A follows B."

Note: Some reviewers write their reviews in the active voice, directly addressing the authors as "you", as in "You should consider deleting that entire section that starts on page 17"; others refer indirectly to "the authors", as if the comments are addressed primarily to the editor, although of course the authors will read these comments. Perhaps the custom varies in different disciplines or different journals, or maybe it is just a reviewer personality thing.

In your review, if you are going to suggest the addition of a citation of one or more of your own papers, you should explain why this should be done. As a reviewer, I typically comment on citations of my own papers, or lack thereof, only if (1) a paper is mis-cited (i.e., my paper on purple kangaroos who live in lunar craters is cited after a statement noting that green rabbits live on Neptune); or (2) if there is an egregious omission (i.e., a statement that purple kangaroos live in lunar craters and then no citation of my work whatsoever, despite the fact that I have published extensively on this topic and no one else has).

Reviewers should, to some extent, consider the manuscript as a completed thing and only suggest the addition of new items (particularly those involving new research activities that may be costly in terms of money and time) if those items are absolutely essential to the manuscript; i.e., without them, the paper is not publishable. If you truly believe that a paper is not publishable based on its current content, of course you should state this in your review and back up this opinion with reasons, but if you just think the paper would be better with more data, make it clear that you are making a suggestion, not pointing out a fatal flaw.

This is where an editor can play an important role. In many cases when I see this type of do-more suggestions in reviews, I tell the author that I think this is an unreasonable suggestion and they do not need to address it in their revision. In other cases, I concur with a reviewer and tell the author that their paper is not publishable without this additional work; fortunately these cases are quite rare.

It is also very useful if a reviewer comments on technical aspects of a manuscript, particularly those issues related to clarity. Does the organization of the text make sense or does it interfere with your understanding of the major points of the paper? Is the paper too long/too short? If not, what is a better way to present the information?

I understand if a reviewer does not want to take the time to fix the writing problems in a manuscript, especially if there are a lot of problems. I don't like doing this as a reviewer and I find it annoying as an editor, especially if at least one of the co-authors is a native English speaker. I am not paid for my work as an editor, and co-authors who are able to fix their own writing problems should take the time to do so before submitting a manuscript and expecting others to clean it up. If none of the authors are native English speakers, of course I can and do help with writing issues, but I am always grateful when a reviewer takes the time to do this as well.

To those who lack confidence in their reviews: don't worry. Just do a careful job of reading and commenting on the manuscript, and there is a very good chance that your review will be helpful to the author(s) and editor.

Keep in mind that your main job is not to point out new and different research activities that the authors should have done or could do, and focus on what is in the manuscript. Provide both general and specific comments (including noting what you liked about the manuscript, if anything, not just what you didn't like), note any problems you find, make constructive suggestions, and don't take too long with your review. Also remember that by reviewing a manuscript you are doing a great service to all involved, and perhaps learning something interesting, so don't stress out, just dive in and write out your comments.

Friday, April 09, 2010

Editorial Opinion

There are many different ways that one can be involved in the editorial aspects of scholarly journals, and one's experience with the editorial universe can also vary considerably depending on whether a journal is published by a professional society or by a for-profit company.

Some variations on the wonderful world of editing a journal include:

1. being on an editorial board that essentially serves as a pool of reviewers (i.e., if you agree to be on the editorial board, you agree to review most manuscripts that are sent to you);

2. being on an editorial board that exists only as a list of names on a journal to show.. actually, I don't know what it shows. When I agreed to be on the EB for one particular journal, I assumed that I would actually do more than just have my name listed, but so far I haven't done anything. Does my Distinguished Name add luster to this journal, inspiring more people to read it? No way. The only people who would read this journal already have an intense interest in this very specific aspect of Science. Perhaps the in-name-only EB is like having a list of "fans" or "friends" of the journal.

3. being an associate editor for journals that have an extra editorial layer between the reviewers and the editor(s). I have been an AE at various times in the past. This type of editorial organization can be a bit inefficient, but this type of structure makes sense for some journals that have a somewhat broad scope. The editors need a pool of experts who are better qualified to select reviewers and provide their own comments on the manuscript and the reviews, but the editor or editors make the final decisions.

4. being the editor of a journal. Variations on this include: (a) being the one and only chief editor of a journal, and (b) being one of 2 or more other editors who are autonomous in their decision-making. And of course these editors can either be part of a system that has associate editors or an active editorial board, or may themselves be directly involved in selecting reviewers.

I have been or currently am involved in one or more of each of the above except 4a.

Somewhere in the blogosphere recently -- I am sorry I don't remember the blog, as I was roaming somewhat indiscriminately at the time -- I read someone's opinion that editors should be eliminated so that reviewers and authors could communicate more directly. I don't remember if the person holding this opinion has ever been an editor, but I'm inclined to think not.

As anyone who has received reviews for their own manuscripts likely knows, reviews vary a lot in terms of constructiveness, thoroughness, usefulness, and politeness. Part of an editor's job is to even out some of the roughness of the reviews, to provide more substance if the reviews lack it (in some cases by finding additional reviewers), to guide authors regarding revisions, and to reconcile disparate reviews or choose one review over another as being more instructive. In rare cases, editors rescind reviews or reviewer comments that are offensive. We keep the system running despite the vagaries of the reviewers (and authors).

Being an editor of a journal that covers a broad range of topics is difficult because you have to rely so much on the expertise of others, but it is also difficult editing a more specialized journal in which you know many of the authors and reviewers. In that situation, your own professional interactions with specific individuals are at stake and may be influenced by your editorial work.

In my work as an editor, I have found it essential to have a good online editing system that keeps track of reviewer data such as: time since last review for this journal (so I don't overload anyone with too many reviews), average time it takes a reviewer to submit a review, and information about the reviewing habits of an individual (e.g., do they routinely return thorough and useful reviews or are their reviews shallow and useless?). If someone is known to me in advance to be a not-so-great reviewer but is nevertheless someone who can provide an important point of view, I might try to get an additional reviewer for the manuscript in question.

I try to keep the system moving as rapidly as possibly, but of course I am somewhat at the mercy of the reviewers for this. Even so, when reviewing time becomes too prolonged, I have several contingency plans: (1) I have a small group of willing "emergency reviewers" who might be able to provide a rapid review; I try not to use this group if at all possible, but they have saved the day on a number of occasions; (2) I act as a reviewer myself, if I feel qualified to comment on the manuscript's topic; or (3) If I have one thorough review in hand, I will just use that and add my own comments (not as a reviewer, but just to make note of anything I think the one reviewer missed). In some cases a delinquent review is submitted in time to be of use during the revision process. So far I have not had any situations in which a late review contained information that would have changed my editorial decision on a manuscript if I had the review earlier, but perhaps I have just been lucky.

It has been important for me to find the right balance in terms of time I spend on editing tasks and the types of editing activities that I do. At the moment, I am quite content with my editing experiences both in terms of types and the time involved. Perhaps in the future I will want to branch out to other editorial experiences, for the challenge or for variety, but right now, things are good the way they are.

I have also served on a search committee that evaluated candidates to be editor of a journal, and this was kind of interesting because each candidate had a different combination of skills. But which was the right combination?

Some of the candidates were excellent scientists and would have added prestige to the journal, but it was clear (in some cases by their own admission) that they did not have the organizational skills or the time to do a good job. Other candidates seemed to have excellent organizational skills and editorial experience, but they were not well respected as scientists. We didn't want someone whose major qualifications were clerical skills. And other candidates had other liabilities (e.g., a candidate who had lots of editorial experience but who had been sanctioned for plagiarism). And what if someone is an excellent scientist and quite organized, but is a polarizing figure, well known for being involved in disputes that at times involved unprofessional behavior? Is that relevant to an individual's qualifications to be an editor? In fact, it probably is quite relevant.

But why be so picky? These people were interested in spending vast amounts of time for no/low pay as a professional service. Shouldn't a journal be happy just to find someone willing to do the "job"?

Fortunately, amazingly, we eventually found a person who was excellent in all respects for this particular position. I guess as long as there are people like that who have the energy, skills, and personality to succeed in the job, the system will continue to function.

I don't know what it's like in other fields, but as an editor of a journal in my field of the physical sciences, I have been impressed with the dedication and care that many reviewers take with their reviews. Therefore, despite the peer reviewing system's flaws -- and colleagues and I recently encountered a rather shocking example of one of these flaws (perhaps more on that some other time) -- my experience has shown that it is mostly a good system that involves a lot of conscientious reviewers and editors who give their time and share their expertise to make it work.

[I haven't decided yet about Monday's topic, but I have a few more things to say on the topic of being an Editor. Also, perhaps we can all share our most disturbing experiences with reviewers and editors next week, to balance out today's mostly-positive view of the peer review system. So save your stories of that sort for next week!]

Thursday, April 08, 2010

Playing the Game (2)

Citation index considerations aside, have you made any publication decisions specifically because you wanted to increase your number of publications, on the cynical-but-perhaps-justified assumption that more papers = better?

For example:

1. Have you taken what probably should have been one paper and split it up into two or more shorter (but nevertheless distinct) papers for the sole purpose of increasing the total number of papers on your CV?

Figuring out how many papers should be written about the results of a particular research effort is a bit of an art, and in some cases more papers is the best decision. Sometimes you know in advance whether to write results up as one or more paper(s), and sometimes you don't know until you start writing.

My question, therefore, refers to cases in which the main motivation for splitting up a project into n>1 papers is to crank up the publication numbers.

2. Have you published what probably should have been one paper but that instead were two or more related papers that were not as distinctly separated in content as in the first scenario? (i.e., shingling)

This is also a fuzzy concept because sometimes you want to publish one short and zippy paper and then another, longer one in a more specialized journal. Is that shingling? Or what if you decide to publish some different-but-related papers because each involves different groups of co-authors and it makes logistical sense to keep the publications separate? Or maybe you want to publish a review paper that summarizes information in some of your other papers. There are many legitimate ways in which similar papers are published by the same author.

But then there are other cases. I recall one time when I brought a manuscript to review on an airplane. This was back in the Days of Paper, so I had a hard copy of the manuscript, and had turned to a page with a figure on it. I was traveling with some colleagues to a conference, and a colleague in a different-but-related field was sitting next to me. He was also reviewing a manuscript, and turned the document to a page with a figure on it. It was the exact same figure. Yes, I know that manuscripts in review are confidential, but there we were, sitting next to each other with two different manuscripts submitted to two different journals at the same time, and there was at least one thing in both manuscripts that was identical. So we started comparing. The two manuscripts had the same authors, the same figures using the same data for the same topic, and only a slightly different "spin" put on different aspects of the data. Those two manuscripts clearly represented shingling of a sort that was probably not OK. We informed the editors of the journals.

3. Have you ever submitted a paper before the project had advanced as far as it probably should have before writing up part of it as a manuscript; i.e., a premature manuscript that was probably publishable but that you knew would be much better if you worked on the research more? (but you didn't feel you could afford to wait longer because you needed publications on your CV sooner rather than later)

As with the other cases, this is not an obviously bad thing to do either. Maybe you would have waited longer to publish if you already had tenure, but there are also good aspects of publishing a preliminary paper to communicate initial results rather than waiting, perhaps years, to publish one big definitive paper. You'd want to be as confident as possible that the preliminary paper was sound, but if you feel you have something to say that is of interest, I think it can be very useful to publish early and often.

I know that that is "playing the game" and perhaps contributing to the mass proliferation of academic articles so that the flow of information is overwhelming and the very act of publishing a scholarly work is devalued etc. etc., but I think that if you have something interesting to say, it's a good thing if you write it up and get it out there.

Ideally, in the course of your career, you will publish some short papers and some longer, more detailed papers and some review papers and some papers in Awesome Journal X and some other papers in Specialized Journals Y and Z, and it will all even out. It's in the early stage of an academic career when every decision about what/where/how much to publish can seem so critical.

From what I've seen in the physical sciences, the "best" route to take at all stages of an academic career is to try for a balance between publishing a reasonable number (according to the norms of your specific field) of very good but perhaps not awesome papers in respected journals, and then some (but likely fewer) rather awesome paper(s). This is preferable to having lots of narrowly focused papers or only/mostly having "big idea" papers. Together, however, these different types of publications demonstrate the breadth and depth of your research.

When deciding how to divide up a big project into papers, I try to optimize publication quality, speed, and impact, as well as consider what is most fair to the most number of co-authors, particularly students, postdocs, and/or tenure-track colleagues. This not always a straightforward decision, of course, and sometimes I wonder if I would do just as well by consulting a Magic 8-Ball for advice.

Or maybe I should go back for yet more training in Responsible Research Conduct. Surely somewhere in all those case studies and PowerPoint presentations, there is a nifty formula for sorting all of this out easily. {note use of delusional font}

Wednesday, April 07, 2010

Playing the Game (1)

This spring, I have to refresh my ethics training, a ritual that is annoying mostly because the university makes it so extremely difficult for faculty and postdocs not involved in the biomedical sciences to find relevant ethics training opportunities. I am really not that interested in spending 2 days learning about research with human subjects, as my research involves no human subjects (other than grad students..).

And now all our graduate and undergraduate students who receive a salary or stipend from NSF must be trained in ethics.

Ethics training is important, but it is boring: don't plagiarize, don't fabricate data, don't falsify data. And the case studies are bizarre.

So let's forget about whether the postdoc should hide the data outliers that may or may not be due to a power fluctuation during extremely expensive analyses at a national lab even though the grad student involved in the research thinks that they should at least inform their PI, and consider some more interesting situations. For example, following on yesterday's citation theme:

Has your awareness of the importance of citation data affected your decisions about publishing?

That is, would you have made a different decision about anything related to publications (authorship, type/number/format of publications etc.) if your citation metrics were not being constantly tabulated for all the world to see?

When answering the first-order question, consider only whether you have ever considered the impact of a publication decision on your citation indices. Such considerations are not a priori unethical; it is possible that such considerations will result in your making a completely ethical and smart decision that helps your career. An example of that might be to send a manuscript to a journal that is indexed instead of to an edited volume being published as a not-indexed book. You do not change anything about the authorship or content of the paper; just the publication venue.

But now consider whether you have ever made a citation-fueled publication decision that might not have been entirely ethical but that could possibly be justified because "That's how the game is played." (others are doing it; if you don't play the game, you lose; etc.).

I don't think I've made any unethical decisions about research publications, but I definitely had citations in mind a couple of years ago when I decided to revise a much-cited technical document that was originally authored by someone else (now long retired) and that was in great need of an update. In that case, though, I wasn't thinking so much of my own citation index, but was instead intrigued by the idea of transferring citations from Journal 1 to Journal 2, in part because I am involved in the editing of Journal 2 and therefore have an interest in promoting the success of Journal 2. I hasten to add that I am paid nothing for my editorial work for Journal 2, so financial considerations were not involved. There were in fact valid scientific reasons for publishing the update in Journal 2, in addition to my personal affection for Journal 2. In the end, though, I published the update in Journal 1, but I admit that my original intentions were rather craven and driven in part by thoughts of citations.

That's the worst example I can think of for myself, but perhaps that is because I am a tenured mid-career professor. If I were on the tenure-track today, I am sure it would be difficult not to consider citation index issues when making publication decisions, although if it makes any of my early-career readers feel any better, I happen to know that at least some promotion & tenure committees at research universities are specifically instructed not to consider the h-index or other citation statistics when reviewing files for tenure and promotion.

to be continued..

Tuesday, April 06, 2010

Just Checking

If you have published at least one paper in a journal that is included in a citation index, how often do you check your own citation statistics? Do you know what your h-index is? (I mean, do you know the number, not what the h-index is.) Do you subscribe to a citation alert service so you are notified when someone cites your paper? Do you check up on the citation data of certain colleagues, whether or not your intentions are good?

I am not so interested in opinions about whether you think citation indices are a nifty metric or the worst thing to happen to academe since faculty meetings were invented, but go ahead and rant in the comments if you must.

Mostly I am wondering how often we are checking on our own citation data, no matter what we think of the significance (or lack thereof) of these data.

How often do you check your citation statistics?
As often as possible
Quite regularly, but not obsessively
Every once in a while, when I think of it
Maybe once a year, if that
Never
pollcode.com free polls

Do you know what your h-index is?
Yes, I know exactly what it is
Sort of
No, I have no idea
pollcode.com free polls

Monday, April 05, 2010

Pub Pubs

When I was a graduate student, I wrote a few papers that only involved other graduate students; no faculty were involved in these papers, and therefore only students were authors and co-authors. We came up with the research ideas by talking with each other, did the work, wrote the manuscripts, revised them, and eventually saw them published.

Our various advisers were pleased that we did so, and some of us benefited from these adviserless publications in our job searches. In fact, one of my co-authors was specifically told by a professor at another university that these publications sans professors were impressive because they clearly demonstrated independence and initiative. And I was told during one job interview that these and other papers without my adviser showed that I had my own ideas.

In some fields and in some sub-disciplines, adviserless papers may be impossible or at least extremely rare. They are not so common in my field, actually, but my fellow grads and I were fortunate to have advisers who liked the fact that we pursued and published our own work. I was never supported by a grant from my adviser anyway, and I came up with my own idea for a PhD project, so I was rather unconstrained in terms of what I worked on.

At the time, I didn't think about whether these adviserless papers were unusual. Whether or not they were at the time, I think they are (even?) more rare now. I discussed this recently with one of these collaborators with whom I wrote a paper when we were both grad students. He thought it might be more rare today, and wondered why it might be more rare, if it even is. Our two main hypotheses are:

1. Science, even at the level of graduate research, has become more interdisciplinary and involves larger groups. Our grad collaboration groups were somewhat interdisciplinary (i.e., we all had different advisers), but not extremely so (i.e., we were working in related fields). Perhaps it is much less likely that a group of grad students can reasonably organize and conduct research as it is done today.

or:

2. The culture of graduate programs has changed. Just comparing grad programs with which my colleague and I are most familiar today with our old grad department, it is clear that there is a lot more active advising today. By active advising, I mean that many advisers are more closely involved in all stages of the research and therefore likely to have contributed ideas, writing, maybe even data (!) to a paper, and therefore will be a co-author. In my old grad department, it was a rather extreme example of sink-or-swim, live-or-die. We were pretty much just set loose, and those who survived were very independent (or learned to be). It was not a great system, but perhaps one outcome was that we produced some original work that did not involve our advisers.

Do I really have to say that I am not basing a major analysis of academic cultural trends on these anecdotes. Experience shows that I need to make this point, or some readers will be shocked shocked shocked at my unscientific musings. But that is merely what they are: musings.

And lest anyone think that we did these adviserless projects because we had no lives outside graduate school and therefore never left our labs and computers and had lots of time: that was only true for some of us. Others in these grad collaborations had families, hobbies, and other outside interests. My first grad collaboration was with an outstandingly smart, kind, and thoughtful older grad student who was married, worked 8-5, and was very into sports of all kinds. Although we had little in common other than our mutual scientific interests, we found ourselves frequently hanging out at lunchtime or in the afternoon, talking about Science, and eventually the ideas we kicked around turned into a paper in a high impact journal within our field.

There is one aspect of that anecdote that might be illuminating in terms of the general issue of whether/how grad collaborations occur, and it is related to the topic of (undergrad) student lounges discussed last week: we grad students had a place to hang out. We had abysmal office space, but there was a central area with a couch and a table and some chairs and a scary refrigerator, and a lot of Science was discussed in that place. There was also a subset of us who regularly went out for coffee and cookies together in the afternoon (in fact, I have published a paper with my most frequent afternoon cookie companion from grad school) or to a local pub (I have published with my pub companions as well, so you I guess you can say that I have pub pubs, and hence the strange title of this post). Because we had these other occasions at which Science was discussed at length, I don't think our grad lounge area was the key factor in nucleating grad collaborations. It was nevertheless a factor.

I would be happy if grad students in my department collaborated with each other and wrote papers. Some do, but it is rare. As an adviser paying a student from a grant, I would want to be aware of such independent student collaborations in case I needed to give any general advice about priorities or time in relation to the grant that was funding them, but overall I think that these grad collaborations should be encouraged. They are difficult things to foster because of course the whole point is that advisers not be involved, but perhaps we advisers who value such experiences can at least be supportive when such collaborations spontaneously generate.

Friday, April 02, 2010

Unchanging

An ancient post that still gets comments from time to time, in many cases from non-academics, concerns the topic of whether a woman chooses to change (or hyphenate) her name when she gets married.

The most recent comment was from a smug and delusional person who seems to think that women who don't take their husband's last name are more likely to get divorced. Somehow I think the commenter was expressing their own insecurities rather than making a statement based on fact. Somehow I doubt that, after ~ 20 years in a marriage in which neither one of us at any time wanted me to change my name, the name issue is going to break up my marriage.

In this blog, I try to examine issues from various points of view, recognizing that we all have different experiences and priorities in our lives. But sometimes I make an unequivocal statement. This is one of those times:

Whether or not a woman changes her last name to her husband's has nothing to do with how much they love and respect one another. It has nothing to do with the strength of their bond. It is a personal decision that should be respected, no matter what that decision is.

I am now quite used to seeing the CVs of women who changed their names after first publishing under a different last name. In fact, this week I am spending a lot of time gazing at CVs for yet another committee that does this kind of thing, and have seen good examples of this. The change in name is easily and efficiently explained in a footnote to the CV. I completely don't care whether/why a woman changed her name. And I have no regrets about not changing my name. To each her own.

Thursday, April 01, 2010

Office Hour Chat

Every week I sit in my office during my designated office hour(s), and I get some student visitors during this time, especially before a problem set deadline or exam. Students also stop by my office at random times; they are welcome to come to my office whenever my door is open. Of course many students also send questions by e-mail, instead of or in addition to asking me questions in person, and I always reply.

This classic system of in-person office hours supplemented by e-mail works pretty well. There should not be any students who cannot somehow get their questions answered in a timely way.

Nevertheless, I have long felt dissatisfied by the limitations of this system. In part my dissatisfaction has stemmed from a feeling that students were waiting until the last minute (that is, just before the final exam) to study the review materials I provide after every class, and many were not reading the textbook, although I carefully selected a textbook that complements the class and has useful diagrams and information to which I specifically refer in class.

On the one hand: That's their problem, not mine.

But still. Is there any way that is relatively painless for us all abd that I could fix these classic problems be fixed in any way, at least for some students, at least a bit?

I don't know, but here is a new thing I have tried this term: I have an online office hour, at least once/week (perhaps more just before the final exam), and I use a designated networking site that I set up specifically for this class. During the e-office hour, I "chat" online in realtime with the students. I am sure others are doing this, but I just started this term.

This is much better than e-mail question-and-answer because it is interactive, allowing instant follow-up questions and clarification, and all students who login can see or participate in the chat. I can answer a question once, and all the students, even the lurkers, can see the answer. It is sort of like a review session, but it is more versatile because it is logistically so easy, I can have a mini review session every week, even if I am out of town. And, if I am at home, I can bring my cats to my "office hour".

Some students have not participated at all; some of these might participate just before the final exam; some might not ever participate. In that sense my e-office hour doesn't solve the problem of reaching every student, e.g., the terminal procrastinators, the insanely busy, or those drenched in apathy. Perhaps the students who participate in the online chat are the ones who were already keeping up with the review materials.

But perhaps I will be able to help a few more students in a somewhat more constructive way than otherwise, and that will be progress. That is what I want to try to evaluate at the end of the term. For now, though, I am happy with the chatty office hour and the easy way to increase substantive interactions with my students.

What I haven't figured out yet is whether there is a course size at which this type of online chat office hour is no longer manageable or whether it works for any size of course. Has anyone tried this with a giga-class yet?

Wednesday, March 31, 2010

Try Try Try to Understand

First, let me say that I hate myself for using lyrics from a song by Heart(?) in the title of this post, but it's what came to mind when I was mulling over the topic-of-the-day.

If this blog has any mission or goals, and it may not, one of them might be to demystify some of the experiences of Graduate School, and in particular the often fraught grad-adviser relationship. Some of my student readers seem very bitter about their graduate experiences. I know well that there are situations of extreme unfairness, but perhaps in some cases the anger stems from a lack of understanding of a system that is not always as transparent as it could or should be. In other cases, a bad situation may persist because a student doesn't know what the options are for resolution of the problem.

In saying this, my intention is not to 'blame the victim'. I want to be very clear that I abhor evil advisers, and that I think advisers (evil or not, and myself included) should work harder to explain what we do and why we do it. And I think that students can do more to ask constructive questions to try to get the information they want and need. Grad students vary in more ways than I ever imagined before I became an adviser, and I therefore appreciate it when students take the initiative to ask for the information they want and need.

When I was a student, I was often incredulous at the behavior, decisions, and overall philosophy towards students displayed by my adviser and other professors (though I never asked them about any of this), and was quite sure that I would do things in a very different way if ever I got the chance to advise students.

Well, of course it's not so simple. I provide more feedback and funding to my students than my adviser gave to me, although that is setting the bar rather low for improving adviser-grad interactions. Nevertheless, until you manage a research group yourself, you may not understand the decisions that go into how funding and publications and research responsibilities are prioritized and allocated. Some decisions or policies that seem unfair or inconsistent might actually be the actions of a well-intentioned adviser. And you shouldn't be too critical of how your adviser spends his/her time or research funds until know what it's like to be in a position of managing a research group, teaching, and having many service responsibilities, all at the same time.

That last point is in response to student comments and e-mails along the lines of "I do all the work and my adviser does nothing." I am deeply skeptical of such comments unless a student has an adviser who has no grants and has not provided the student with any research support or ideas, and who does not teach any classes nor do any service work for the institution or profession. Managing a research group is far from "nothing".

You can and should be critical, however, if your adviser doesn't provide you with timely feedback on your research progress, proposals, manuscripts, or other documents, despite specific and reasonable requests. And you certainly should be upset if all you get is criticism, with no suggestions for how to do things "right". These seem to be common complaints.

I think that in some (many?) cases of advisers who don't give timely feedback is that the adviser has so many things to do that it's not possible to do them all in a reasonable time frame, although in some cases it could be that the student's needs are lower in priority than they should be. That is a major problem for some, and it would be a significant improvement to the Grad Experience for many if we could all find a way to solve it. Perhaps we can use the collective wisdom of the FSP reading community to come up with some possible solutions.

As an adviser, I am pretty good about getting comments back to students on manuscripts and other documents, but I certainly have trouble getting co-authors to read, edit, or at least sign-off on manuscripts. These situations are different of course because I can remove a dysfunctional colleague from a project or send them an e-mail saying "If I don't hear from you by DATE, I will assume that you approve of the manuscript in its current form and will submit it with you as co-author." Students don't typically have that option, although I am curious if anyone has tried something like that with an adviser who sat on a manuscript for an unacceptably long period of time.

It is important to be clear about what amount of time is reasonable vs. unacceptable. If someone gives me a long document to edit just before a proposal deadline or conference or some other major time consuming activity, my response time might be slower. It is important to communicate about these things and, if possible, to work out an agreement about what would be a reasonable time frame for all concerned. That advice assumes that all parties involves are semi-reasonable people, perhaps a flawed assumption in some cases.

All of us who have advised students for many years can think of examples in which the adviser-grad interaction was very tense or somehow dysfunctional, not because the adviser was (necessarily) evil, but for a wide range of reasons involving misunderstanding, miscommunication, or widely divergent personalities and priorities. This is normal in any system involving interpersonal relationship, and may be particularly common when you add in the stress and power differential of adviser-student relationships.

Just because it is normal, however, doesn't mean we shouldn't try to fix problems that can be fixed. My overall message to grad students in apparently dysfunctional adviser-student situations is to first and foremost do whatever you can to try to understand the situation and make things work for yourself. Is your adviser really being evil and unfair? Maybe, maybe not. Be as proactive as is reasonable in your situation, and seek out allies in senior students, postdocs, and/or other faculty.

There are some extreme situations in which nothing you can do will work, and perhaps these situations can only be solved at the departmental or institutional level (if the will and means to do so exists), but my hope is that many misunderstandings can be resolved before they get magnified into major problems, and that advisers and students can develop highly functioning and respectful interactions through enhanced understanding on both sides.

Tuesday, March 30, 2010

Spring Cleaning

A reader wrote to me with a truly disgusting tale of the unhealthy and unacceptably low level of personal hygiene of a very smart and motivated graduate student. This raises the interesting but difficult question of how much an adviser can do in these situations. Can we demand a certain level of personal hygiene of our graduate students? Can and should these demands be enforced?

I hasten to note that this reader is dealing with an extreme situation. This is not the case of preferring that someone not sweat, or something of a similar level.

If the unsanitary behavior is so revolting that others in the group (including the adviser) find it nauseating to work with a particular student, it could be that the student has a serious physical or emotional problem that needs attention by the university health center. I have never been in the situation of having to ask a student to seek help for this type of problem, so I don't speak from experience here, but I think I would first inform someone in my department of the situation (e.g., the department chair, the grad adviser), perhaps consult with the campus health center, and then talk to the student about the problem and the need for him/her to get help.

You can't force a student to get medical help, but you can do things to minimize the impact of the situation on those who must work with the student. Note that I focus on students here because that is what the e-mail was about, but of course there are faculty with unfortunate personal hygiene issues as well.

In the specific case in which a student's unsanitary habits are degrading research group equipment or materials, including a computer dedicated to that student's use, I think it is reasonable in such extreme cases to take the computer (or whatever) away and insist that the student use their own personal computer or other items that are possible for an individual to purchase. Part of the terms of use of research equipment is that these items not be degraded any more than is usual for normal wear-and-tear.

It is also reasonable, in extreme cases, to set limits on what the student can and cannot do in terms of access to facilities and interactions with others. These limits should be very clearly stated and discussed with the student, however difficult it is to have that conversation. Someone who is just a slob (as opposed to mentally ill) may then be motivated to clean up, once it is clear that continued revolting personal habits have negative consequences for themselves.

It may be a good idea to have another faculty member or an administrator or even a counselor in the room when you, the adviser, has a conversation with the student about these topics. You don't want to humiliate or appear to gang up on a student who may be having severe problems, but you also want to make sure that conversations that touch on issues of a rather personal nature are dealt with in a professional way by those better equipped to deal with them.

If the student cannot or will not be helped, but does excellent work despite causing widespread revulsion in all who come into contact with him/her, perhaps there is a way for that student to work in near-isolation. That doesn't sound like a such a healthy or even good solution for the student, but the other options seem even worse. It is difficult to imagine what kind of career such a student could have upon obtaining a degree.

Perhaps others who have encountered similar situations as advisers will have better advice than I have been able to muster.

Monday, March 29, 2010

Plastic Brain

A major component of my research involves interacting with international colleagues and students, an aspect of my work that I enjoy very much. At some point years ago I decided that I should try to become more conversant in a particular language that would be useful to one of my long-running international research collaborations.

As some readers know from previous posts, after years of informal study and practice, I took 3 years of undergraduate classes at my university. The beginning, intermediate, and advanced language courses met 4-5 times/week during each academic year, and, as a result of these classes and the dedication of an excellent instructor, I finally progressed beyond a tourist-speak level of ability in this language. I also had some interesting experiences being an "undergraduate" again (example 1, example 2, example 3; others can be found by searching on the word 'language').

I took all the courses there were to take, so this year I have been meeting one-on-one with a language tutor, a young woman who is a non-science graduate student at my university. We meet twice a week for an hour or so of random conversation about life, the news, movies, books, anything. Although my tutor had no previous experience as a tutor, I was extraordinarily lucky to find such a kind, patient, and interesting person. I enjoy our meetings very much.

When I was taking classes, there were obvious milestones that helped me gauge my progress. We did oral presentations (typically twice in a term), and moved through a textbook series that systematically expanded our vocabulary and knowledge of grammar.

I was reasonably happy with my progress, although quite dissatisfied with my speaking skills. I was also very aware that it was getting more and more difficult for me to learn new words. It was considerably annoying to have to look up the same word over and over and find that it just wasn't sticking in my brain. In my youth, I had an excellent memory, but at some point I no longer did.

Now that my language learning involves mostly conversation, supplemented by some reading (newspapers, novels) and movie watching, I didn't know whether I was progressing or not -- I feared that I was getting stuck in some speaking-ruts, using the same simple words and grammar forms over and over. In my more pessimistic moments, I wondered if my ability to speak this language had plateaued, a victim of my aging brain and lack of time or opportunity to immerse myself in this language.

Recently, however, I had a few experiences that gave me some sense that I had made progress. For example, during a visit to another university to give a talk, I encountered a scientist from a country where this language is spoken, and we talked for more than an hour in this language. I couldn't have done that last year. I could have carried on some form of rudimentary conversation for an hour, but I couldn't really have conversed.

So, now I think that language learning is always going to be slower than I want it to be, but, even given the challenges of my aging brain and limited time, I think I can continue to make progress. I have not plateaued.

This gives me hope in general for my ability to learn new things. As a researcher, I hope that I can still explore new fields of knowledge, learn new techniques, and make connections between ideas. My detectable (albeit) slow progress with language learning is evidence that my brain isn't full (or emptying..) quite yet and that I haven't already learned everything I will ever learn.

I was thinking about this the other day, not only because I finally had a ray of hope about my progress with speaking skills in the language I have been trying to learn, but also because I was wondering what proportion of my time I spend transferring knowledge I already have (i.e., sharing my accumulated wisdom via teaching or advising) vs. having creative new thoughts about Science.

It's hard to calculate because, although I spend a substantial and perhaps steady amount of time on the former (knowledge transfer), the latter (acquisition of new knowledge, ideas) mostly comes in pulses, precipitated in part by a encountering a looming proposal deadline, reaching a particular stage with a paper, or needing to brainstorm with a student or colleague about some aspect of a project.

That's fine with me. As long as there is a not-infrequent component of my job involving creative thought, there will be a good balance between knowledge-out and knowledge-in, and my aging brain and I can continue to learn, discover, and have fun.