more senior than you, and whose ego is invested in a particular qualitative
finding (e.g., “School vouchers are bad”), you will predictably want to
avoid having them (or their cronies) as reviewers, which makes it tempting
to avoid citing their work. Avoid that temptation as much as possible. While
drawing those people as reviewers is certainly not ideal, a worse outcome
occurs when you get caught strategically
citing the literature, which is at
best interpreted as you not knowing what you are doing and at worst as you
trying to obscure some part of the literature. The only right way to act here
is to cite honestly, and use your writing skills to simultaneously signal to
the editor (who makes the final decision, and can often see through people’s
biases when given a reason to do so) that you are stepping on some toes and
to soften the blow of your findings to your reviewer’s ego.
Here is an example. I once wrote a paper
looking at the relationship
between farmers markets (number of farmers markets per capita in a given
state) and food-borne illness (aggregate number of outbreaks and cases of
food-borne illness per capita in a given state, and then the same broken
down by types of illness). The identification was obviously not up to
randomization standards, but it was pretty good, and we even supplemented
our core identification strategy (state fixed effects with a battery of means
of accounting for time: year fixed effects, linear time trends, state-specific
linear
time trends, census region–year fixed effects, and coarsely
controlling for violations of the stable unit treatment value assumption)
with a weather shock-based instrumental variable. No matter which way we
approached the data, we kept finding the same thing: there was a positive
relationship between farmers markets and food-borne illness.
But we also kept running afoul of one specific reviewer who hated our
finding because that reviewer was invested in the goodness of farmers
markets, to a point where they simultaneously told us, in the same referee
report, that (i) our results were likely spurious, and that (ii) we were looking
at “too many” outcomes because we disaggregated.
We resolved that
problem in our cover letter, by telling the editor that the reviewer was at
best not being earnest and at worst a crank when we wrote:
So we are in a
Catch-22: If we hadn’t
conducted a disaggregated
analysis by illness, we would have been told that our findings are
likely to be spurious. Now that we do conduct such a disaggregated
analysis, we are exposing ourselves to the “multiple hypothesis tests”
criticism. This really makes us wonder whether anything we do or say
will satisfy [that reviewer].
Ultimately, the editor saw through the reviewer’s bias,
and decided to
accept our manuscript for publication. Though you should not write as
candidly in a manuscript as we did in our cover letter, it is still possible to
write your introduction in such a way as to communicate to the editor (and
the other reviewers) that your work, though it may contradict someone
else’s
pet findings, is worthy of publication.
Dostları ilə paylaş: