A BEAUTY CONTEST OF
REFEREE PROCESSES OF ECONOMICS JOURNALS:
PRELIMINARY RESULTS
By Christian Seidl, Ulrich Schmidt, Peter Grösche
Department of Economics, University of Kiel, Germany
1. SURVEY
In the time between November 21st, 2001, and December 8th, 2001, we addressed some
twenty thousands of economists by e-mail asking them for their responses to seven questions
concerning their experience with the referee process of economics journals. For their responses, they were referred to an online-questionnaire. No less than some 5,300 persons had a
look at our questionnaire, but only 460 of them could bring themselves to fill in the first question of our questionnaire and provide usable responses. This induced us to launch a follow-up
request for responses starting in April 29th, 2002.
This second wave brought us about another 1,500 looks at our questionnaire with 170 usable responses to the first question. We have now finished a preliminary account of the results
based on 630 usable responses. As it will take some time to complete a paper, and get it over
the hurdles of a referee process (you know), we feel that we owe all persons bothered by our
plea, and – even more so – all persons who responded to our questionnaire, at least preliminary information about our results. Here they are!
2. JOURNALS
In our survey we had two groups of journals; first, what we call invited journals, and, second,
contributed journals. The invited journals centred on the famous Diamond (1989) list comprising 27 economics journals, which was enlarged by 49 journals taken from the A and B
categories of the VSNU (Vereniging van Samenwerkende Nederlandse Universiteiten - Association of Universities in the Netherlands) economics journals ranking list, which we considered as important enough to be included. This makes 76 invited journals. Second, we allowed
our respondents to add journals which they considered as important enough to be added to the
journals list. The invited journals are marked with an asterisk, the journals of the Diamond list
among them with a diamond, and the contributed journals are unmarked.
In Table 1 we list all journals for which the first question was answered (respondents could
answer subsequent questions only by passing Question 1 first). This table shows a list of 359
journals. Moreover, Table 1 also shows that our choice of 76 invited journals provided a good
match with respondents’ experience with paper submission. Among the 73 journals having at
least 10 responses to Question 1, only four were not listed among the invited journals. Notice,
furthermore, that all 10 journals which attracted one hundred or more responses are also in the
Diamond list. All journals of the Diamond list, with the exception of the Brooking Papers on
Economic Activity, elicited at least 11 responses to the first question. Table 1 also shows that
some renowned, mostly non-American journals, which existed well before 1989, were not
included in the Diamond list.
Of course, it does not make much sense to release data on journals for which only few responses were registered. As our documentation is purely descriptive, no valid criterion exists
which imperatively prescribes a cut-off benchmark. Hence we arbitrarily settled on five valid
responses to a question to include a journal into an evaluation result to be released. As some
respondents had chosen to drop out during the survey, the set of journals decreases somewhat
for later posed questions.
3. RESPONDENTS
A survey of researchers’ experience with referee processes can follow several routes. One
possibility is to address successful authors who managed to get their papers published in a
journal. Alas, this approach is endangered of biasing responses in favor of the respective journal because one asks the lucky ones whose work has been accepted. The other way is to address economists at large and thus collect also the experience of the less lucky ones which is,
however, crucial for a valid picture of the performance of referee processes.
We took the second route and asked several institutions for e-mail addresses of economists.
Fortunately for our survey, many of them lent us their help. We are very much indebted to the
European Economic Association, to the Verein für Socialpolitik, to the editorial board of the
Economics Bulletin, to the IZA [Forschungsinstitut zur Zukunft der Arbeit – Institute for the
Study of Labor] and to Inomics for having helped us with a link to our questionnaire, and to
many colleagues who helped us with e-mail addresses. Some e-mail addresses of economists
were collected by us. For helpful comments we are also indebted to our faculty colleagues
Sönke Albers and Joachim Wolf.
Several institutions denied their cooperation. The American Economic Association did not
answer our pleas addressed both to the President of the AEA and to its office. Neither did we
receive a reply from the Royal Economic Society. We received negative answers from the
Econometric Society (having asked the responsible person for making the society’s e-mail
announcements) and from North-Holland Publishing Company (which disposes of a huge
amount of e-mail addresses of economists addressed by Economics Alert). Some other minor
institutions either denied their cooperation or did not answer to our request for addresses. This
refusal of cooperation implies that American, Asian and Pacific economists are somewhat
underrepresented in our survey (cf. Table 2).
The data of all respondents were screened by hand. This led to the elimination of the data
of 13 respondents on various reasons. For instance, one respondent proposed a journal, inserted into the questionnaire that (s)he had not submitted any paper, but reported that (s)he
had received two referee reports on this nonsubmitted paper. Nine respondents had to be
eliminated because of untrustworthy data (for instance, one respondent had claimed to have
waited 999,999 weeks for a response from the editor of a journal; another one indicated to
have received 26 referee reports on average from a journal). As these were attempts at manipulation, the data of 13 subjects had to be eliminated, leaving us with 630 usable responses
to the first question. Of these, 551 participated in the survey through to the seventh question.
In addition to that, we listed respondents with respect to multiple uses of the same computers. If indeed somebody tried manipulation in favor or disfavor of some journals, (s)he is
likely to have addressed our questionnaire repeatedly and inserted similar ratings for selected
journals. So we listed the responses according to computer IP addresses and checked for similar evaluations. Although we observed multiple uses of the same computers in several cases
(which is completely understandable, as not sufficiently many computers are available in all
departments, and as some respondents may have availed themselves of the help of some other
persons, using their computers), we did not observe suspicious similarities of responses in the
cases of multiple uses of the same computers.
4. REACTIONS
We are indebted to many persons for their comments and suggestions. The tenor of the reactions was either helpful, sympathetic, or critical.
Many helpful comments drew our attention to related work, of which we were in some
cases not aware of, as respective work was published in sundry journals far outside economics. In this presentation of preliminary results, we cannot deal with related work, which has to
be deferred to our later paper, but, for the benefit of interested scholars, we enclose here a list
of references to related papers.
Numerous sympathetic reactions came from all strata of respondents. Some responses were
quite enthusiastic, such as this one from a female economist: “…great to see you have embarked on this”.
Many commentators argued that we should have posed more and more detailed questions.
Yet, it is true that we started originally from a far more comprehensive list of questions, but
decided to confine us to but seven questions for fear of too many drop-outs. Our experience
with this survey showed ample evidence that we were right in doing so: Only about eight per
cent out of all persons originally interested in our survey embarked on responding to all questions. However, we conjecture that some drop-outs might have been caused by inefficient web
services in some countries. For instance, no Indian economist managed to respond to our survey, although several had a look into our homepage. This might have been caused by an extremely slow web service in India. Interestingly enough, we registered also some interest on
the part of an economist from Nepal, but (s)he seems to have given up for similar reasons.
Other sympathetic scholars took the occasion of our survey to broach their own uneasiness
with the current referee situation. For instance, a prominent senior American economist sent
us the following comment:
The problem I have had is the inability or unwillingness of top mainstream journals to provide competent refereeing for papers that differ substantially in their
theoretical starting point from the, broadly speaking, neoclassical mainstream.
Thus papers that explore classical closures of economic models, that look at
growth theory without the framework of a Cobb-Douglas production function,
that address Marx’s theory of value and money, and the like, meet with hostility
from editors or incomprehension from referees.
The effect of this situation is to discourage people, and particularly younger
scholars, working in these traditions from even submitting papers to these journals. Thus the blandness and theoretical homogeneity they present is just the tip of
the iceberg. This has been a long-standing problem in economics, and as far as I
can tell it is probably getting worse rather than getting better.
Arguing along the same lines, another respondent coined the expression “Terror der Mainstream-Refereed-Journal-Anhänger”. However, these laments do not pertain to economics
alone. It seems to be a feature of all sciences to stifle innovative papers [see, for instance,
Barber (1961), Kuhn (1962), Goodstein and Brazis (1970), Abramowitz et al. (1975), Mahoney (1977), Garcia (1981), Epstein (1990), Horrobin (1990), Gans and Shepherd (1994),
Companario (1995)].
Critical comments were received exclusively from top prominent economists. For instance,
one of the world’s leading game theorists urged us: “please stop sending me reminders about
this research. such research projects are dangerous and misleading!”
Comments such as this suggest that research directed at referee processes of learned journals is likely to stir up a hornet’s nest among the incumbents of the profession’s most influential positions. The pioneering study, which drew much fire, was certainly the paper by Peters
and Ceci (1982a). They resubmitted twelve already published papers under fictitious names to
prestigious psychology journals. Only three of them were detected, eight of the rest were rejected, and only one was accepted. As to the rejected papers, no referee remonstrated lack of
novelty of the respective findings. Armstrong (1982b, p. 63) reports:
Many people are not enthusiastic about the P&C paper. Earlier versions of the paper had been rejected by Science and by the American Psychologist. Many of the
editors of the twelve journals involved in the P&C experiment were upset. Some
of them withheld relevant information, making it more difficult to interpret the
findings. One editor tried to sabotage the study by informing other editors [Peters
and Ceci 1982b]. Many of the commentators were also critical, particularly about
the ethics of deceiving editors. (Experimental study often requires deception, but
the matter seems especially serious when editors are deceived.)
Apparently, P&C are tampering with religion. Those who point out shortcomings
in this religion are dangerous people. For example, Michael Mahoney [1982] reported that, his 1977 experiment on journal reviewing practices led to attempts to
haven him fired. Other examples are provided by Manwell and Baker [1982].
They describe cases where plagiarists recycled work that had been previously
published in other journals. Two academic “whistleblowers” who spotted the plagiarism were dealt with harshly (one of them was fired). The plagiarists were not
punished. Apparently shortcomings in the review system are tolerated, but pointing out shortcomings is not.
In a reply to Armstrong (1982b), Herbert F. Ayres, then President of TIMS, remarked:
The cited, unsaintly negative reactions of the editors and their friends were because they – entirely correctly – saw the checks on “Journal Reviewing Practices”
as criticism of themselves and the structure of their system. They are responsible
because they are in charge. Do you expect referees to be saintly while their oxen
are gored when editors are not?
5. RESULTS
The results of our survey are summarized in Tables 3-9. For each question posed, we enumerate the journals with at least five valid responses in the order of desirability, using the mean
responses as the criterion of ranking. For identical mean responses, the respective journals are
assigned the same rank, and, within this rank, are arranged in an alphabetic order. When it
comes to single out particular journals, we focus on the most prestigious ones because it is
these journals which should represent patterns of exemplary referee processes. There is widespread agreement in the profession that the core journals of the most prestigious journals are
represented by those in the Diamond list. Therefore, journals from the Diamond list receive
special attention in the comments on our results.
Note that the responses to Questions 1-3 are numbers such as the spell to get a first reply,
numbers of referee reports received, and numbers of papers submitted and accepted. In contrast to that, the responses to Questions 4-7 result from mouse click to one out of seven fields
on Likert scales. In our results, the worst value is coded with a 0, and the best with a 6, so that
3 forms the mean coded value of each Likert scale if all values were clicked with equal frequency.
5.1 QUESTION 1: “AFTER SUBMISSION OF YOUR PAPER, HOW LONG DID IT TAKE
ON AVERAGE TO GET A REPLY OTHER THAN JUST A CONFIRMATION THAT
YOUR PAPER HAD BEEN RECEIVED?”
Table 3 contains the responses to this question, ordered with respect to the mean spell of a
reply measured in weeks.
The Quarterly Journal of Economics stands out as the speediest one. With a mean spell of
0.613 weeks it is an outlier with respect to fast response. However, given the high rejection
rate of this journal, which places it at the very end of Table 5, the Quarterly Journal of Economics’ pretence of being a thoroughly refereed journal is disproved by the facts. Even the
speediest referee process takes hardly less than two weeks. This means that the managing editor(s) of the Quarterly Journal of Economics reject(s) many of the submitted manuscripts
without ever having consulted a single referee as to rejection or acceptance of a paper. This
provokes at least two questions:
1. Why have referee processes been introduced at all in the economics profession, if
some managing editors return to those dictatorial practices which in days of yore have
exposed Alfred Marshall and John M. Keynes to the reproach of having suppressed all
work they disapproved from publication in the Economic Journal?
2. Why are journals, which violate the rules of decent referee processes, any longer listed
as refereed journals? It seems that we are in strong need of a certification agency
which monitors and certifies the property of being a refereed journal. [Indeed, Herbert
F. Ayres, then the President of TIMS, proposed in 1982 the establishment of a Rejection Review Board; cf. Armstrong (1982b).]
A related problem to be raised is the long spell of economics journals to reach a decision.
Hardly any journals decide below 10 weeks, and more than half of them need 20 weeks and
more to take a decision. 20 journals of the Diamond list (out of the 26 remaining ones) need
more than 20 weeks to make a decision.
This seems to be a defect which primarily befalls economics journals. In a recent letter to
the Royal Economic Society Newsletter, Paul Omerod (2002) remonstrates the long spell of
decision processes of the Economic Journal. In the year 2000, it took this journal 18 weeks to
reject a paper and 28 weeks to offer a revision of a paper. [Taking our respondents’ mean acceptance rate of 0.296 of Table 5, this gives a mean spell of 20.96 weeks, which is in line with
the 21.583 weeks for the Economic Journal in Table 3.] Omerod contrasts this with the experience he had made with five articles submitted to world class physics journals and with
two submitted to mathematical finance journals. Six out of these seven papers were accepted.
The average time to make a decision was 4.5 weeks, the largest being 8 weeks. Moreover,
Omerod reports that, from discussion with people, who have submitted regularly to such journals over the years, this experience is entirely typical, and is not simply a matter of small
sample bias
One might object that papers in economics are typically longer than papers in physics, yet
even an economics journal which confines itself to short papers only, such as Economics Letters, takes a mean spell of 14.774 weeks to reach a decision. Moreover, this journal, too, takes
some decisions based on the discretion of the managing editor only without entering the papers into a referee process. This is evidenced by its meagre average number of referee reports,
which is taken up in the next subsection.
A mean spell of more than one year was reached by three journals only. However, note that
the standard deviation of some journals is rather high.
5.2 QUESTION 2: “HOW MANY REFEREE REPORTS DID YOU RECEIVE ON AVERAGE?”
Table 4 shows that the more reputed journals tend to provide less referee reports than the less
reputed journals. For instance, only two journals from the Diamond list figure below rank 20,
viz. Econometrica and Economic Inquiry. The Spanish Economic Review (rank 18 out of 88)
is the last journal with a mean of two referee reports per respondent. The Quarterly Journal of
Economics is ranked 79 with a mean of 1.252 referee reports per respondent. Taken together
with the results of Section 5.1, it seems as if most respondents considered the managing editors’ rejection as a valid referee report. Economics Letters ranks last among the journals from
the Diamond list (0.86 referee reports per respondent). As this is less than one referee report
per respondent, this reflects that papers are rejected by the managing editor without ever having been entered into an ordinary referee process.
5.3 QUESTION 3: “HOW MANY PAPERS DID YOU SUBMIT TO THIS JOURNAL AND
HOW MANY PAPERS WERE ACCEPTED?”
Table 5 reports the paper acceptance rates. The aggregate acceptance rates can immediately
be calculated by dividing the entries of the sixth column by the entries of the fifth column.
However, it is more interesting to take the acceptance rates of the individual respondents and
compute their mean, median, and standard deviation using the individual data.
Several journals release data on acceptance rates. For other journals, one can easily get
information. Comparing these figures with the acceptance rates of Table 5, we find them up to
more than doubly as high as the real acceptance rates. Thus, our data seem to be biased by
two effects:
1. Trend effect: True acceptance rates fell with the lapse of time. Respondents who remember their submission history of papers amalgamate past with present experience,
which biases the present rejection rates upwards.
2. Selection effect: It seems that the more successful (and, perhaps, also the more active)
scholars felt more attracted by our survey than the less successful ones.
Unfortunately, we cannot control for these affects, but notice that they are at work. This
may well imply that the results presented in Tables 6-9 suffer from an upward bias. However,
as we did not pre-select our respondents a priori from the set of the successful ones, this upward bias is certainly less than it would have been, had we addressed only people whose papers were actually accepted for publication (e.g., by way of taking only the e-mail addresses
of respondents from publications in journals). On the other hand, a survey such as ours is endangered of attracting primarily frustrated respondents who wish to deal a blow to those journals which they consider to have treated them unfairly. The figures in Table 5 show that this
is certainly not the case
Table 5 shows that the more reputed journals have higher rejection rates. There are some
spectacular exceptions to this regularity. For instance, four journals of the Diamond list rank
below 50 (out of 94 ranks). However, 17 journals out of the Diamond list figure on the last 25
ranks.
It seems that rejections rates of papers are exceptionally high in economics and in the social sciences at large. Comparing the Economic Journal’s rejection rates with journals in
fields other than economics, Omerod (2002) reports his experience with five articles submitted to world class physics journals and with two submitted to mathematical finance journals.
Six out of these seven papers were accepted. Omerod’s experience fits with Armstrong’s
(1982b, p.64) observation that “Peer review is greatly relied upon in the management sciences
where almost 80% of the papers are rejected by the prestigious journals. (In physics, on the
other hand, almost 80% are accepted.)” [Even this bright view on physics does not guarantee
that important research findings are published of necessity. For instance, the first publication
on the famous scanning tunnelling microscope, which led subsequently to a Nobel Prize in
physics, failed in 1981 because a journal referee found the paper “not interesting enough”; see
Fisher (1989). For more general examples in science at large, see Companario (1995).]
5.4 QUESTION 4: “WERE THE REFEREE REPORTS COMPETENT?”
Table 6 contains the respective results. Surprisingly enough, our preliminary impression is
that the competence of referee reports is not positively correlated with the reputation of a
journal. Both the journals of the Diamond list and of the invited journals do neither bunch at
the upper not at the lower end. They appear to be rather evenly distributed among the ranks.
For instance, considering the mean rank of 44, 14 journals of the Diamond list rank ahead of,
and 12 rank behind the mean rank. Moreover, prima facie there seems to be no significant
correlation with the rejection rates of the respective journals. In view of rumors that some
editors, being snowed down with papers, encourage their referees to write negative referee
reports, high rejection rates may precipitate as less competent referee reports. However, more
detailed investigations have to be deferred to subsequent analyses of the data.
5.5 QUESTION 5: “DID THE DECISION OF THE EDITOR MATCH THE REFEREE REPORT?”
The responses to this question, summarized in Table 7, suggest that most journals score rather
good with respects to the matching of the managing editors’ decisions with the recommendations of the referee reports. Concerning the journals’ rankings, some prestigious journals with,
as it seems, high backlogs of manuscripts, such as the American Economic Review, the Journal of Political Economy, the Review of Economics and Statistics, the Journal of Public Economics, the Economic Journal, the Quarterly Journal of Economics, and some others, rank in
the rear, possibly because of the editors’ zeal to curb the growth of the queues of papers
agreed to be published.
However, a good match of managing editors’ decisions with the recommendations of the
referees need not be a proxy for fair refereeing because referee hostility or incompetence is
but insufficiently monitored by the editor. Notwithstanding that referees’ recommendations
may be highly contradictory [Cicchetti (1991)], editors tend to reject papers if only one referee recommends rejection irrespective of other referees’ judgments [see, for example,
Munley, Sharkin, and Gelso (1988), Marsh and Ball (1989), Bakanic, McPhail, and Simon
(1990), Kupfersmid and Wonderly (1994, p.56)].
5.6 QUESTION 6: “WERE THE REFEREE REPORTS CAREFULLY DONE?”
Table 8, which contains the results to this question, shows a less optimistic picture than Table
7. 66 out of 106 journals have scores less than 4. Only 6 out of the 26 journals of the Diamond
list (as the Brooking Papers dropped out) score at 4 or better than 4.
Many reputed journals are among the 20 last ranks of carefully done referee reports, viz.
the European Economic Review, the Oxford Economic Papers, Economics Letters, the Quarterly Journal of Economics, Economica, the Journal of Political Economy, and the Journal of
Financial Economics.
5.7 QUESTION 7: “HOW WAS YOUR OVERALL SATISFACTION WITH THE PROCEDURE OF PAPER SUBMISSION TO THE RESPECTIVE JOURNAL?”
This question was meant to summarize respondents’ overall satisfaction with the whole procedure of paper submission.
The results, arranged in Table 9, are disappointing for the prestigious journals. Out of 106
journals, 36 score at 4 or better, among them only five journals from the Diamond list. Out of
the 106 journals, 23 score worse than 3, among them eight journals from the Diamond list, to
wit, the European Economic Review, Economica, the Quarterly Journal of Economics, the
Journal of Labor Economics, the Economic Journal, the Journal of Monetary Economics, the
Journal of Financial Economics, and the Journal of Political Economy.
6. SUMMARY OF RESULTS
1. Some journals which pretend to be refereed journals are in fact only semi-refereed
journals.
2. The most prestigious journals (e.g., those from the Diamond list) are not the leading
ones in the evaluation questions 4-7.
3. The mean spell of reply is about 20 weeks, which is four times longer than for leading
journals of, e.g., physics. The most prestigious journals (20 out of the remaining 26 of
the Diamond list) need more than 20 weeks for making a decision.
4. Concerning acceptance rates, our data are biased by a trend effect and a selection effect, which may account for an upward bias in the response to questions 4-7.
5. Prestigious journals have higher rejection rates.
6. Competence of referee reports is largely evenly spread.
7. Compliance of editors’ decisions and referees’ recommendations is, in general, rather
good. This implies that editors but insufficient control of referee hostility or incompetence.
8. Only few prestigious journals score at 4 or better as to carefulness of referee reports.
9. The overall satisfaction with the referee process leaves the prestigious journals of the
Diamond list behind. Only five (among 36) score at 4 or better, whereas eight (among
23) score worse than 3.
10. Given severe irregularities in referee processes, we are in need of a certification
agency to certify decency of referee procedures of a journal.
7. REFERENCES
Abramowitz, S.I., Gomes, B., and Abramowitz C.V. (1975), Publish or Politic: Referee Bias
in Manuscript Review, Journal of Applied Social Psychology 5, 187-200.
Armstrong, J.S. (1997), Peer Review for Journals: Evidence on Quality Control, Fairness, and
Innovation, Science and Engineering Ethics 3, 63-84.
Armstrong, J.S. (1982a), Research on Scientific Journals: Implications for Editors and Authors, Journal of Forecasting 1, 83-104.
Armstrong, J.S. (1982b), Is Review by Peers as Fair as it Appears?, Interfaces 12, 62-74.
Bakanic, V., McPhail, C., and Simon, R.V. (1990), If at First You Don’t Succeed: Review
Procedures for Revised and Resubmitted Manuscripts, American Sociologist 21, 373-391.
Bairam, Erkin I. (1994), Institutional Affiliation of Contributors to Top Economic Journals,
1985-1990, Journal of Economic Literature 32, 674-79.
Baltagi, B., (1999), Applied Econometrics Rankings: 1989-1995, Journal of Applied Econometrics 14, 423-41.
Barber, B. (1961), Resistance by Scientists to Scientific Discovery, Science 134, 596-602.
Beed, C, and C. Beed (1996), Measuring the Quality of Academic Journals: The Case of Economics, Journal of Post Keynesian Economics 18, 369-96.
Bergstrom, T.C. (2001), Free Labor for Costly Journals? Journal of Economic Perspectives
15, 183-198.
Billings, B.B., and G.J. Viksnins (1972), The Relative Quality of Economics Journals: An
Alternative Rating System, Western Economic Journal 10, 467-69.
Bradley, J.V. (1981), Pernicious Publication Practices, Bulletin of the Psychonomic Society
18, 31-34.
Burton, M.P., and E. Phimister (1995), Core Journals: A Reappraisal of the Diamond List,
The Economic Journal 105, 361-73.
Bush, W.C., P.W. Hamelman, and R.J. Staaf (1974), A Quality Index for Economic Journals,
Review of Economics and Statistics 56, 123-25.
Campanario, J.M. (1995), On Influential Books and Journal Articles Initially Rejected Because of Negative Referees’ Evaluations, Science Communication 16, 304-325.
Canterbery, E.R., and R.J. Burkhardt (1983), What do we Mean by Asking Whether Economics is a Science?, in: A.S. Eichner (ed.), Why Economics is Not Yet a Science, London, Macmillan , 15-40.
Cicchetti, D.V. (1991), The Reliability of Peer Review for Manuscript and Grant Submissions: A Cross-Disciplinary Investigation, Behavioral and Brain Sciences 14, 119-186.
Colander, D. (1994), Vision, Judgment, and Disagreement Among Economists, Journal of
Economic Methodology 1, 43-56.
Coupé, T., (2000), Revealed Performances: World Wide Rankings of Economists and Economic Departments, unpublished manuscript, Free University of Brussels.
Diamond, A.M. Jr. (1989), The Core Journals of Economics, Current Contents 1, 4-11.
Eichenberger, R., U. Meier, and R. Arpagaus (2000), Ökonomen, Publikationen und Zitationen: Ein europäischer Vergleich, Perspektiven der Wirtschaftspolitik 1, 143-160.
Elliott, C., D. Greenaway, and D. Sapsford (1998), Who’s Publishing Who? The National
Composition of Contributors to Some Core US and European Journals, European Economic
Review 42, 201-206.
Epstein, W.M. (1990), Confirmational Response Bias Among Social Work Journals, Science,
Technology, and Human Values 15, 9-38.
Figlio, D. (1994), Trends in the Publication of Empirical Economics, Journal of Economic
Perspectives 8, 179-187.
Finzen. A. (1998), Der Impact Factor, Die Veränderung der Wissenschaftskultur durch die
Quantifizierung wissenschaftlicher Leistung, Phlebologie 27, 77-83.
Fisher, A. (1989), Seeing Atoms, Popular Science, 102-107,
Fiske, D.W. and Fogg, L. (1990), But the Reviewers are Making Different Criticisms of my
Paper! Diversity and Uniqueness in Reviewer Comments, American Psychologist 45, 591598.
Fölster, S. (1995), The Perils of Peer Review in Economics and Other Sciences, Journal of
Evolutionary Economics 5, 43-57.
Fry, B.M., and H.S. White (1976), Publishers and Libraries: A Study of Scholarly Research
Journals. Lexington, MA: Lexington Books.
Gans, J., and G. Shepherd (1994), How are the Mighty Fallen: Rejected Classic Articles by
Leading Economists, Journal of Economic Perspectives 8, 165-179.
Garcia, J. (1981), Tilting at the Paper Mills of Academe, American Psychologist 36, 149-158.
Garfield, E. (1972), Citation Analysis as a Tool in Journal Evaluation, Science 178, 471-479.
Goodstein, L. and Brazis, K. (1970), Credibility of Psychologists: An Empirical Study, Psychological Reports 27, 835-838.
Harzing, A.-W. (2001), Bradford University School of Management Journal Quality List, July
2001.
Hawkins, R.G., L.S. Ritter, S. Lawrence, and I. Walter (1973) What Economists Think of
their Journals, Journal Political Economy 81, 1017-32.
Hodgson, G.M. and H. Rothman (1999), The Editors and Authors of Economics Journals: A
Case of Institutional Oligopoly?, The Economic Journal 109, F165-F186.
Horrobin, D.F. (1990), The Philosophical Basis of Peer Review and the Suppression of Innovation, Journal of the American Medical Association 263, 1438-1441.
Jauch, L.R., and Wall, J.L. (1989), What they do when they Get your Manuscript: A Survey
of Academy of Management Reviewer Practices, Academy of Management Journal 32, 157173.
Judge Institute of Management Studies (1994), Quality Rankings of Journals in Management
and Social Science: The Judge Institute of Management Studies List, Cambridge: The Judge
Institute of Management Studies, University of Cambridge, mimeo.
Juhasz, S., Calvert, E., Jackson, T., Kronick, D.A., and Shipton, J. (1975), Acceptance and
Rejection of Manuscripts, IEEE Transactions of Professional Communications PC18, 188184.
Kalaitzidakis, P., Mamuneas, T.P., and Stengos, T., (1999), European Economics: An Analysis Based on Publications in the Core Journals, European Economic Review, 43, pp. 1150-68.
Kalaitzidakis, P, T.P. Mamuneas, and T. Stengos (2001), Rankings of Academic Journals and
Institutions in Economics, Working Paper, University of Leicester, October 2001.
Kocher, M.G., and M. Sutter (2002), The Market for Publications in Top Economics Journals,
The Economic Journal (forthcoming).
Kuhn, T.S. (1962), The Structure of Scientific Revolutions, Chicago, University of Chicago
Press.
Kupfersmid, J., and Wonderley, D.M. (1994), An Author’s Guide to Publish Better Articles in
Better Journals in the Behavioral Sciences, Brandon, Vermont, Clinical Psychology Publishing Co.
Laband, D.N., and M.J. Piette (1994a), Favoritism Versus Search for Good Papers: Empirical
Evidence Regarding the Behavior of Journal Editors, Journal of Political Economy 102, 194203.
Laband, D.N., and M.J. Piette (1994b), The Relative Impacts of Economics Journals, Journal
of Economic Literature 32, 640-66.
Leamer, E.E. (1981), The Hit Parade of Economics Articles, in: E. Tower (ed.), Economics
Reading lists, Course Outlines, Exams, Puzzles and Problems 14, 3-54.
Liebowitz, S.J. and J.P. Palmer (1984), Assessing the Relative Impact of Economics Journals,
Journal of Economic Literature 22, 77-88.
Lindsey, D. (1978), The Scientific Publication System in Social Science, San Francisco:
Jossey-Bass.
Lock, S., and Smith, J. (1990), What do Peer Reviewers do?, Journal of the American Medical Association 263, 1341-1343.
Lock, S., and Smith, J. (1986), Peer Review at Work, Scholarly Publishing 17, 303-316.
Lloyd, M.E. (1990), Gender Factors in Reviewer Recommendations for Manuscript Publication, Journal of Applied Behavior Analysis 23, 539-543.
Mahoney, M. (1982), Publication, Politics, and Scientific Progress, Behavioral and Brain Sciences 5, 220-221.
Mahoney, M. (1977), Publication Prejudices: An Experimental Study of Confirmatory Bias in
the Peer Review System, Cognitive Therapy and Research 1, 161-175.
Manwell, C., and Baker, C.M. (1982), Reform Peer Review: The Peters and Ceci Study in the
Context of other Current Studies of Scientific Evaluation, Behavioral and Brain Sciences 5,
221-225.
Marsh, H.W., and Ball, S. (1989), The Peer Review Process Used to Evaluate Manuscripts
Submitted to Academic Journals: Interjudgmental Reliability, Journal of Experimental Education 57, 151-169.
Munley, P.H., Sharkin, B-, and Gelso, C.J. (1988), Reviewer Ratings and Agreement on
Manuscripts Reviewed for the Journal of Counseling Psychology, Journal of Counseling Psychology 35, 198-202.
Omerod, P. (2002), Dealing With Journal Submissions, Royal Economic Society Newsletter
No. 117, 18.
Peters, D.P., and Ceci, S.J. (1982a), Peer-Review Practices of Psychology Journals: The Fate
of Published Articles, Submitted Again, Behavioral and Brain Sciences 5, 187-195.
Peters, D.P., and Ceci, S.J. (1982b), Peer-Review Research: Objections and Obligations, Behavioral and Brain Sciences 5, 246-252.
Pressman, S.(1994), Simultaneous Multiple Journal Submissions: The Case Against, American Journal of Economics and Sociology 53, 316-333.
Ross, C. (1982), Rejecting Published Work: Similar Fate for Fiction, Behavioral and Brain
Sciences 5, 236.
Ross, C. (1979), Rejected, New West 4, 39-41.
Rowney, J.A., and Zenisek, T.J. (1980), Manuscript Characteristics Influencing Reviewers’
Decisions, Canadian Psychology 21, 17-21.
Rushton J.P., and H.L. Roediger (1978), An Evaluation of 80 Psychology Journals based on
the Science Citation Index, The American Psychologist 33, 520-23.
Shepherd, G. (ed.) (1995), Rejected: Leading Economists Ponder the Publication Process.
Thomas Horton and Daughters, Sun Lakes, Arizona.
Simon, R., Bakanic, V., and McPhail, C. (1986), Who Complains to Editors and What Happens, Sociological Inquiry 56, 259-271.
Skeels, J.W., and R.A. Taylor (1972), The Relative Quality of Economics Journals: An Alternative Rating System, Western Economic Journal 10, 470-73.
Speck, B.W. (1993), Publication Peer Review: An Annotated Bibliography, Greenwood Publishing Group, Westport, Connecticut.
Stigler, G.J., S.M. Stigler, and C. Friedland (1995), The Journals of Economics, Journal of
Political Economy 103, 331-59.
Szenberg, M. (1994), Disseminating Scholarly Output: The Case for Eliminating the Exclusivity of Journal Submissions, American Journal of Economics and Sociology 53, 303-315.
Voos, H., and K.S. Dagaev (1976), Are all Citations Equal? Or Did We Op Cit Your Idem?,
Journal of Academic Librarianship 6, 19-21.
White, M.J., and K.G. White (1977), Citation Analysis of Psychology Journals, The American
Psychologist 32, 301-05.
Wilson, J.D. (1978), Peer Review and Publication, Journal of Clinical Investigation 61, 16971701.
Yankauer, A. (1990), Who are the Peer Reviewers and How Much do they Review?, Journal
of the American Medical Association 263, 1338-1340.
Yankauer, Y. (1985), Peering at Peer Review, CBE Views 8, 7-10.
8. TABLES
Table 1: Frequency of Journal Nomination (Usable Responses to Question 1)
No. Rank * ♦ Journal
1
1
* ♦ European Economic Review
2
2
* ♦ Economics Letters
3
3
* ♦ American Economic Review
4
4
* ♦ Quarterly Journal of Economics
5
5
* ♦ Economic Journal
6
6
* ♦ Journal of Public Economics
7
7
* ♦ Econometrica
8
8
* ♦ Journal of Economic Theory
9
9
* ♦ Journal of Political Economy
10
10 * ♦ Review of Economic Studies
11
11 * ♦ International Economic Review
12
12 *
European Journal of Political Economy
13
13 * ♦ Review of Economics and Statistics
14
14 *
Scandinavian Journal of Economics
15
15 *
Journal of Economics (Zeitschr. f. Nat.ök.)
16
16 *
Journal of Economic Behavior and Organization
17
17 *
Games and Economic Behavior
18
18 * ♦ Rand Journal of Economics
19
18 *
Weltwirtschaftliches Archiv
20
19 * ♦ Economica
21
20 * ♦ Journal of International Economics
22
20 *
Public Choice
23
21 *
Kyklos
24
22 * ♦ Oxford Economic Papers
25
23 *
Economic Theory
26
24 *
Journal of Institutional and Theoretical Economics
27
25 *
Journal of Industrial Economics
28
26 * ♦ Journal of Development Economics
29
27 *
Empirical Economics
30
28 *
Finanzarchiv
31
29 * ♦ Canadian Journal of Economics
32
30 *
Journal of Economic Dynamics and Control
33
31 * ♦ Journal of Monetary Economics
34
32 * ♦ Journal of Labor Economics
35
32 *
Oxford Bulletin of Economics and Statistics
36
33 *
Management Science
37
34 *
Journal of Money, Credit, and Banking
38
34 *
Mathematical Social Sciences
39
35 *
Journal of Human Resources
40
35 *
Journal of Public Economic Theory
41
35 *
Social Choice and Welfare
42
36 *
International Journal of Game Theory
43
37 *
Journal of Finance
44
37 *
Theory and Decision
45
38 *
Journal of Applied Economics
46
38 *
Southern Economic Journal
47
39 * ♦ Economic Inquiry
48
39 * ♦ Journal of Mathematical Economics
49
40 *
Journal of Population Economics
50
41 * ♦ Journal of Econometrics
51
41 *
Scottish Journal of Political Economy
52
42 *
Cambridge Journal of Economics
53
42 *
Metroeconomica
54
43 * ♦ Journal of Law and Economics
* Invited Journals
♦ Diamond List
All others are contributed journals
No. of
Responses
216
197
193
137
134
126
113
110
103
102
93
89
84
83
82
79
76
72
72
68
67
67
64
63
62
59
58
52
50
44
43
41
40
38
38
37
36
36
35
35
35
33
32
32
31
31
30
30
29
27
27
21
21
20
Table 1: Frequency of Journal Nomination (Usable Responses to Question 1)
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
44
45
45
46
46
47
47
47
47
48
48
49
50
50
50
51
51
51
51
52
52
52
53
53
53
53
53
53
54
54
54
54
54
54
54
54
55
55
55
55
55
55
55
56
56
56
56
56
56
56
56
56
56
56
56
56
International Journal of Industrial Organization
Journal of Common Market Studies
Journal of Economic Psychology
Journal of Health Economics
Public Finance
Geneva Papers of Risk and Insurance
Journal of Business
Journal of Risk and Uncertainty
Journal of Urban Economics
Review of Income and Wealth
Review of International Economics
* ♦ Journal of Financial Economics
*
Australian Economic Papers
* ♦ Journal of Economic Literature
*
Regional Studies
Applied Economics
*
Econometric Theory
Journal of Business and Economic Statistics
*
Public Finance Quarterly
International Tax and Public Finance
Journal of Macroeconomics
*
National Tax Journal
*
Economic Record
Jahrbücher für Nationalökonomie und Statistik
Journal of Economics and Management Strategy
Labour Economics
Regional Science and Urban Economics
Research Policy
Academy of Management Journal
Economic Modelling
German Economic Review
Industrial and Labor Relations Review
Journal of International Money and Finance
Open Economies Review
*
Pacific Economic Review
Zeitschrift für betriebsw. Forschung/ Schm. Bus. Rev
*
Annals of Regional Science
Economic Systems
Health Economics
Journal of Applied Econometrics
Journal of Environmental Economics and Management
Journal of Law, Economics, and Organization
Konjunkturpolitik
Ecological Economics
Economic Systems Research
Empirica
Environmental and Resource Economics
International Review of Law and Economics
Investigaciones Economicas
Journal of Banking and Finance
*
Journal of Consumer Research
Journal of International Business Studies
Journal of Policy Modelling
Journal of Regional Science
Labour: Review of Labour Economics and Industrial Relations
Spanish Economic Review
*
*
*
*
*
*
*
*
*
* Invited Journals
♦ Diamond List
All others are contributed journals
18
17
17
16
16
15
15
15
15
13
13
12
11
11
11
10
10
10
10
9
9
9
8
8
8
8
8
8
7
7
7
7
7
7
7
7
6
6
6
6
6
6
6
5
5
5
5
5
5
5
5
5
5
5
5
5
Table 1: Frequency of Journal Nomination (Usable Responses to Question 1)
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
57
57
57
57
57
57
57
57
57
57
57
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
58
59
59
59
59
59
59
59
59
59
59
59
59
Applied Economics Letters
Bulletin of Economic Research
De Economist
Economics and Politics
International Trade Journal
Journal of Economic Integration
Journal of Productivity Analysis
Kredit und Kapital
Review of Economic Design
Review of Financial Studies
Strategic Management Journal
Atlantic Economic Journal
* ♦ Brooking Papers on Economic Activity
Economic Development and Cultural Change
Economic Notes
Economics and Philosophy
Economics of Education Review
Economics of Governance
Energy Journal
European Journal of Law and Economics
European Journal of Operational Research
History of Political Economy
IEEE Transactions on Engineering Management
Jahrbuch für Wirtschaftswissenschaften
Journal of African Economies
Journal of Applied Social Science Studies (Schmollers Jahrbuch)
Journal of Comparative Economics
Journal of Economic Growth
Journal of Economic Methodology
Journal of Economic Surveys
Journal of Economics and Business
Journal of Evolutionary Economics
Management International Review
Perspektiven der Wirtschaftspolitik
R&D Management
Research in Economics
Resource and Energy Economics
Review of Economic Dynamics
Review of Industrial Organization
*
Urban Studies
World Development
World Economy
Zeitschrift für Betriebswirtschaft
Zeitschrift für Wirtschafts- und Sozialwissenschaften
Academy of Management Review
Annales de Economie et de Statistique
Banca Nazionale del Lavoro Quarterly Review
British Journal of Industrial Relations
Central European Journal of Operations Research
Computational Economics
Constitutional Political Economy
Econometric Reviews
Econometrics Journal
Economics of Innovation and New Technology
Energy Economics
European Environment
* Invited Journals
♦ Diamond List
All others are contributed journals
4
4
4
4
4
4
4
4
4
4
4
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
2
2
2
2
2
2
2
2
2
2
2
2
Table 1: Frequency of Journal Nomination (Usable Responses to Question 1)
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
59
59
59
59
59
59
59
59
59
59
59
59
59
59
59
59
59
59
59
59
59
59
59
59
59
59
59
59
59
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
European Journal of Finance
European Journal of The History of Economic Thought
European Union Politics
Fiscal Studies
Ifo-Studien
International Advances in Economic Research
International Game Theory Review
International Journal of Technology Management
Jahrbuch für Regionalwissenschaft
Journal of Business Research
Journal of Cultural Economics
Journal of Economic Studies
Journal of European Integration
Journal of Financial and Quantitative Analysis
Journal of Legal Studies
Journal of Regulatory Economics
Journal of World Business
Louvain Economic Review
Macroeconomic Dynamics
Managerial and Decision Economics
Manchester School
Mathematics of Operations Research
Organization Studies
Papers in Regional Science
Quarterly Review of Economics and Finance
Review of Development Economics
Review of Political Economy
Revue Economique
Rivista Internazionale di Scienze Economiche e Commerciali
Administrative Science Quarterly
Advances in Human Resource Development
Agricultural Economics
Allgemeines Statistisches Archiv
American Journal of Agricultural Economics
American Journal of Economics and Sociology
American Journal of Evaluation
American Law and Economics Review
American Review of Law and Economics
Applied Econometrics
Applied Economic Letters
Applied Financial Economics
Berkeley Electronic Journals of Theoretical Economics
Business History
Carnegie-Rochester Conference Series on Public Policy
Climate Policy
Cognitive Science
Contemporary Economic Policy
Die Betriebswirtschaft
Economia
Economia Internazionale
Economia Politica
Economics Bulletin
Economics of Transition
Energy and Environment
Energy Policy
Environment and Development Economics
* Invited Journals
♦ Diamond List
All others are contributed journals
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
Table 1: Frequency of Journal Nomination (Usable Responses to Question 1)
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
Environment and Planning
Environmental Management
European Accounting Review
European Journal of Housing Policy
European Journal of Industrial Relations
European Review of Agricultural Econoimics
Experimental Economics
Financial Analysts Journal
Financial Management
Finnish Economic Papers
Giornale Degli Economisti
Global Environmental Change
History of Economic Ideas
Homo Oeconomicus
Human Resource Development International
Human Resource Development Quarterly
Human Resource Development Review
IBR (International Business Review?)
Industrial and Corporate Change
Industrial Labor Relations Review
Industrial Relations
Información Comercial Española
Inquiry
Intereconomics
International Environmental Agreements
International Journal for Sustainable Development
International Journal of Finance and Economics
International Journal of Forecasting
International Journal of Human Resources Management
International Journal of Manpower
International Journal of Production Economics
International Journal of Social Economics
International Organization
International Review of Applied Economics
International Review of Econmics and Finance
International Review of Economics and Business
Jahrbuch für Wirtschaftsgeschichte
Jahrbücher für Wirtschaftswissenschaften
Japan and The World Economy
Journal of Productivity Analysis
Journal of Accounting and Economics
Journal of African Finance and Economic Development
Journal of Agricultural and Applied Economics
Journal of Agricultural Economics
Journal of Applied Corporate Finance
Journal of Behavioral Decision Making
Journal of Business and Behavioral Sciences
Journal of Business Venturing
Journal of Climate Change
Journal of Computational Economics
Journal of Conflict Resolution
Journal of Economic Education
Journal of Economic History
Journal of Economic Issues
Journal of Economics and Finance
Journal of Engineering and Technology Management
* Invited Journals
♦ Diamond List
All others are contributed journals
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
Table 1: Frequency of Journal Nomination (Usable Responses to Question 1)
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
Journal of Environmental and Resource Economics
Journal of Environmental Policy and Planning
Journal of Financial Intermediatio
Journal of Financial Markets
Journal of Forecasting
Journal of Futures Markets
Journal of Global Business
Journal of Housing Economics
Journal of Industry, Competition and Trade
Journal of Interdisciplinary History
Journal of Internation Development
Journal of International Development
Journal of International Marketing
Journal of Leadership Studies
Journal of Management
Journal of Management Studies
Journal of Marketing Management
Journal of Marketing Research
Journal of Media Economics
Journal of Official Statistics
Journal of Operations Management
Journal of Organizational Behavior
Journal of Risk Research
Journal of Small Business Management
Journal of The Academy of Marketing Science
Journal of The Japanese and International Economies
Journal of The Market Research Society
Journal of Theoretical Politics
Journal of Time Series Analysis
Journal of Transport Economics and Policy
Journal of World Trade
Lateinamerika Archiv
Long Range Planning
Management International Review
Marine Policy
Marine Resource Economics
Marketing Science
Mathematical Finance
Mathematiques, Informatiques et Sciences Humaines
Mitigation and Adaptation Strategies for Global Change
Mitteilungen aus der Arbeitsmarkt- und Berufsforschung MittA
Multinational Business Review
National Institute Economic Review
Netnomics
Norwegian Journal of Economics
Optimal Control Applications and Methods
OR Spektrum
Organization Science
Oxford Review of Economic Policy
Population and Development Review
Quarterly Journal of International Agriculture
Review of International Political Economy
Review of Regional Studies
Review of Social Economy
Riecerche Economice
Risk Management and Insurance Review
* Invited Journals
♦ Diamond List
All others are contributed journals
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
Table 1: Frequency of Journal Nomination (Usable Responses to Question 1)
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
60
Sankhya: The Indian Journal of Statistics
Scandinavian Journal of Management
Simulation & Gaming
Singapore International Insurance and Actuarial Journal
Small Business Economics
Social Science Quarterly
Socio-economic Planning Sciences
South African Journal of Economics
Statistics and Probability Letters
Structural Change and Economics Dynamics
Swiss Journal of Economics and Statistics
System Dynamics Review
Technological Forecasting and Social Change
The American Economist
Transport Policy
Turkish Studies
Wirtschaftsinformatik
World Bank Reserch Observer
Zagreb Journal of Economics
Zeitschrift für Angewandte Umweltforschung
Zeitschrift für Nationalökonomie und Statistik
Zeitschrift für Planung
Zeitschrift für Unternehmensgeschichte
Zeitschrift für Wirtschaftswissenschaften
* Invited Journals
♦ Diamond List
All others are contributed journals
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
Table 2: Residence Countries of Participants Having Responded to Question 1
No.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
Country of
Residence
Participants
Argentina
1
Australia
3
Austria
31
Belgium
19
Brazil
3
Canada
10
Croatia
1
Czech Republic
1
Denmark
16
Finland
3
France
28
Germany
167
Greece
1
Hong Kong, China
1
Iceland
1
Ireland
2
Israel
9
Italy
33
Japan
3
Korea
1
Madagascar
1
Netherlands
21
New Zealand
1
Nigeria
1
Norway
13
Poland
2
Portugal
9
Romania
2
Spain
38
Sweden
16
Switzerland
27
Tunisia
1
Turkey
5
United Kingdom
44
USA
113
no identification
2
Sum
630
Table 3: Responses to Question 1 (in weeks)
"After Submission of your paper, how long did it take on average to get a reply other than just a confirmation that your paper had been received?"
No. Rank
*
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
*
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
17
18
18
19
20
21
22
23
24
25
26
27
28
29
29
30
*
*
*
♦ Journal
♦ Quarterly Journal of Economics
♦
*
*
*
♦
*
*
*
*
♦
*
*
*
*
♦
*
*
*
*
Economic Systems
Geneva Papers of Risk and Insurance
Kyklos
Journal of Financial Economics
Economic Systems Research
Zeitschrift für betriebsw. Forschung/ Schm. Bus. Rev.
National Tax Journal
Spanish Economic Review
Journal of Finance
Journal of Law and Economics
Konjunkturpolitik
Health Economics
Finanzarchiv
Journal of Banking and Finance
Journal of Common Market Studies
Journal of Consumer Research
Journal of Economic Literature
Jahrbücher für Nationalökonomie und Statistik
Regional Science and Urban Economics
Journal of Health Economics
Journal of Economics (Zeitschr. f. Nat.ök.)
Weltwirtschaftliches Archiv
Economics Letters
Academy of Management Journal
Annals of Regional Science
Review of Income and Wealth
Australian Economic Papers
Industrial and Labor Relations Review
Journal of Business
Ecological Economics
Journal of Regional Science
Journal of Law, Economics, and Organization
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
n
Mean
Median
Stddev.
137
6
15
64
12
5
7
9
5
32
20
6
6
44
5
17
5
11
8
8
16
82
72
197
7
6
13
11
7
15
5
5
6
0.613
8.667
9.267
10.063
11.000
11.200
11.286
11.333
11.600
12.438
12.550
12.667
13.167
13.245
13.600
13.882
14.000
14.000
14.125
14.125
14.563
14.579
14.708
14.774
14.857
15.333
15.385
15.636
15.714
15.733
16.000
16.000
16.167
0
9
8
8
9
12
8
10
8
12
10
11
8
12
10
12
12
10
13.5
8
10
12
12
12
8
12
12
15
15
15
16
13
17.5
3.699
3.204
7.116
8.317
9.468
8.319
11.884
6.519
8.050
8.044
8.817
7.967
12.007
7.263
10.262
10.167
12.708
10.583
7.511
14.808
13.919
11.582
13.733
10.700
15.657
12.061
10.767
7.514
6.601
12.401
6.164
7.450
8.060
Table 3: Responses to Question 1 (in weeks)
"After Submission of your paper, how long did it take on average to get a reply other than just a confirmation that your paper had been received?"
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
♦
*
*
*
*
*
♦
*
*
*
*
*
♦
*
♦
♦
Public Choice
Scottish Journal of Political Economy
Journal of International Business Studies
Journal of Economic Psychology
Open Economies Review
Journal of Institutional and Theoretical Economics
Metroeconomica
Journal of Urban Economics
Mathematical Social Sciences
Cambridge Journal of Economics
Journal of Risk and Uncertainty
Economic Record
Econometric Theory
Journal of Macroeconomics
Economic Inquiry
Southern Economic Journal
Journal of Money, Credit, and Banking
Journal of Human Resources
Research Policy
Scandinavian Journal of Economics
Management Science
Oxford Bulletin of Economics and Statistics
Journal of Environmental Economics and Management
Canadian Journal of Economics
European Journal of Political Economy
Journal of International Money and Finance
Empirica
Economic Theory
Economic Modelling
Review of Economics and Statistics
Pacific Economic Review
Oxford Economic Papers
Journal of Industrial Economics
International Tax and Public Finance
Economic Journal
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
67
27
5
17
6
59
21
15
36
21
15
8
10
9
30
31
36
35
8
83
37
38
6
43
89
7
5
62
7
84
7
63
58
9
134
16.194
16.333
16.400
16.471
16.500
16.763
17.143
17.467
17.556
17.667
17.867
17.875
18.100
18.333
18.567
18.645
18.667
19.286
19.750
19.981
20.027
20.105
20.333
20.581
20.652
21.143
21.200
21.224
21.286
21.357
21.429
21.476
21.500
21.556
21.583
12
15
12
12
18.5
16
16
12
16
10
16
14
17.5
15
15.5
15
17
15
20
17
15
22
20
20
18
25
14
16
16
20
15
20
19
10
20
14.329
11.486
13.740
14.608
9.566
10.202
12.146
14.476
11.180
16.575
13.580
16.643
9.574
9.028
13.374
14.527
11.878
14.064
9.362
12.407
17.139
11.079
2.658
11.885
17.245
10.653
17.697
19.646
24.743
13.987
20.558
14.001
16.102
22.661
13.544
Table 3: Responses to Question 1 (in weeks)
"After Submission of your paper, how long did it take on average to get a reply other than just a confirmation that your paper had been received?"
69
66
*
70
67
*
71
72
73
74
75
76
77
78
68
69
70
71
72
73
74
75
*
*
*
*
79
80
81
82
83
84
85
76
77
78
79
80
81
82
*
86
83
*
87
88
89
90
91
84
85
86
87
88
*
*
*
*
*
♦ American Economic Review
♦ Journal of Public Economics
♦ Econometrica
♦
*
*
*
*
193
21.637
20
15.832
126
21.664
20
11.914
Journal of Economic Dynamics and Control
Journal of Population Economics
Regional Studies
Journal of Business and Economic Statistics
Journal of Economics and Management Strategy
Journal of Public Economic Theory
Economica
113
41
29
11
10
8
35
68
22.044
22.073
22.103
22.273
22.400
23.000
23.143
23.207
20
16
20
20
27
21
20
20
14.567
18.253
12.896
13.335
13.426
12.604
12.367
14.208
Empirical Economics
Theory and Decision
International Journal of Industrial Organization
Journal of Applied Econometrics
Social Choice and Welfare
International Review of Law and Economics
Journal of Econometrics
50
32
18
6
35
5
27
23.220
23.250
23.444
23.500
23.714
24.400
24.444
20
18
20
18.5
20
16
20
17.817
19.429
14.288
16.873
16.502
17.111
16.787
72
24.492
22
16.138
216
79
67
8
38
25.080
25.114
25.136
25.375
25.789
24
20
24
26
20
16.658
19.295
13.202
13.212
17.664
110
76
103
5
93
7
102
5
30
13
25.855
26.224
26.768
27.600
27.784
28.286
28.328
29.000
29.067
29.923
23.5
25.5
20
24
25
18
25
25
22
29
17.001
16.231
21.279
15.126
15.199
22.699
17.720
13.304
29.700
14.251
♦
♦ Rand Journal of Economics
♦ European Economic Review
♦
Journal of Economic Behavior and Organization
Journal of International Economics
Labour Economics
Journal of Labor Economics
♦
♦ Journal of Economic Theory
92
89
*
93
90
*
Games and Economic Behavior
94
91
*
♦ Journal of Political Economy
95
92
Investigaciones Economicas
96
93
*
♦ International Economic Review
97
94
German Economic Review
98
95
*
♦ Review of Economic Studies
99
96
Environmental and Resource Economics
100 97
*
♦ Journal of Mathematical Economics
101 98
Review of International Economics
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Table 3: Responses to Question 1 (in weeks)
"After Submission of your paper, how long did it take on average to get a reply other than just a confirmation that your paper had been received?"
102
103
104
105
106
107
108
109
110
99
100
101
102
103
104
105
106
107
*
*
*
*
*
*
Public Finance Quarterly
♦ Journal of Development Economics
International Journal of Game Theory
♦ Journal of Monetary Economics
Applied Economics
Journal of Applied Economics
Labour: Review of Labour Economics and Industrial Relations
Journal of Policy Modelling
Public Finance
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
10
52
33
40
10
31
5
5
16
31.700
32.473
33.758
36.650
38.200
38.484
56.800
59.200
61.500
22.5
25.5
25
25.5
24
40
10
48
40.5
25.206
24.289
30.346
30.806
27.316
28.350
64.084
40.536
71.018
Table 4: Responses to Question 2
"How many referee reports did you receive on average?"
No. Rank
1
1
2
2
3
3
4
4
5
5
6
6
7
7
8
8
9
9
10
9
11
10
12
10
13
10
14
11
15
12
16
13
17
14
18
15
19
16
20
17
21
18
22
18
23
18
24
18
25
19
26
20
27
20
28
21
*
♦ Journal
*
*
*
*
*
*
*
*
*
*
*
*
*
♦
♦
Journal of Regional Science
Academy of Management Journal
Journal of International Business Studies
Industrial and Labor Relations Review
Ecological Economics
Research Policy
Management Science
Journal of Environmental Economics and Management
Environmental and Resource Economics
Journal of Consumer Research
Economic Systems
Health Economics
Konjunkturpolitik
Journal of Health Economics
Journal of Urban Economics
Econometrica(***)
International Tax and Public Finance
Cambridge Journal of Economics
Journal of Economic Dynamics and Control
Economic Inquiry
Economic Record
Geneva Papers of Risk and Insurance
Investigaciones Economicas
Spanish Economic Review
Scandinavian Journal of Economics
International Journal of Industrial Organization
Journal of Econometrics
♦
♦ Journal of Economic Literature
♦ Journal of International Economics
29
21
*
30
22
Journal of Business and Economic Statistics
31
22
*
Public Finance Quarterly
32
23
*
♦ Economic Journal
33
24
*
Journal of Population Economics
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
n
5
7
5
7
5
8
36
6
5
5
6
6
6
13
14
111
9
21
38
28
7
13
5
5
78
18
27
Mean
3.000
2.857
2.800
2.429
2.400
2.375
2.361
2.333
2.200
2.200
2.167
2.167
2.167
2.154
2.143
2.120
2.111
2.095
2.079
2.036
2.000
2.000
2.000
2.000
1.949
1.944
1.944
Median
3
3
3
2
2
2
2
2
2
3
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
Stddev.
0.000
0.378
0.447
0.535
0.548
0.518
0.875
0.516
0.837
1.304
0.753
0.408
0.408
0.966
0.535
0.799
1.054
0.875
0.882
0.429
0.816
0.913
0.000
0.000
0.507
0.416
0.738
11
1.909
2
1.578
66
10
10
128
28
1.909
1.900
1.900
1.898
1.893
2
2
2
2
2
0.481
1.101
0.316
0.780
0.629
Table 4: Responses to Question 2
"How many referee reports did you receive on average?"
34
35
25
26
*
*
36
27
*
37
28
*
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
29
30
31
31
32
33
34
35
36
37
38
39
40
40
40
41
42
*
*
55
56
57
58
43
43
43
44
*
59
60
61
62
63
64
65
66
45
46
47
48
49
50
51
51
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
♦
♦
♦
♦
♦
♦
European Journal of Political Economy
International Economic Review
85
89
1.888
1.885
2
2
0.599
0.882
Journal of Public Economics
125
1.884
2
0.536
European Economic Review
206
1.884
2
0.613
Review of Economic Studies
Journal of Economics (Zeitschr. f. Nat.ök.)
Journal of Economics and Management Strategy
Labour Economics
Journal of Industrial Economics
American Economic Review
Social Choice and Welfare
Journal of Development Economics
Journal of Economic Psychology
Journal of Institutional and Theoretical Economics
Journal of Public Economic Theory
Empirical Economics
Economic Systems Research
International Review of Law and Economics
Journal of Banking and Finance
Econometric Theory
Economica
98
79
8
8
54
188
34
50
16
53
31
49
5
5
5
9
63
1.881
1.880
1.875
1.875
1.861
1.853
1.824
1.820
1.813
1.811
1.806
1.802
1.800
1.800
1.800
1.778
1.754
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
0.663
0.642
0.354
0.641
0.586
0.750
0.706
0.560
0.544
0.709
0.477
0.532
0.447
1.095
0.837
0.441
0.602
Regional Science and Urban Economics
Regional Studies
Canadian Journal of Economics
60
8
10
39
1.750
1.750
1.750
1.744
2
2
2
2
0.661
0.886
0.717
0.549
Journal of International Money and Finance
Games and Economic Behavior
Journal of Economic Theory
Journal of Money, Credit, and Banking
Mathematical Social Sciences
Journal of Macroeconomics
National Tax Journal
79
7
73
107
34
35
9
9
1.728
1.714
1.705
1.704
1.691
1.686
1.667
1.667
2
2
2
2
2
2
2
2
0.702
0.488
0.564
0.718
0.603
0.728
0.500
0.707
♦
♦ Oxford Economic Papers
♦
♦ Review of Economics and Statistics
♦
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Table 4: Responses to Question 2
"How many referee reports did you receive on average?"
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
51
52
53
54
55
56
57
58
59
60
60
61
62
63
63
64
65
65
65
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
*
*
*
*
*
*
*
♦ Rand Journal of Economics
*
*
*
*
*
♦
♦
♦
*
*
*
*
*
*
*
*
*
*
*
♦
♦
*
*
*
♦
Journal of Human Resources
Metroeconomica
Journal of Law and Economics
Journal of Risk and Uncertainty
International Journal of Game Theory
Finanzarchiv
Jahrbücher für Nationalökonomie und Statistik
Journal of Labor Economics
Annals of Regional Science
Journal of Economic Behavior and Organization
Journal of Mathematical Economics
Review of Income and Wealth
German Economic Review
Journal of Business
Southern Economic Journal
Journal of Applied Econometrics
Journal of Law, Economics, and Organization
Open Economies Review
Pacific Economic Review
Journal of Applied Economics
Scottish Journal of Political Economy
Journal of Monetary Economics
Public Choice
Journal of Political Economy
Economic Theory(***)
Theory and Decision(***)
Journal of Finance
Empirica
Journal of Common Market Studies
Australian Economic Papers
Review of International Economics
Zeitschrift für betriebsw. Forschung/ Schm. Bus. Rev.
Quarterly Journal of Economics
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
69
32
20
17
14
33
42
8
35
5
75
28
12
7
14
27
6
6
6
6
27
25
39
66
97
58
29
31
5
16
11
13
7
129
1.667
1.656
1.650
1.647
1.643
1.636
1.626
1.625
1.614
1.600
1.600
1.589
1.583
1.571
1.571
1.556
1.500
1.500
1.500
1.500
1.481
1.480
1.462
1.424
1.423
1.419
1.414
1.403
1.400
1.375
1.364
1.308
1.286
1.252
2
2
2
2
2
2
2
1.5
2
2
2
2
1.5
2
1.5
2
1.5
2
1.5
1.5
2
2
1
1
1
1
1
1
1
1
1
1
1
1
0.700
0.865
0.813
0.786
0.633
0.641
0.489
0.744
0.595
0.548
0.731
0.828
0.669
0.535
1.016
0.641
1.049
0.837
0.548
0.548
0.802
0.653
0.720
0.609
0.592
0.622
0.733
0.554
0.548
0.806
0.505
0.480
0.756
0.820
Table 4: Responses to Question 2
"How many referee reports did you receive on average?"
101
102
103
104
105
106
107
108
109
110
80
81
82
82
83
84
85
86
87
88
*
*
*
*
*
*
Weltwirtschaftliches Archiv
♦ Journal of Financial Economics
♦
Applied Economics
Journal of Policy Modelling
Oxford Bulletin of Economics and Statistics
Public Finance
Kyklos
Economics Letters
Labour: Review of Labour Economics and Industrial Relations
Economic Modelling
(***) Modification to compute average correctly
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
66
11
10
5
36
16
61
187
5
7
1.250
1.227
1.200
1.200
1.194
1.156
1.107
0.860
0.800
0.714
1
1
1
1
1
1
1
1
1
1
0.556
0.518
0.422
1.304
0.856
0.625
0.759
0.550
0.447
0.488
Table 5: Responses to Question 3
"How many papers did you submit to this journal and how many papers were accepted?"
Individual Acceptance Rates
Empirica
Konjunkturpolitik
Economic Systems Research
Health Economics
Metroeconomica
Journal of Policy Modelling
Zeitschrift für betriebsw. Forschung/ Schm. Bus. Rev.
Applied Economics
Journal of Mathematical Economics
Economic Modelling
Pacific Economic Review
Research Policy
Australian Economic Papers
Journal of Banking and Finance
Jahrbücher für Nationalökonomie und Statistik
German Economic Review
Open Economies Review
Public Finance Quarterly
n
5
6
5
6
19
5
5
10
26
7
6
7
10
5
8
7
6
10
Total of
Papers
submitted
13
7
13
8
30
7
6
17
52
8
6
18
15
5
14
10
8
12
Total of
Papers
accepted
13
7
12
7
28
6
5
15
48
7
5
15
12
4
11
6
6
9
Journal of Population Economics
Review of International Economics
Finanzarchiv
24
13
41
36
16
77
34
7
5
5
44
8
25
11
♦ Journal
No.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
Rank
1
1
2
3
4
5
5
6
7
8
9
9
10
10
11
12
13
13
*
19
20
21
14
15
16
*
22
23
24
25
26
27
28
17
18
19
19
20
21
22
*
*
Social Choice and Welfare
Journal of International Money and Finance
Economic Systems
Investigaciones Economicas
Empirical Economics
International Tax and Public Finance
Journal of Applied Economics
29
23
*
Geneva Papers of Risk and Insurance
*
*
*
*
*
*
*
♦
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Mean
Median
Stddev.
1.000
1.000
0.960
0.944
0.930
0.900
0.900
0.867
0.865
0.857
0.833
0.833
0.800
0.800
0.788
0.786
0.750
0.750
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
0.000
0.000
0.089
0.136
0.238
0.224
0.224
0.322
0.333
0.378
0.408
0.373
0.422
0.447
0.364
0.393
0.418
0.425
25
12
58
0.743
0.731
0.729
1.000
1.000
1.000
0.399
0.439
0.381
67
10
10
10
62
9
36
53
8
8
6
46
6
27
0.721
0.714
0.700
0.700
0.693
0.688
0.687
1.000
1.000
1.000
0.500
1.000
1.000
1.000
0.408
0.488
0.447
0.274
0.443
0.458
0.452
13
8
0.682
1.000
0.462
Table 5: Responses to Question 3
"How many papers did you submit to this journal and how many papers were accepted?"
30
24
*
31
25
*
32
26
33
34
35
36
37
♦ Economic Inquiry
23
38
25
0.681
1.000
0.389
Theory and Decision
26
39
26
0.673
1.000
0.426
*
Journal of Economic Psychology
14
20
13
0.667
1.000
0.453
27
*
Journal of Economics (Zeitschr. f. Nat.ök.)
75
129
84
0.658
1.000
0.431
28
*
Journal of Institutional and Theoretical Economics
52
81
57
0.656
1.000
0.444
29
30
31
*
Industrial and Labor Relations Review
Journal of Macroeconomics
Journal of Econometrics
7
9
24
9
13
63
5
8
47
0.643
0.639
0.636
1.000
1.000
0.850
0.476
0.486
0.440
38
32
*
Review of Income and Wealth
12
16
11
0.625
1.000
0.483
39
33
*
Mathematical Social Sciences
33
59
39
0.623
1.000
0.452
40
34
*
Econometric Theory
9
14
10
0.611
1.000
0.486
41
35
*
European Journal of Political Economy
82
107
65
0.608
1.000
0.467
42
43
44
36
37
38
*
*
Journal of Urban Economics
Spanish Economic Review
Public Finance
13
5
15
21
7
22
15
5
13
0.603
0.600
0.589
1.000
1.000
1.000
0.498
0.548
0.475
45
38
*
Regional Studies
9
15
9
0.589
0.800
0.470
46
39
*
Journal of Economic Dynamics and Control
37
48
30
0.581
1.000
0.464
47
48
49
50
51
40
41
42
43
44
*
*
Journal of Economic Behavior and Organization
Journal of International Business Studies
Journal of Risk and Uncertainty
Journal of Business and Economic Statistics
Economic Theory
73
5
13
9
56
114
17
30
11
87
66
9
16
6
50
0.561
0.558
0.558
0.556
0.542
0.750
0.500
0.667
1.000
0.500
0.470
0.276
0.463
0.527
0.449
52
45
*
Public Choice
61
100
57
0.537
0.571
0.462
53
46
*
Economic Record
7
20
8
0.518
0.625
0.502
54
55
56
57
58
47
48
48
48
48
*
Weltwirtschaftliches Archiv
International Review of Law and Economics
Journal of Economics and Management Strategy
Journal of Law, Economics, and Organization
National Tax Journal
62
5
7
6
9
110
12
9
9
11
61
8
4
4
6
0.513
0.500
0.500
0.500
0.500
0.500
0.500
0.500
0.500
0.500
0.455
0.500
0.500
0.447
0.500
59
49
*
174
331
184
0.498
0.500
0.441
31
35
17
0.484
0.500
0.491
*
*
♦
♦ Economics Letters
60
50 *
Journal of Public Economic Theory
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Table 5: Responses to Question 3
"How many papers did you submit to this journal and how many papers were accepted?"
61
51
*
62
52
*
63
53
*
64
54
*
65
55
*
66
67
68
69
70
56
57
58
59
60
*
71
Cambridge Journal of Economics
20
38
19
0.473
0.350
0.481
16
25
14
0.469
0.250
0.499
22
30
14
0.466
0.125
0.502
38
54
27
0.447
0.250
0.476
9
14
4
0.444
0.000
0.527
*
Management Science
Ecological Economics
Games and Economic Behavior
Regional Science and Urban Economics
Scandinavian Journal of Economics
34
5
70
7
76
64
10
133
8
102
29
5
69
4
42
0.440
0.433
0.429
0.429
0.428
0.313
0.500
0.333
0.000
0.167
0.463
0.435
0.430
0.535
0.461
61
*
International Journal of Game Theory
31
66
32
0.426
0.444
0.436
72
62
*
Southern Economic Journal
23
43
14
0.424
0.000
0.485
73
63
*
56
74
64
*
75
76
77
78
79
80
81
65
65
66
67
68
68
69
*
82
70
83
♦ Journal of Law and Economics
Scottish Journal of Political Economy
♦ Canadian Journal of Economics
♦ Journal of Economic Literature
*
♦ Economica
81
34
0.421
0.000
0.465
Journal of Human Resources
Annals of Regional Science
Labour: Review of Labour Economics and Industrial Relations
International Journal of Industrial Organization
Journal of Development Economics
Academy of Management Journal
Labour Economics
Review of Economics and Statistics
30
37
15
0.417
0.000
0.493
5
5
17
45
6
8
75
7
5
40
74
17
10
118
3
2
17
27
7
4
50
0.400
0.400
0.387
0.383
0.375
0.375
0.362
0.500
0.000
0.500
0.000
0.125
0.250
0.000
0.418
0.548
0.354
0.439
0.494
0.443
0.437
*
Kyklos
57
80
33
0.355
0.000
0.458
71
*
Journal of Business
14
19
8
0.345
0.000
0.455
84
72
*
Journal of Money, Credit, and Banking
32
46
19
0.341
0.000
0.459
85
73
*
Oxford Bulletin of Economics and Statistics
33
43
17
0.338
0.000
0.448
86
74
*
Journal of Public Economics
118
234
93
0.338
0.000
0.404
87
75
*
International Economic Review
83
125
47
0.321
0.000
0.440
88
76
*
Journal of Economic Theory
103
273
121
0.315
0.000
0.369
89
77
*
European Economic Review
193
326
116
0.314
0.000
0.409
90
78
*
Oxford Economic Papers
53
77
24
0.313
0.000
0.431
*
♦
*
♦
♦
♦
♦
♦
♦
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Table 5: Responses to Question 3
"How many papers did you submit to this journal and how many papers were accepted?"
91
79
*
♦ Journal of Financial Economics
11
17
5
0.303
0.000
0.400
92
80
*
Journal of Industrial Economics
48
77
25
0.295
0.000
0.389
93
81
*
34
44
13
0.285
0.000
0.409
94
82
♦ Journal of Monetary Economics
* ♦ Economic Journal
118
197
65
0.269
0.000
0.412
95
83
*
15
15
4
0.267
0.000
0.458
96
84
*
59
94
29
0.255
0.000
0.381
97
98
99
85
86
87
108
8
137
26
2
39
0.228
0.222
0.221
0.000
0.000
0.000
0.383
0.404
0.379
100
88
♦
* ♦ Econometrica
65
6
87
103
231
64
0.202
0.000
0.313
101
89
*
Journal of Health Economics
12
20
5
0.194
0.000
0.324
102
90
*
32
45
10
0.190
0.000
0.351
103
91
176
333
65
0.168
0.000
0.327
104
105
106
92
93
93
♦ Journal of Labor Economics
* ♦ American Economic Review
* ♦ Journal of Political Economy
89
5
30
145
7
36
28
1
3
0.149
0.100
0.100
0.000
0.000
0.000
0.326
0.224
0.305
107
94
117
196
19
0.071
0.000
0.211
Journal of Common Market Studies
♦ Journal of International Economics
* ♦ Rand Journal of Economics
*
*
*
Journal of Applied Econometrics
Review of Economic Studies
Journal of Environmental Economics and Management
Journal of Finance
♦ Quarterly Journal of Economics
Dropped-out Journals:
Journal of Consumer Research
Environmental and Resource Economics
Journal of Regional Science
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
n=4
n=4
n=4
Table 6: Responses to Question 4
"Were the referee reports competent?"
No.
1
2
3
4
5
6
7
8
9
Rank * ♦ Journal
1
Journal of International Business Studies
2
Journal of Economics and Management Strategy
3
Health Economics
4
Academy of Management Journal
4
Journal of Business and Economic Statistics
5
International Tax and Public Finance
6
Economic Systems Research
6
Empirica
7
*
Econometric Theory
♦ Journal of Economic Literature
n
5
7
6
6
9
8
5
5
9
Mean
5.000
4.857
4.833
4.667
4.667
4.625
4.600
4.600
4.556
Median
5
5
5
5.5
5
5
5
5
5
Stddev.
0.000
0.900
1.169
1.966
1.118
1.768
0.894
0.894
1.878
7
4.429
5
1.902
10
8
*
11
9
*
Mathematical Social Sciences
31
4.387
5
1.498
12
10
*
Social Choice and Welfare
33
4.364
5
1.319
13
11
*
23
4.304
5
1.550
14
12
♦ Economic Inquiry
* ♦ Econometrica
98
4.296
5
1.906
15
13
*
17
4.294
4
1.047
16
14
*
24
4.292
5
1.429
17
15
♦ Journal of Econometrics
* ♦ Journal of Mathematical Economics
23
4.261
4
1.356
18
19
20
21
22
23
24
25
26
27
28
16
16
17
17
18
19
20
21
22
22
22
Economic Systems
Investigaciones Economicas
Industrial and Labor Relations Review
Journal of International Money and Finance
*
Journal of Public Economic Theory
*
Journal of Risk and Uncertainty
* ♦ Review of Economic Studies
*
Games and Economic Behavior
*
Australian Economic Papers
Ecological Economics
Journal of Banking and Finance
5
5
7
7
30
11
84
70
10
5
5
4.200
4.200
4.143
4.143
4.133
4.091
4.083
4.057
4.000
4.000
4.000
5
4
4
4
4
5
4
4.5
4
4
5
1.924
1.483
1.345
1.345
1.137
1.700
1.416
1.693
1.054
1.581
1.414
29
22
*
15
4.000
5
1.732
30
22
7
4.000
4
1.528
Metroeconomica
♦ Journal of Law and Economics
Regional Science and Urban Economics
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Likert-Scale: 0 = very incompetent, 6 = very competent
Table 6: Responses to Question 4
"Were the referee reports competent?"
31
22
Research Policy
7
4.000
5
2.236
32
23
*
Economic Theory
55
3.982
4
1.521
33
24
*
Journal of Economic Dynamics and Control
35
3.943
4
1.589
34
35
36
37
38
39
25
26
27
28
29
30
*
Journal of Urban Economics
Jahrbücher für Nationalökonomie und Statistik
* ♦ American Economic Review
Journal of Applied Econometrics
*
Finanzarchiv
*
Journal of Institutional and Theoretical Economics
13
8
171
6
38
50
3.923
3.875
3.860
3.833
3.816
3.780
4
4
4
4
4
4
1.038
1.458
1.709
1.722
1.430
1.389
40
41
42
31
31
31
*
*
Geneva Papers of Risk and Insurance
Journal of Macroeconomics
Review of Economics and Statistics
9
9
72
3.778
3.778
3.778
4
4
4
1.202
1.202
1.558
43
32
*
Journal of Economics (Zeitschr. f. Nat.ök.)
71
3.775
4
1.466
44
33
*
30
3.767
4
1.382
45
34
99
3.758
4
1.768
46
35
Labour Economics
8
3.750
4.5
2.252
International Journal of Game Theory
30
3.733
4
1.701
58
3.690
4
1.667
♦
Weltwirtschaftliches Archiv
Journal of Human Resources
International Economic Review
58
25
76
3.690
3.680
3.671
4
4
4
1.501
1.600
1.636
♦
Journal of Industrial Economics
Journal of Population Economics
Journal of Public Economics
47
23
117
3.660
3.652
3.641
4
4
4
1.403
1.526
1.573
♦
♦ Journal of Labor Economics
* ♦ Journal of Economic Theory
47
36
*
48
37
*
49
50
51
37
38
39
*
*
*
52
53
54
40
41
42
*
*
*
55
43
*
Management Science
33
3.636
4
1.729
56
44
*
Empirical Economics
43
3.605
4
1.620
57
45
International Review of Law and Economics
5
3.600
4
2.074
58
46
*
Review of Income and Wealth
12
3.583
4
1.621
59
47
*
European Journal of Political Economy
80
3.563
4
1.621
60
48
*
Regional Studies
9
3.556
4
1.740
129
3.550
4
1.807
♦ Rand Journal of Economics
61
49 * ♦ Economics Letters
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Likert-Scale: 0 = very incompetent, 6 = very competent
Table 6: Responses to Question 4
"Were the referee reports competent?"
62
50
*
63
51
*
64
52
*
65
53
*
66
67
68
69
70
54
55
56
56
57
*
*
71
58
72
59
*
73
60
*
74
75
76
61
61
61
*
77
78
79
80
81
62
63
64
65
66
82
♦ Canadian Journal of Economics
37
3.514
3
1.426
Journal of Economic Psychology
14
3.500
4
1.454
♦ Journal of International Economics
59
3.475
4
1.546
National Tax Journal
9
3.444
3
2.007
Kyklos
Theory and Decision
German Economic Review
Journal of Applied Economics
Quarterly Journal of Economics
43
25
7
21
91
3.442
3.440
3.429
3.429
3.418
3
4
4
3
4
1.548
1.583
1.718
1.690
1.904
Spanish Economic Review
5
3.400
4
2.074
113
3.398
4
1.714
Journal of Economic Behavior and Organization
69
3.391
4
1.638
Journal of Health Economics
Journal of Law, Economics, and Organization
Open Economies Review
12
6
6
3.333
3.333
3.333
4
3.5
3.5
1.875
1.862
2.160
Review of International Economics
* ♦ Journal of Monetary Economics
*
Public Choice
* ♦ European Economic Review
*
Journal of Finance
13
34
58
186
29
3.308
3.294
3.276
3.263
3.241
3
3.5
3
3
3
1.109
1.915
1.684
1.556
1.704
67
*
Scottish Journal of Political Economy
22
3.227
3.5
1.798
83
68
*
Oxford Bulletin of Economics and Statistics
23
3.217
3
1.757
84
69
*
Scandinavian Journal of Economics
73
3.205
3
1.683
85
86
87
88
89
90
70
71
72
73
74
75
*
*
*
Journal of Environmental Economics and Management
International Journal of Industrial Organization
Konjunkturpolitik
Journal of Development Economics
Journal of Common Market Studies
Economica
5
17
6
43
13
56
3.200
3.176
3.167
3.163
3.154
3.107
4
4
4
4
3
3.5
2.168
1.811
2.229
1.731
1.864
1.755
91
76
50
3.060
3
1.823
20
3.050
3
1.572
*
*
♦
♦ Economic Journal
♦
♦
* ♦ Oxford Economic Papers
92
77 *
Cambridge Journal of Economics
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Likert-Scale: 0 = very incompetent, 6 = very competent
Table 6: Responses to Question 4
"Were the referee reports competent?"
93
78
*
Pacific Economic Review
6
3.000
3
0.894
94
95
96
78
79
80
*
*
*
Southern Economic Journal
Journal of Money, Credit, and Banking
Journal of Political Economy
22
31
88
3.000
2.968
2.886
2.5
3
3
1.952
1.703
1.908
97
98
99
100
101
102
103
81
82
83
84
85
86
86
*
Public Finance Quarterly
*
Journal of Business
* ♦ Journal of Financial Economics
*
Economic Record
*
Public Finance
Applied Economics
Journal of Policy Modelling
10
12
11
7
13
10
5
2.800
2.500
2.455
2.429
2.308
2.200
2.200
3
3
3
3
2
2.5
2
1.932
1.446
2.018
1.813
2.016
1.619
1.924
104
105
106
86
87
88
5
7
5
2.200
1.857
1.800
3
1
1
1.643
2.545
1.643
♦
Labour: Review of Labour Economics and Industrial Relations
Economic Modelling
Zeitschrift für betriebsw. Forschung/ Schm. Bus. Rev.
Dropped-out Journals:
Journal of Consumer Research
Environmental and Resource Economics
Journal of Regional Science
Annals of Regional Science
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
n=3
n=4
n=4
n=4
Likert-Scale: 0 = very incompetent, 6 = very competent
Table 7: Responses to Question 5
"Did the decision of the editor match the referee report?"
No.
1
2
3
4
5
6
7
Rank * ♦ Journal
1
Empirica
2
Health Economics
3
Journal of Environmental Economics and Management
4
Industrial and Labor Relations Review
5
*
Review of Income and Wealth
6
Spanish Economic Review
7
* ♦ Journal of Mathematical Economics
n
5
6
5
7
12
5
23
Mean
5.800
5.667
5.600
5.571
5.500
5.400
5.391
Median
6
6
6
6
6
5
6
Stddev.
0.447
0.516
0.548
0.787
0.798
0.548
1.305
8
8
*
Metroeconomica
16
5.375
6
0.806
9
9
*
♦ Economics Letters
125
5.360
6
1.132
10
10
*
Games and Economic Behavior
68
5.353
6
0.974
11
11
*
Econometric Theory
9
5.333
5
0.707
12
12
*
Public Finance Quarterly
10
5.300
5.5
0.949
13
13
*
14
15
16
14
15
16
*
17
18
19
20
♦ Journal of Law and Economics
15
5.267
5
0.799
*
International Journal of Game Theory
Journal of Business and Economic Statistics
Social Choice and Welfare
29
9
32
5.241
5.222
5.219
6
5
5
1.123
0.972
1.184
17
*
Journal of Public Economic Theory
30
5.200
5
0.847
18
18
19
*
Economic Theory
Journal of Law, Economics, and Organization
Kyklos
54
6
42
5.167
5.167
5.143
6
5.5
5.5
1.424
0.983
1.221
*
21
20
*
Journal of Population Economics
23
5.130
5
1.100
22
23
24
21
22
23
*
Journal of Economics (Zeitschr. f. Nat.ök.)
Applied Economics
Journal of Economic Theory
69
10
96
5.116
5.100
5.094
6
5
5
1.378
0.994
1.161
25
24
*
Weltwirtschaftliches Archiv
56
5.054
5.5
1.367
26
25
*
Mathematical Social Sciences
29
5.034
6
1.546
27
26
*
Public Choice
57
5.018
5
1.232
28
27
*
Australian Economic Papers
9
5.000
5
1.000
29
27
*
♦ Canadian Journal of Economics
37
5.000
6
1.333
*
♦
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Likert Scale: 0= totally contrary with referee reports, 6= totally in line with referee reports
Table 7: Responses to Question 5
"Did the decision of the editor match the referee report?"
30
31
32
33
34
27
27
27
27
27
*
German Economic Review
International Tax and Public Finance
Investigaciones Economicas
Journal of Applied Econometrics
Journal of Applied Economics
7
8
5
6
21
5.000
5.000
5.000
5.000
5.000
5
5
5
5.5
5
1.155
1.069
1.225
1.265
1.049
35
27
*
Journal of Money, Credit, and Banking
30
5.000
5
1.232
36
27
*
Journal of Urban Economics
13
5.000
5
1.225
37
28
*
Finanzarchiv
38
4.974
5
1.197
38
29
*
23
4.957
6
1.745
39
30
*
Oxford Bulletin of Economics and Statistics
23
4.957
5
1.186
40
31
*
Journal of Economic Dynamics and Control
34
4.941
6
1.613
41
32
*
33
4.939
5
1.413
42
33
*
Journal of Institutional and Theoretical Economics
49
4.939
5
1.281
43
44
45
34
35
35
*
*
Scottish Journal of Political Economy
Journal of Macroeconomics
Regional Studies
21
9
9
4.905
4.889
4.889
6
5
5
1.640
0.928
0.782
46
36
*
Theory and Decision
47
37
*
48
♦ Economic Inquiry
♦ Journal of Monetary Economics
25
4.880
5
1.641
95
4.874
5
1.362
38
♦ Econometrica
* ♦ International Economic Review
70
4.871
5
1.413
49
39
*
Southern Economic Journal
22
4.864
5
1.356
50
40
*
♦ Journal of Economic Literature
7
4.857
5
1.069
51
41
*
Public Finance
13
4.846
5
1.281
52
42
*
Empirical Economics
42
4.833
5
1.413
53
42
*
Pacific Economic Review
6
4.833
5.5
1.472
54
43
*
Journal of Industrial Economics
46
4.826
5
1.141
55
56
57
44
45
46
*
*
Management Science
Economic Systems Research
European Journal of Political Economy
31
5
77
4.806
4.800
4.727
5
4
5
1.579
1.095
1.544
58
46
*
Journal of Risk and Uncertainty
11
4.727
5
1.272
59
47
*
81
4.716
5
1.575
♦ Review of Economic Studies
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Likert Scale: 0= totally contrary with referee reports, 6= totally in line with referee reports
Table 7: Responses to Question 5
"Did the decision of the editor match the referee report?"
60
61
62
63
64
48
48
48
49
50
*
Economic Record
Journal of Economics and Management Strategy
Research Policy
Review of International Economics
European Economic Review
7
7
7
13
182
4.714
4.714
4.714
4.692
4.676
5
5
5
5
5
1.799
1.113
1.113
1.750
1.398
65
51
♦
* ♦ Journal of Development Economics
42
4.667
5
1.426
66
52
*
Journal of Economic Psychology
14
4.643
5
1.277
67
53
*
Scandinavian Journal of Economics
72
4.639
5
1.513
68
54
*
69
55
*
22
4.636
5
1.399
30
4.633
5
1.650
70
56
*
19
4.632
5
1.892
71
57
*
51
4.627
5
1.483
72
73
74
75
76
58
59
59
59
60
*
67
5
5
5
56
4.612
4.600
4.600
4.600
4.589
5
4
5
6
5
1.604
1.342
1.517
2.608
1.372
77
61
♦
* ♦ Journal of International Economics
57
4.561
5
1.376
78
62
*
79
63
*
Journal of Health Economics
11
4.545
5
1.753
Journal of Finance
28
4.536
5
1.666
80
64
*
Journal of Common Market Studies
12
4.500
5
1.784
81
65
*
American Economic Review
167
4.491
5
1.613
Journal of Political Economy
85
4.471
5
1.715
68
♦
* ♦
* ♦
* ♦
82
66
83
67
84
85
69
*
86
70
*
87
71
*
*
♦ Journal of Econometrics
♦ Journal of Labor Economics
Cambridge Journal of Economics
♦ Economica
Journal of Economic Behavior and Organization
Ecological Economics
Journal of Banking and Finance
Journal of Policy Modelling
Rand Journal of Economics
*
Review of Economics and Statistics
68
4.456
5
1.597
Journal of Public Economics
112
4.446
5
1.524
National Tax Journal
9
4.444
5
2.068
Journal of Business
12
4.417
5.5
2.021
108
4.380
5
1.722
♦ Economic Journal
88
72 *
Geneva Papers of Risk and Insurance
8
4.375
5
89
72
Jahrbücher für Nationalökonomie und Statistik
8
4.375
4
90
73
Academy of Management Journal
6
4.333
4.5
* Invited Journals
♦ Diamond List
Likert Scale: 0= totally contrary with referee reports, 6= totally in line with referee reports
All Others: Contributed Journals
1.923
1.302
1.862
Table 7: Responses to Question 5
"Did the decision of the editor match the referee report?"
91
92
93
94
95
96
97
73
74
75
76
77
77
78
98
99
100
101
102
103
104
105
106
79
80
81
82
83
83
84
85
86
Konjunkturpolitik
6
48
7
11
5
5
25
4.333
4.313
4.286
4.273
4.200
4.200
4.080
4.5
5
4
5
5
6
5
1.366
1.800
1.704
2.102
1.789
2.683
2.197
Labour Economics
International Journal of Industrial Organization
Regional Science and Urban Economics
Journal of International Business Studies
Labour: Review of Labour Economics and Industrial Relations
Open Economies Review
Economic Modelling
Zeitschrift für betriebsw. Forschung/ Schm. Bus. Rev.
89
8
17
7
5
5
6
7
5
4.079
4.000
3.941
3.857
3.800
3.800
3.500
3.429
2.800
5
5
4
5
4
6
4.5
4
2
2.018
2.138
1.919
2.035
1.643
3.033
2.811
2.573
2.588
Dropped-out Journals:
Journal of Consumer Research
Environmental and Resource Economics
Journal of Regional Science
Annals of Regional Science
n=3
n=4
n=4
n=4
*
♦ Oxford Economic Papers
*
♦ Journal of Financial Economics
Journal of International Money and Finance
*
*
Economic Systems
International Review of Law and Economics
Journal of Human Resources
♦ Quarterly Journal of Economics
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Likert Scale: 0= totally contrary with referee reports, 6= totally in line with referee reports
Table 8: Responses to Question 6
"Were the referee reports carefully done?"
* ♦ Journal
Academy of Management Journal
Health Economics
*
Econometric Theory
Journal of Business and Economic Statistics
Journal of Economics and Management Strategy
International Tax and Public Finance
Empirica
*
Regional Studies
Research Policy
Economic Systems Research
Journal of Banking and Finance
* ♦ Journal of Mathematical Economics
n
6
6
9
9
7
8
5
9
7
5
5
22
Mean
5.167
5.000
4.889
4.778
4.714
4.625
4.600
4.444
4.429
4.400
4.400
4.364
Median
5.5
5
5
5
5
5
5
4
5
5
5
5
Stddev.
1.169
0.894
1.364
0.972
0.756
1.302
1.140
1.130
2.070
1.949
1.342
1.529
12
*
Mathematical Social Sciences
29
4.345
5
1.518
13
*
Journal of Public Economic Theory
29
4.310
5
1.285
15
16
17
18
14
15
15
16
*
Social Choice and Welfare
Industrial and Labor Relations Review
Journal of International Money and Finance
Journal of Urban Economics
31
7
7
13
4.290
4.286
4.286
4.231
5
5
4
4
1.575
1.380
1.496
1.481
19
20
21
22
23
24
17
18
18
18
18
19
*
*
Ecological Economics
Economic Systems
Journal of Environmental Economics and Management
Journal of International Business Studies
Journal of Institutional and Theoretical Economics
93
5
5
5
5
49
4.226
4.200
4.200
4.200
4.200
4.163
5
4
4
5
4
5
1.883
1.304
1.483
1.643
1.483
1.463
25
20
*
Finanzarchiv
38
4.158
4
1.386
26
21
*
♦ Journal of Economic Literature
7
4.143
4
2.193
27
22
*
Australian Economic Papers
8
4.125
4
0.991
28
22
*
Geneva Papers of Risk and Insurance
8
4.125
4
1.246
29
22
*
Metroeconomica
16
4.125
5
1.628
30
23
*
22
4.091
5
1.659
No.
1
2
3
4
5
6
7
8
9
10
11
12
Rank
1
2
3
4
5
6
7
8
9
10
10
11
13
14
*
♦ Econometrica
♦ Journal of Econometrics
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Likert-Scale: 0= very sloppy, 6= very careful
Table 8: Responses to Question 6
"Were the referee reports carefully done?"
31
24
*
Weltwirtschaftliches Archiv
56
4.089
4
1.225
32
25
*
Journal of Economics (Zeitschr. f. Nat.ök.)
69
4.087
4
1.411
33
25
*
Journal of Population Economics
23
4.087
5
1.443
34
26
*
Review of Income and Wealth
12
4.083
4
1.782
35
27
*
Journal of Industrial Economics
46
4.043
4
1.382
36
28
*
Economic Theory
52
4.038
5
1.703
37
29
*
79
4.025
4
1.527
38
39
40
41
30
30
30
31
German Economic Review
Journal of Macroeconomics
Journal of Economic Dynamics and Control
23
7
9
34
4.000
4.000
4.000
3.971
5
4
4
4.5
1.834
1.915
1.323
1.817
42
43
44
32
33
34
*
Empirical Economics
Labour Economics
Journal of Public Economics
42
8
111
3.905
3.875
3.829
4
4.5
4
1.605
2.295
1.683
45
35
*
Games and Economic Behavior
67
3.806
4
1.828
46
36
*
36
3.806
4
1.470
47
48
49
37
38
39
Jahrbücher für Nationalökonomie und Statistik
Journal of Economic Theory
40
8
93
3.775
3.750
3.731
4
4
4
1.717
1.669
1.912
50
40
*
Management Science
31
3.710
4
1.697
51
52
53
41
42
43
*
*
Review of International Economics
International Journal of Game Theory
69
13
29
3.696
3.692
3.690
4
4
4
1.593
1.797
1.834
54
44
*
Journal of Money, Credit, and Banking
29
3.690
4
1.966
55
56
57
58
45
46
46
47
*
European Journal of Political Economy
Konjunkturpolitik
Open Economies Review
Rand Journal of Economics
77
6
6
56
3.675
3.667
3.667
3.661
4
4.5
4
4
1.610
1.751
2.160
1.919
59
48
*
Theory and Decision
25
3.640
4
1.604
60
49
*
Scandinavian Journal of Economics
72
3.639
4
1.730
19
3.632
4
1.802
♦ Review of Economic Studies
* ♦ Economic Inquiry
*
*
♦
♦ Canadian Journal of Economics
* ♦ Journal of Development Economics
*
*
♦
♦ International Economic Review
♦
61
50 *
Cambridge Journal of Economics
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Likert-Scale: 0= very sloppy, 6= very careful
Table 8: Responses to Question 6
"Were the referee reports carefully done?"
62
51
*
Journal of Applied Economics
21
3.619
4
1.687
63
51
*
Scottish Journal of Political Economy
21
3.619
4
1.910
64
52
*
Economic Record
7
3.571
4
1.718
65
66
67
52
52
53
*
Journal of Economic Psychology
Regional Science and Urban Economics
Oxford Bulletin of Economics and Statistics
14
7
23
3.571
3.571
3.565
3.5
5
3
1.016
2.637
1.830
68
54
*
69
*
67
3.552
4
1.820
55
♦ Review of Economics and Statistics
* ♦ American Economic Review
163
3.552
4
1.860
70
56
*
42
3.548
4
1.742
71
57
*
57
3.544
3
1.582
72
58
*
73
74
75
59
60
61
*
76
77
78
79
62
62
62
63
*
80
81
82
83
64
65
65
66
*
84
67
85
86
87
70
88
71
♦ European Economic Review
* ♦ Oxford Economic Papers
* ♦ Economics Letters
89
72
*
90
73
91
74
Kyklos
♦ Journal of International Economics
Journal of Finance
28
3.536
3
1.621
15
17
67
3.533
3.529
3.507
4
4
4
2.066
1.940
1.862
♦
Journal of Applied Econometrics
Journal of Law, Economics, and Organization
Journal of Labor Economics
108
6
6
30
3.500
3.500
3.500
3.433
4
3.5
3.5
4
1.862
2.429
2.074
1.813
♦
Journal of Common Market Studies
Investigaciones Economicas
Spanish Economic Review
Journal of Monetary Economics
12
5
5
33
3.417
3.400
3.400
3.394
3
4
3
4
1.621
2.408
2.302
2.120
*
Journal of Risk and Uncertainty
11
3.364
4
2.248
68
*
Journal of Human Resources
69
*
♦ Journal of Law and Economics
International Journal of Industrial Organization
Journal of Economic Behavior and Organization
*
*
*
♦ Economic Journal
25
3.360
4
1.868
181
3.320
4
1.728
47
3.277
3
1.930
123
3.268
3
1.882
Pacific Economic Review
6
3.167
3
1.472
*
Public Choice
57
3.158
4
1.869
*
Journal of Health Economics
11
3.091
4
1.973
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Likert-Scale: 0= very sloppy, 6= very careful
Table 8: Responses to Question 6
"Were the referee reports carefully done?"
♦ Quarterly Journal of Economics
* ♦ Economica
88
3.080
4
2.030
53
3.075
3
1.910
77
78
78
79
79
*
*
Southern Economic Journal
International Review of Law and Economics
Journal of Business
Labour: Review of Labour Economics and Industrial Relations
Public Finance Quarterly
21
5
12
5
10
3.048
3.000
3.000
2.800
2.800
3
4
3
3
3
1.962
2.828
1.859
1.643
1.989
99
80
*
Public Finance
13
2.615
3
2.399
100
81
*
84
2.607
3
1.957
101
102
103
104
105
106
82
83
84
85
86
87
*
National Tax Journal
Zeitschrift für betriebsw. Forschung/ Schm. Bus. Rev.
Economic Modelling
Applied Economics
Journal of Policy Modelling
Journal of Financial Economics
8
5
7
10
5
11
2.500
2.400
2.286
2.200
2.000
1.818
1
2
2
3
1
1
2.070
2.074
2.498
1.814
2.550
1.991
Dropped-out Journals:
Journal of Consumer Research
Environmental and Resource Economics
Journal of Regional Science
Annals of Regional Science
n=3
n=4
n=4
n=4
92
75
93
76
94
95
96
97
98
*
*
*
♦ Journal of Political Economy
♦
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Likert-Scale: 0= very sloppy, 6= very careful
Table 9: Responses to Question 7
"How was your overall satisfaction with the procedure of paper submission to the respective journal?"
No.
1
2
3
4
5
6
7
Rank * ♦ Journal
1
Ecological Economics
2
Empirica
2
Research Policy
3
Health Economics
3
*
Pacific Economic Review
4
Economic Systems Research
5
*
Econometric Theory
n
5
5
7
6
6
5
9
Mean
5.200
5.000
5.000
4.833
4.833
4.800
4.667
Median
5
5
6
5
5
5
5
Stddev.
0.837
1.225
1.826
1.169
1.169
1.095
1.225
8
5
*
Regional Studies
9
4.667
5
1.118
9
10
11
12
13
6
7
7
7
8
*
Finanzarchiv
Academy of Management Journal
Metroeconomica
Open Economies Review
Mathematical Social Sciences
38
6
18
6
30
4.526
4.500
4.500
4.500
4.467
5
5
5
4.5
5
1.428
2.258
1.689
1.049
1.814
14
9
*
9
4.444
5
2.007
15
16
17
18
10
10
11
12
*
*
8
8
9
70
4.375
4.375
4.333
4.329
4.5
4.5
5
5
1.188
1.685
1.581
1.666
19
13
*
24
4.250
5
1.775
20
14
*
Journal of Urban Economics
14
4.214
5
1.528
21
15
*
Scottish Journal of Political Economy
20
4.200
5
1.908
22
16
*
Social Choice and Welfare
32
4.188
5
1.712
23
24
25
26
17
18
18
19
*
*
Journal of Institutional and Theoretical Economics
Industrial and Labor Relations Review
Journal of Economics and Management Strategy
Economic Inquiry
49
7
7
24
4.184
4.143
4.143
4.125
5
5
4
5
1.495
2.116
1.069
1.895
27
19
*
Geneva Papers of Risk and Insurance
8
4.125
4
1.642
28
20
*
Journal of Economic Dynamics and Control
33
4.091
5
2.067
29
21
*
23
4.087
5
2.043
16
4.063
5
1.948
*
*
♦ Journal of Economic Literature
Australian Economic Papers
International Tax and Public Finance
Journal of Business and Economic Statistics
Journal of Economics (Zeitschr. f. Nat.ök.)
♦ Journal of Mathematical Economics
♦
♦ Journal of Econometrics
* ♦ Journal of Law and Economics
30
22
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Likert-Scale: 0= very unsatisfied, 6= very satisfied
Table 9: Responses to Question 7
"How was your overall satisfaction with the procedure of paper submission to the respective journal?"
31
32
33
34
35
36
37
23
24
24
24
24
24
25
38
26
39
*
*
Journal of Public Economic Theory
Economic Systems
Journal of Banking and Finance
Journal of Macroeconomics
Konjunkturpolitik
Spanish Economic Review
Journal of Population Economics
29
5
5
9
6
5
24
4.034
4.000
4.000
4.000
4.000
4.000
3.917
4
5
5
4
5
5
4.5
1.569
1.732
2.000
1.323
2.191
2.550
1.742
*
Review of Income and Wealth
14
3.857
4.5
1.791
27
*
Economic Theory
51
3.843
5
1.963
40
28
*
European Journal of Political Economy
76
3.842
4
1.674
41
29
*
98
3.816
4
1.907
42
43
44
45
30
31
32
33
*
Weltwirtschaftliches Archiv
Investigaciones Economicas
Jahrbücher für Nationalökonomie und Statistik
Canadian Journal of Economics
62
5
8
37
3.806
3.800
3.750
3.730
4
4
4
4
1.773
2.280
1.982
1.836
46
47
48
34
35
36
*
Games and Economic Behavior
Journal of International Money and Finance
Management Science
66
7
31
3.727
3.714
3.677
4
4
5
1.759
1.496
2.039
49
37
*
Scandinavian Journal of Economics
74
3.635
4
1.927
50
38
*
154
3.630
4
1.993
51
52
53
39
40
41
*
112
7
94
3.589
3.571
3.564
4
4
4
1.814
2.070
1.926
54
42
*
42
3.524
4
1.941
55
56
57
58
59
43
43
44
44
45
*
Empirical Economics
Journal of Law, Economics, and Organization
Economic Record
German Economic Review
Journal of Risk and Uncertainty
44
6
7
7
12
3.500
3.500
3.429
3.429
3.417
4
3.5
4
4
3.5
1.849
2.345
2.573
2.225
2.065
60
61
46
46
Journal of Economic Psychology
Journal of Environmental Economics and Management
15
5
3.400
3.400
4
4
2.063
1.817
*
*
♦ Econometrica
♦
♦ Economics Letters
* ♦ Journal of Public Economics
*
*
*
Regional Science and Urban Economics
Journal of Economic Theory
♦
♦ Journal of Development Economics
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Likert-Scale: 0= very unsatisfied, 6= very satisfied
Table 9: Responses to Question 7
"How was your overall satisfaction with the procedure of paper submission to the respective journal?"
62
47
*
Public Choice
57
3.386
4
2.102
63
48
*
171
3.374
3
1.825
64
49
*
67
3.373
4
1.914
65
50
*
66
51
*
Journal of Industrial Economics
84
3.369
3.5
1.727
46
3.348
4
1.689
67
52
*
Journal of Money, Credit, and Banking
29
3.345
3
1.717
68
53
*
71
3.338
3
1.934
76
3.329
4
1.872
55
♦ Review of Economics and Statistics
* ♦ International Economic Review
* ♦ Journal of International Economics
69
54
70
60
3.317
3
1.732
71
56
*
Theory and Decision
26
3.308
4
1.871
72
73
74
75
76
77
57
58
59
60
61
62
*
*
Public Finance Quarterly
Journal of International Business Studies
International Journal of Industrial Organization
International Journal of Game Theory
Labour Economics
Oxford Economic Papers
10
5
17
30
8
51
3.300
3.200
3.176
3.167
3.125
3.098
4
3
4
4
3
3
2.214
1.789
1.845
2.036
2.167
1.962
78
63
*
Kyklos
53
3.094
3
2.106
79
80
81
64
65
66
*
Journal of Health Economics
Review of International Economics
Journal of Applied Economics
11
13
23
3.091
3.077
3.043
3
3
3
2.119
1.605
2.225
82
83
84
67
68
69
*
*
60
6
20
3.033
3.000
2.950
3
3
3
1.966
1.673
1.731
85
70
*
187
2.947
3
1.831
86
71
♦ European Economic Review
* ♦ Economica
52
2.942
3
1.924
87
72
*
22
2.909
2.5
2.114
88
73
*
106
2.896
3
2.051
89
74
♦ Quarterly Journal of Economics
* ♦ Journal of Labor Economics
32
2.875
3
1.897
90
75
*
Journal of Human Resources
30
2.867
3
2.113
91
76
*
Oxford Bulletin of Economics and Statistics
29
2.862
3
2.183
♦ American Economic Review
Journal of Economic Behavior and Organization
♦ Review of Economic Studies
*
*
♦
♦ Rand Journal of Economics
Journal of Applied Econometrics
Cambridge Journal of Economics
Southern Economic Journal
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Likert-Scale: 0= very unsatisfied, 6= very satisfied
Table 9: Responses to Question 7
"How was your overall satisfaction with the procedure of paper submission to the respective journal?"
92
77
*
93
94
95
96
78
79
79
80
*
*
97
81
98
99
♦ Economic Journal
115
2.861
3
2.008
Journal of Common Market Studies
International Review of Law and Economics
Zeitschrift für betriebsw. Forschung/ Schm. Bus. Rev.
Journal of Monetary Economics
14
5
5
34
2.857
2.800
2.800
2.794
3
2
3
3
2.248
2.588
2.168
2.027
*
Journal of Finance
28
2.786
3
1.853
82
*
National Tax Journal
9
2.667
3
2.449
83
*
Journal of Business
14
2.357
2.5
1.499
100
84
*
11
2.273
1
2.573
101
85
♦ Journal of Financial Economics
* ♦ Journal of Political Economy
88
2.125
2
1.923
102
103
104
105
106
86
87
88
89
90
*
Public Finance
Applied Economics
Labour: Review of Labour Economics and Industrial Relations
Economic Modelling
Journal of Policy Modelling
15
10
5
7
5
2.000
1.900
1.800
1.714
1.200
1
1
1
2
0
2.268
1.912
2.490
1.890
2.683
Dropped-out Journals:
Annals of Regional Science
Environmental and Resource Economics
Journal of Consumer Research
Journal of Regional Science
n=4
n=3
n=3
n=4
♦
* Invited Journals
♦ Diamond List
All Others: Contributed Journals
Likert-Scale: 0= very unsatisfied, 6= very satisfied