Order matters: Alphabetizing in-text citations biases citation rates

Jeffrey R. Stevens, Juan F. Duque

Research output: Contribution to journalArticle

1 Scopus citations

Abstract

Though citations are critical for communicating science and evaluating scholarly success, properties unrelated to the quality of the work—such as cognitive biases—can influence citation decisions. The primacy effect, in particular, is relevant to lists, which for in-text citations could result in citations earlier in the list receiving more attention than those later in the list. Therefore, how citations are ordered could influence which citations receive the most attention. Using a sample of 150,000 articles, we tested whether alphabetizing in-text citations biases readers into citing more often articles with first authors whose surnames begin with letters early in the alphabet. We found that surnames earlier in the alphabet were cited more often than those later in the alphabet when journals ordered citations alphabetically compared with chronologically or numerically. This effect seemed to be stronger in psychology journals (which have a culture of alphabetizing citations) compared with biology or geoscience journals (which primarily order chronologically or numerically) and was strongest among moderately and highly cited articles. Therefore, alphabetizing in-text citations biases citation decisions toward authors with surnames occurring early in the alphabet. These citation decisions result from an interaction between cognitive biases (more attention devoted to items earlier in a list) and the structure of the citation environment (the style in which citations are ordered). We suggest that journals using alphabetically ordered citations switch to chronological ordering to minimize this arbitrary alphabetical citation bias.

Original languageEnglish (US)
Pages (from-to)1020-1026
Number of pages7
JournalPsychonomic Bulletin and Review
Volume26
Issue number3
DOIs
Publication statusPublished - Jun 15 2019

    Fingerprint

Keywords

  • Alphabetical order
  • Bounded rationality
  • Chronological order
  • Citation decisions
  • Citation style
  • Primacy effect

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Developmental and Educational Psychology
  • Arts and Humanities (miscellaneous)

Cite this