Information theory and cognition: A review

Research output: Contribution to journalReview article

4 Citations (Scopus)

Abstract

We examine how information theory has been used to study cognition over the last seven decades. After an initial burst of activity in the 1950s, the backlash that followed stopped most work in this area. The last couple of decades has seen both a revival of interest, and a more firmly grounded, experimentally justified use of information theory. We can view cognition as the process of transforming perceptions into information-where we use information in the colloquial sense of the word. This last clarification is one of the problems we run into when trying to use information theoretic principles to understand or analyze cognition. Information theory is mathematical, while cognition is a subjective phenomenon. It is relatively easy to discern a subjective connection between cognition and information; it is a different matter altogether to apply the rigor of information theory to the process of cognition. In this paper, we will look at the many ways in which people have tried to alleviate this problem. These approaches range from narrowing the focus to only quantifiable aspects of cognition or borrowing conceptual machinery from information theory to address issues of cognition. We describe applications of information theory across a range of cognition research, from neural coding to cognitive control and predictive coding.

Original languageEnglish (US)
Article number706
JournalEntropy
Volume20
Issue number9
DOIs
StatePublished - Sep 14 2018

Fingerprint

cognition
information theory
coding
machinery
bursts

Keywords

  • Averagemutual information
  • Cognition
  • Information theory
  • Neuronal codes
  • Predictive coding

ASJC Scopus subject areas

  • Physics and Astronomy(all)

Cite this

Information theory and cognition : A review. / Sayood, Khalid.

In: Entropy, Vol. 20, No. 9, 706, 14.09.2018.

Research output: Contribution to journalReview article

@article{484993892e8a43eda003a2ba9c2e0391,
title = "Information theory and cognition: A review",
abstract = "We examine how information theory has been used to study cognition over the last seven decades. After an initial burst of activity in the 1950s, the backlash that followed stopped most work in this area. The last couple of decades has seen both a revival of interest, and a more firmly grounded, experimentally justified use of information theory. We can view cognition as the process of transforming perceptions into information-where we use information in the colloquial sense of the word. This last clarification is one of the problems we run into when trying to use information theoretic principles to understand or analyze cognition. Information theory is mathematical, while cognition is a subjective phenomenon. It is relatively easy to discern a subjective connection between cognition and information; it is a different matter altogether to apply the rigor of information theory to the process of cognition. In this paper, we will look at the many ways in which people have tried to alleviate this problem. These approaches range from narrowing the focus to only quantifiable aspects of cognition or borrowing conceptual machinery from information theory to address issues of cognition. We describe applications of information theory across a range of cognition research, from neural coding to cognitive control and predictive coding.",
keywords = "Averagemutual information, Cognition, Information theory, Neuronal codes, Predictive coding",
author = "Khalid Sayood",
year = "2018",
month = "9",
day = "14",
doi = "10.3390/e20090706",
language = "English (US)",
volume = "20",
journal = "Entropy",
issn = "1099-4300",
publisher = "Multidisciplinary Digital Publishing Institute (MDPI)",
number = "9",

}

TY - JOUR

T1 - Information theory and cognition

T2 - A review

AU - Sayood, Khalid

PY - 2018/9/14

Y1 - 2018/9/14

N2 - We examine how information theory has been used to study cognition over the last seven decades. After an initial burst of activity in the 1950s, the backlash that followed stopped most work in this area. The last couple of decades has seen both a revival of interest, and a more firmly grounded, experimentally justified use of information theory. We can view cognition as the process of transforming perceptions into information-where we use information in the colloquial sense of the word. This last clarification is one of the problems we run into when trying to use information theoretic principles to understand or analyze cognition. Information theory is mathematical, while cognition is a subjective phenomenon. It is relatively easy to discern a subjective connection between cognition and information; it is a different matter altogether to apply the rigor of information theory to the process of cognition. In this paper, we will look at the many ways in which people have tried to alleviate this problem. These approaches range from narrowing the focus to only quantifiable aspects of cognition or borrowing conceptual machinery from information theory to address issues of cognition. We describe applications of information theory across a range of cognition research, from neural coding to cognitive control and predictive coding.

AB - We examine how information theory has been used to study cognition over the last seven decades. After an initial burst of activity in the 1950s, the backlash that followed stopped most work in this area. The last couple of decades has seen both a revival of interest, and a more firmly grounded, experimentally justified use of information theory. We can view cognition as the process of transforming perceptions into information-where we use information in the colloquial sense of the word. This last clarification is one of the problems we run into when trying to use information theoretic principles to understand or analyze cognition. Information theory is mathematical, while cognition is a subjective phenomenon. It is relatively easy to discern a subjective connection between cognition and information; it is a different matter altogether to apply the rigor of information theory to the process of cognition. In this paper, we will look at the many ways in which people have tried to alleviate this problem. These approaches range from narrowing the focus to only quantifiable aspects of cognition or borrowing conceptual machinery from information theory to address issues of cognition. We describe applications of information theory across a range of cognition research, from neural coding to cognitive control and predictive coding.

KW - Averagemutual information

KW - Cognition

KW - Information theory

KW - Neuronal codes

KW - Predictive coding

UR - http://www.scopus.com/inward/record.url?scp=85053672504&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85053672504&partnerID=8YFLogxK

U2 - 10.3390/e20090706

DO - 10.3390/e20090706

M3 - Review article

AN - SCOPUS:85053672504

VL - 20

JO - Entropy

JF - Entropy

SN - 1099-4300

IS - 9

M1 - 706

ER -