Asymptotic normality of the posterior in relative entropy

Bertrand S Clarke

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

We show that the relative entropy between a posterior density formed from a smooth likelihood and prior and a limiting normal form tends to zero in the independent and identically distributed case. The mode of convergence is in probability and in mean. Applications to codelengths in stochastic complexity and to sample size selection are briefly discussed.

Original languageEnglish (US)
Pages (from-to)165-176
Number of pages12
JournalIEEE Transactions on Information Theory
Volume45
Issue number1
DOIs
StatePublished - Dec 1 1999

Fingerprint

normality
entropy
Entropy

Keywords

  • Asymptotic normality
  • Posterior density
  • Relative entropy

ASJC Scopus subject areas

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences

Cite this

Asymptotic normality of the posterior in relative entropy. / Clarke, Bertrand S.

In: IEEE Transactions on Information Theory, Vol. 45, No. 1, 01.12.1999, p. 165-176.

Research output: Contribution to journalArticle

Clarke, Bertrand S. / Asymptotic normality of the posterior in relative entropy. In: IEEE Transactions on Information Theory. 1999 ; Vol. 45, No. 1. pp. 165-176.
@article{43c36fd690d14b87b66420fc69b1283f,
title = "Asymptotic normality of the posterior in relative entropy",
abstract = "We show that the relative entropy between a posterior density formed from a smooth likelihood and prior and a limiting normal form tends to zero in the independent and identically distributed case. The mode of convergence is in probability and in mean. Applications to codelengths in stochastic complexity and to sample size selection are briefly discussed.",
keywords = "Asymptotic normality, Posterior density, Relative entropy",
author = "Clarke, {Bertrand S}",
year = "1999",
month = "12",
day = "1",
doi = "10.1109/18.746784",
language = "English (US)",
volume = "45",
pages = "165--176",
journal = "IEEE Transactions on Information Theory",
issn = "0018-9448",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "1",

}

TY - JOUR

T1 - Asymptotic normality of the posterior in relative entropy

AU - Clarke, Bertrand S

PY - 1999/12/1

Y1 - 1999/12/1

N2 - We show that the relative entropy between a posterior density formed from a smooth likelihood and prior and a limiting normal form tends to zero in the independent and identically distributed case. The mode of convergence is in probability and in mean. Applications to codelengths in stochastic complexity and to sample size selection are briefly discussed.

AB - We show that the relative entropy between a posterior density formed from a smooth likelihood and prior and a limiting normal form tends to zero in the independent and identically distributed case. The mode of convergence is in probability and in mean. Applications to codelengths in stochastic complexity and to sample size selection are briefly discussed.

KW - Asymptotic normality

KW - Posterior density

KW - Relative entropy

UR - http://www.scopus.com/inward/record.url?scp=0032636553&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0032636553&partnerID=8YFLogxK

U2 - 10.1109/18.746784

DO - 10.1109/18.746784

M3 - Article

VL - 45

SP - 165

EP - 176

JO - IEEE Transactions on Information Theory

JF - IEEE Transactions on Information Theory

SN - 0018-9448

IS - 1

ER -