Kernel estimation in transect sampling without the shoulder condition

Y. P. Mack, Pham X. Quang, Shunpu Zhang

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

We consider the estimation of wildlife population density based on line transect data. Nonparametric kernel method is employed, without the usual assumption that the detection curve has a shoulder at distance zero, with the help of a special class of kernels called boundary kernels. Asymptotic distribution results are included. It is pointed out that the boundary kernel of Zhang and Karunamuni (1998) (see also Müller and Wang (1994)) performs better (for asymptotic mean square error consideration) than that of the boundary kernel of Müller (1991). But both of these kernels are clearly superior to the half-normal and one-sided Epanechnikov kernel when the shoulder condition fails to hold. In practice, however, for small to moderate sample sizes, caution should be exercised in using boundary kernels in that the density estimate might become negative. A Monte Carlo study is also presented, comparing the performance of four kernels applied to detection data, with and without the shoulder condition. Two boundary kernels for derivatives arc also included for the point transect case.

Original languageEnglish (US)
Pages (from-to)2277-2296
Number of pages20
JournalCommunications in Statistics - Theory and Methods
Volume28
Issue number10
DOIs
StatePublished - Jan 1 1999

Fingerprint

Kernel Estimation
Mean square error
Sampling
kernel
Derivatives
Density Estimates
Nonparametric Methods
Kernel Methods
Monte Carlo Study
Asymptotic distribution
Sample Size
Arc of a curve
Derivative
Curve

ASJC Scopus subject areas

  • Statistics and Probability

Cite this

Kernel estimation in transect sampling without the shoulder condition. / Mack, Y. P.; Quang, Pham X.; Zhang, Shunpu.

In: Communications in Statistics - Theory and Methods, Vol. 28, No. 10, 01.01.1999, p. 2277-2296.

Research output: Contribution to journalArticle

Mack, Y. P. ; Quang, Pham X. ; Zhang, Shunpu. / Kernel estimation in transect sampling without the shoulder condition. In: Communications in Statistics - Theory and Methods. 1999 ; Vol. 28, No. 10. pp. 2277-2296.
@article{47cbecc2729849ea91fbc41c83096619,
title = "Kernel estimation in transect sampling without the shoulder condition",
abstract = "We consider the estimation of wildlife population density based on line transect data. Nonparametric kernel method is employed, without the usual assumption that the detection curve has a shoulder at distance zero, with the help of a special class of kernels called boundary kernels. Asymptotic distribution results are included. It is pointed out that the boundary kernel of Zhang and Karunamuni (1998) (see also M{\"u}ller and Wang (1994)) performs better (for asymptotic mean square error consideration) than that of the boundary kernel of M{\"u}ller (1991). But both of these kernels are clearly superior to the half-normal and one-sided Epanechnikov kernel when the shoulder condition fails to hold. In practice, however, for small to moderate sample sizes, caution should be exercised in using boundary kernels in that the density estimate might become negative. A Monte Carlo study is also presented, comparing the performance of four kernels applied to detection data, with and without the shoulder condition. Two boundary kernels for derivatives arc also included for the point transect case.",
author = "Mack, {Y. P.} and Quang, {Pham X.} and Shunpu Zhang",
year = "1999",
month = "1",
day = "1",
doi = "10.1080/03610929908832422",
language = "English (US)",
volume = "28",
pages = "2277--2296",
journal = "Communications in Statistics - Theory and Methods",
issn = "0361-0926",
publisher = "Taylor and Francis Ltd.",
number = "10",

}

TY - JOUR

T1 - Kernel estimation in transect sampling without the shoulder condition

AU - Mack, Y. P.

AU - Quang, Pham X.

AU - Zhang, Shunpu

PY - 1999/1/1

Y1 - 1999/1/1

N2 - We consider the estimation of wildlife population density based on line transect data. Nonparametric kernel method is employed, without the usual assumption that the detection curve has a shoulder at distance zero, with the help of a special class of kernels called boundary kernels. Asymptotic distribution results are included. It is pointed out that the boundary kernel of Zhang and Karunamuni (1998) (see also Müller and Wang (1994)) performs better (for asymptotic mean square error consideration) than that of the boundary kernel of Müller (1991). But both of these kernels are clearly superior to the half-normal and one-sided Epanechnikov kernel when the shoulder condition fails to hold. In practice, however, for small to moderate sample sizes, caution should be exercised in using boundary kernels in that the density estimate might become negative. A Monte Carlo study is also presented, comparing the performance of four kernels applied to detection data, with and without the shoulder condition. Two boundary kernels for derivatives arc also included for the point transect case.

AB - We consider the estimation of wildlife population density based on line transect data. Nonparametric kernel method is employed, without the usual assumption that the detection curve has a shoulder at distance zero, with the help of a special class of kernels called boundary kernels. Asymptotic distribution results are included. It is pointed out that the boundary kernel of Zhang and Karunamuni (1998) (see also Müller and Wang (1994)) performs better (for asymptotic mean square error consideration) than that of the boundary kernel of Müller (1991). But both of these kernels are clearly superior to the half-normal and one-sided Epanechnikov kernel when the shoulder condition fails to hold. In practice, however, for small to moderate sample sizes, caution should be exercised in using boundary kernels in that the density estimate might become negative. A Monte Carlo study is also presented, comparing the performance of four kernels applied to detection data, with and without the shoulder condition. Two boundary kernels for derivatives arc also included for the point transect case.

UR - http://www.scopus.com/inward/record.url?scp=0042110195&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0042110195&partnerID=8YFLogxK

U2 - 10.1080/03610929908832422

DO - 10.1080/03610929908832422

M3 - Article

AN - SCOPUS:0042110195

VL - 28

SP - 2277

EP - 2296

JO - Communications in Statistics - Theory and Methods

JF - Communications in Statistics - Theory and Methods

SN - 0361-0926

IS - 10

ER -