Expected loss functions as additional measures to assess performance of multiple testing procedures for combination drug dosefinding

Julia N Soulakova, Allan R. Sampson

Research output: Contribution to journalArticle

Abstract

There are several measures that are commonly used to assess performance of a multiple testing procedure (MTP). These measures include power, overall error rate (family-wise error rate), and lack of power. In settings where the MTP is used to estimate a parameter, for example, the minimum effective dose, bias is of interest. In some studies, the parameter has a set-like structure, and thus, bias is not well defined. Nevertheless, the accuracy of estimation is one of the essential features of an MTP in such a context. In this paper, we propose several measures based on the expected values of loss functions that resemble bias. These measures are constructed to be useful in combination drug dose response studies when the target is to identify all minimum efficacious drug combinations. One of the proposed measures allows for assigning different penalties for incorrectly overestimating and underestimating a true minimum efficacious combination. Several simple examples are considered to illustrate the proposed loss functions. Then, the expected values of these loss functions are used in a simulation study to identify the best procedure among several methods used to select the minimum efficacious combinations, where the measures take into account the investigator's preferences about possibly overestimating and/or underestimating a true minimum efficacious combination. The ideas presented in this paper can be generalized to construct measures that resemble bias in other settings. These measures can serve as an essential tool to assess performance of several methods for identifying set-like parameters in terms of accuracy of estimation.

Original languageEnglish (US)
Pages (from-to)250-257
Number of pages8
JournalPharmaceutical Statistics
Volume11
Issue number3
DOIs
StatePublished - May 1 2012

Fingerprint

Multiple Testing
Drug Combinations
Loss Function
Drugs
Expected Value
Minimum Effective Dose
Familywise Error Rate
Dose-response
Research Personnel
Error Rate
Penalty
Well-defined
Simulation Study
Target

Keywords

  • average test
  • dose response
  • maximum test
  • minimum effective dose
  • stepwise procedure

ASJC Scopus subject areas

  • Statistics and Probability
  • Pharmacology
  • Pharmacology (medical)

Cite this

Expected loss functions as additional measures to assess performance of multiple testing procedures for combination drug dosefinding. / Soulakova, Julia N; Sampson, Allan R.

In: Pharmaceutical Statistics, Vol. 11, No. 3, 01.05.2012, p. 250-257.

Research output: Contribution to journalArticle

@article{bc12a569c7934fc99c87df77352c2966,
title = "Expected loss functions as additional measures to assess performance of multiple testing procedures for combination drug dosefinding",
abstract = "There are several measures that are commonly used to assess performance of a multiple testing procedure (MTP). These measures include power, overall error rate (family-wise error rate), and lack of power. In settings where the MTP is used to estimate a parameter, for example, the minimum effective dose, bias is of interest. In some studies, the parameter has a set-like structure, and thus, bias is not well defined. Nevertheless, the accuracy of estimation is one of the essential features of an MTP in such a context. In this paper, we propose several measures based on the expected values of loss functions that resemble bias. These measures are constructed to be useful in combination drug dose response studies when the target is to identify all minimum efficacious drug combinations. One of the proposed measures allows for assigning different penalties for incorrectly overestimating and underestimating a true minimum efficacious combination. Several simple examples are considered to illustrate the proposed loss functions. Then, the expected values of these loss functions are used in a simulation study to identify the best procedure among several methods used to select the minimum efficacious combinations, where the measures take into account the investigator's preferences about possibly overestimating and/or underestimating a true minimum efficacious combination. The ideas presented in this paper can be generalized to construct measures that resemble bias in other settings. These measures can serve as an essential tool to assess performance of several methods for identifying set-like parameters in terms of accuracy of estimation.",
keywords = "average test, dose response, maximum test, minimum effective dose, stepwise procedure",
author = "Soulakova, {Julia N} and Sampson, {Allan R.}",
year = "2012",
month = "5",
day = "1",
doi = "10.1002/pst.542",
language = "English (US)",
volume = "11",
pages = "250--257",
journal = "Pharmaceutical Statistics",
issn = "1539-1604",
publisher = "John Wiley and Sons Ltd",
number = "3",

}

TY - JOUR

T1 - Expected loss functions as additional measures to assess performance of multiple testing procedures for combination drug dosefinding

AU - Soulakova, Julia N

AU - Sampson, Allan R.

PY - 2012/5/1

Y1 - 2012/5/1

N2 - There are several measures that are commonly used to assess performance of a multiple testing procedure (MTP). These measures include power, overall error rate (family-wise error rate), and lack of power. In settings where the MTP is used to estimate a parameter, for example, the minimum effective dose, bias is of interest. In some studies, the parameter has a set-like structure, and thus, bias is not well defined. Nevertheless, the accuracy of estimation is one of the essential features of an MTP in such a context. In this paper, we propose several measures based on the expected values of loss functions that resemble bias. These measures are constructed to be useful in combination drug dose response studies when the target is to identify all minimum efficacious drug combinations. One of the proposed measures allows for assigning different penalties for incorrectly overestimating and underestimating a true minimum efficacious combination. Several simple examples are considered to illustrate the proposed loss functions. Then, the expected values of these loss functions are used in a simulation study to identify the best procedure among several methods used to select the minimum efficacious combinations, where the measures take into account the investigator's preferences about possibly overestimating and/or underestimating a true minimum efficacious combination. The ideas presented in this paper can be generalized to construct measures that resemble bias in other settings. These measures can serve as an essential tool to assess performance of several methods for identifying set-like parameters in terms of accuracy of estimation.

AB - There are several measures that are commonly used to assess performance of a multiple testing procedure (MTP). These measures include power, overall error rate (family-wise error rate), and lack of power. In settings where the MTP is used to estimate a parameter, for example, the minimum effective dose, bias is of interest. In some studies, the parameter has a set-like structure, and thus, bias is not well defined. Nevertheless, the accuracy of estimation is one of the essential features of an MTP in such a context. In this paper, we propose several measures based on the expected values of loss functions that resemble bias. These measures are constructed to be useful in combination drug dose response studies when the target is to identify all minimum efficacious drug combinations. One of the proposed measures allows for assigning different penalties for incorrectly overestimating and underestimating a true minimum efficacious combination. Several simple examples are considered to illustrate the proposed loss functions. Then, the expected values of these loss functions are used in a simulation study to identify the best procedure among several methods used to select the minimum efficacious combinations, where the measures take into account the investigator's preferences about possibly overestimating and/or underestimating a true minimum efficacious combination. The ideas presented in this paper can be generalized to construct measures that resemble bias in other settings. These measures can serve as an essential tool to assess performance of several methods for identifying set-like parameters in terms of accuracy of estimation.

KW - average test

KW - dose response

KW - maximum test

KW - minimum effective dose

KW - stepwise procedure

UR - http://www.scopus.com/inward/record.url?scp=84861100462&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84861100462&partnerID=8YFLogxK

U2 - 10.1002/pst.542

DO - 10.1002/pst.542

M3 - Article

VL - 11

SP - 250

EP - 257

JO - Pharmaceutical Statistics

JF - Pharmaceutical Statistics

SN - 1539-1604

IS - 3

ER -