Strength of evidence of non-inferiority trials - The adjustment of the type I error rate in non-inferiority trials with the synthesis method

Seung Ho Kang, Yi Tsong

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

In non-inferiority trials that employ the synthesis method several types of dependencies among test statistics occur due to sharing of the same information from the historical trial. The conditions under which the dependencies appear may be divided into three categories. The first case is when a new drug is approved with single non-inferiority trial. The second case is when a new drug is approved if two independent non-inferiority trials show positive results. The third case is when two new different drugs are approved with the same active control. The problem of the dependencies is that they can make the type I error rate deviate from the nominal level. In order to study such deviations, we introduce the unconditional and conditional across-trial type I error rates when the non-inferiority margin is estimated from the historical trial, and investigate how the dependencies affect the type I error rates. We show that the unconditional across-trial type I error rate increases dramatically as does the correlation between two non-inferiority tests when a new drug is approved based on the positive results of two non-inferiority trials. We conclude that the conditional across-trial type I error rate involves the unknown treatment effect in the historical trial. The formulae of the conditional across-trial type I error rates provide us with a way of investigating the conditional across-trial type I error rates for various assumed values of the treatment effect in the historical trial.

Original languageEnglish
Pages (from-to)1477-1487
Number of pages11
JournalStatistics in Medicine
Volume29
Issue number14
DOIs
Publication statusPublished - 2010 Jun 30

Fingerprint

Non-inferiority
Type I Error Rate
Adjustment
Synthesis
Pharmaceutical Preparations
Information Dissemination
Drugs
Treatment Effects
Evidence
Active Control
Margin
Test Statistic
Categorical or nominal

All Science Journal Classification (ASJC) codes

  • Epidemiology
  • Statistics and Probability

Cite this

@article{acd51226138746c69df77710988a760b,
title = "Strength of evidence of non-inferiority trials - The adjustment of the type I error rate in non-inferiority trials with the synthesis method",
abstract = "In non-inferiority trials that employ the synthesis method several types of dependencies among test statistics occur due to sharing of the same information from the historical trial. The conditions under which the dependencies appear may be divided into three categories. The first case is when a new drug is approved with single non-inferiority trial. The second case is when a new drug is approved if two independent non-inferiority trials show positive results. The third case is when two new different drugs are approved with the same active control. The problem of the dependencies is that they can make the type I error rate deviate from the nominal level. In order to study such deviations, we introduce the unconditional and conditional across-trial type I error rates when the non-inferiority margin is estimated from the historical trial, and investigate how the dependencies affect the type I error rates. We show that the unconditional across-trial type I error rate increases dramatically as does the correlation between two non-inferiority tests when a new drug is approved based on the positive results of two non-inferiority trials. We conclude that the conditional across-trial type I error rate involves the unknown treatment effect in the historical trial. The formulae of the conditional across-trial type I error rates provide us with a way of investigating the conditional across-trial type I error rates for various assumed values of the treatment effect in the historical trial.",
author = "Kang, {Seung Ho} and Yi Tsong",
year = "2010",
month = "6",
day = "30",
doi = "10.1002/sim.3903",
language = "English",
volume = "29",
pages = "1477--1487",
journal = "Statistics in Medicine",
issn = "0277-6715",
publisher = "John Wiley and Sons Ltd",
number = "14",

}

TY - JOUR

T1 - Strength of evidence of non-inferiority trials - The adjustment of the type I error rate in non-inferiority trials with the synthesis method

AU - Kang, Seung Ho

AU - Tsong, Yi

PY - 2010/6/30

Y1 - 2010/6/30

N2 - In non-inferiority trials that employ the synthesis method several types of dependencies among test statistics occur due to sharing of the same information from the historical trial. The conditions under which the dependencies appear may be divided into three categories. The first case is when a new drug is approved with single non-inferiority trial. The second case is when a new drug is approved if two independent non-inferiority trials show positive results. The third case is when two new different drugs are approved with the same active control. The problem of the dependencies is that they can make the type I error rate deviate from the nominal level. In order to study such deviations, we introduce the unconditional and conditional across-trial type I error rates when the non-inferiority margin is estimated from the historical trial, and investigate how the dependencies affect the type I error rates. We show that the unconditional across-trial type I error rate increases dramatically as does the correlation between two non-inferiority tests when a new drug is approved based on the positive results of two non-inferiority trials. We conclude that the conditional across-trial type I error rate involves the unknown treatment effect in the historical trial. The formulae of the conditional across-trial type I error rates provide us with a way of investigating the conditional across-trial type I error rates for various assumed values of the treatment effect in the historical trial.

AB - In non-inferiority trials that employ the synthesis method several types of dependencies among test statistics occur due to sharing of the same information from the historical trial. The conditions under which the dependencies appear may be divided into three categories. The first case is when a new drug is approved with single non-inferiority trial. The second case is when a new drug is approved if two independent non-inferiority trials show positive results. The third case is when two new different drugs are approved with the same active control. The problem of the dependencies is that they can make the type I error rate deviate from the nominal level. In order to study such deviations, we introduce the unconditional and conditional across-trial type I error rates when the non-inferiority margin is estimated from the historical trial, and investigate how the dependencies affect the type I error rates. We show that the unconditional across-trial type I error rate increases dramatically as does the correlation between two non-inferiority tests when a new drug is approved based on the positive results of two non-inferiority trials. We conclude that the conditional across-trial type I error rate involves the unknown treatment effect in the historical trial. The formulae of the conditional across-trial type I error rates provide us with a way of investigating the conditional across-trial type I error rates for various assumed values of the treatment effect in the historical trial.

UR - http://www.scopus.com/inward/record.url?scp=77953708859&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77953708859&partnerID=8YFLogxK

U2 - 10.1002/sim.3903

DO - 10.1002/sim.3903

M3 - Article

VL - 29

SP - 1477

EP - 1487

JO - Statistics in Medicine

JF - Statistics in Medicine

SN - 0277-6715

IS - 14

ER -