nav emailalert searchbtn searchbox tablepage yinyongbenwen piczone journalimg journalInfo journalinfonormal searchdiv searchzone qikanlogo popupnotification paper paperNew
摘要:

模型的验证是指对模型的性能指标(区分度、校准度)进行考察的过程。根据考察过程中是否使用预测模型的开发队列数据,模型验证可分为内部验证和外部验证。内部验证是检验模型开发过程的可重复性,常见形式包括随机拆分验证、交叉验证、Bootstrap重抽样以及"内部-外部"交叉验证。外部验证考察的是模型的可移植性和可泛化性,常见形式包括时段验证、空间验证以及领域验证。

Abstract:

Model validation is to assess the performance(discrimination, calibration) of a clinical prediction model. Depending on whether model derivation cohort is used, model validation can be classified as internal and external validation. Internal validation is focused on the reproducibility of the model development procedure,with the methods including random split, cross-validation, bootstrap validation and internal-external validation.External validation pays more attention to transportability and generalizability, and it includes temporal validation,geographical validation and domain validation.

参考文献

[1]Collins GS,Reitsma JB,Altman DG,et al. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis(TRIPOD):the TRIPOD statement. The TRIPOD Group[J]. Circulation,2015,131(2):211-9.

[2]Moons KGM,Altman DG,Reitsma JB,et al. Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis(TRIPOD):Explanation and Elaboration[J]. Annals of Internal Medicine, 2015,162(1):W1-73.

[3]Siontis GC,Tzoulaki I,Castaldi PJ,et al. External validation of new risk prediction models is infrequent and reveals worse prognostic discrimination[J]. Journal of clinical epidemiology,2015,68(1):25-34.

[4]Altman DG,Vergouwe Y,Royston P,et al. Prognosis and prognostic research:validating a prognostic model[J]. BMJ,2009,338:b605.

[5]Alba AC,Agoritsas T,Walsh M,et al. Discrimination and Calibration of Clinical Prediction Models:Users'Guides to the Medical Literature[J].JAMA,2017,318(14):1377-84.

[6]Harrell FE,Lee KL,Mark DB. Multivariable prognostic models:issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors[J]. Statistics in medicine,1996,15(4):361-87.

[7]Rahman MS,Ambler G,Choodari-Oskooei B,et al. Review and evaluation of performance measures for survival prediction models in external validation settings[J]. BMC medical research methodology,2017,17(1):60.

[8]Uno H,Cai T,Pencina MJ,et al. On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data[J]. Statistics in medicine,2011,30(10):1105-17.

[9]Heagerty PJ,Zheng Y. Survival model predictive accuracy and ROC curves[J]. Biometrics,2005,61(1):92-105.

[10] Schmid M,Potapov S. A comparison of estimators to evaluate the discriminatory power of time-to-event models[J]. Statistics in medicine,2012,31(23):2588-609.

[11] Steyerberg EW,Vergouwe Y. Towards better clinical prediction models:seven steps for development and an ABCD for validation[J].Eur Heart J,2014,35(29):1925-31.

[12] Steyerberg EW. Clinical prediction models:a practical approach to development, validation,and updating[M]. Springer Science&Business Media,2008.

[13]Steyerberg EW,Vickers AJ,Cook NR,et al. Assessing the performance of prediction models:a framework for traditional and novel measures[J]. Epidemiology,2010,21(1):128-38.

[14] Moons KG,Kengne AP,Grobbee DE,et al. Risk prediction models:II. External validation, model updating, and impact assessment[J].Heart,2012,98(9):691-8.

[15]Moons KGM,Kengne AP,Woodward M,et al. Risk prediction models:I.Development, internal validation,and assessing the incremental value of a new(bio)marker[J]. Heart,2012,98(9):683-90.

[16] Steyerberg EW,Harrell FE,Jr. Prediction models need appropriate internal,internal-external,and external validation[J]. J Clin Epidemiol,2016,69:245-7.

[17] Harrell Jr FE. Regression modeling strategies:with applications to linear models, logistic and ordinal regression,and survival analysis[M]. Springer,2015.

[18]Royston P,Altman DG. External validation of a Cox prognostic model:principles and methods[J]. BMC medical research methodology,2013,13(1):33.

[19]Hendriksen JM,Geersing GJ,Moons KG,et al. Diagnostic and prognostic prediction models[J]. J Thromb Haemost,2013,11(Suppl 1):129-41.

基本信息:

中图分类号:R-03

引用信息:

[1]王俊峰,章仲恒,周支瑞,等.临床预测模型:模型的验证[J].中国循证心血管医学杂志,2019,11(02):141-144.

基金信息:

首都医科大学附属北京天坛医院青年基金(2016-YQN-07)

发布时间:

2019-02-20

出版时间:

2019-02-20

检 索 高级检索