ALM

Evaluation of Major Online Diabetes Risk Calculators and Computerized Predictive Models

Publication Date: November 11, 2015
Journal: PLOS ONE
Authors: Gregor Stiglic & Majda Pajnkihar
Volume: 10
Issue: 11
Pages: e0142827
DOI: https://dx.plos.org/10.1371/journal.pone.0142827
Publisher URL: http://journals.plos.org/plosone/article?id=10.1371%2Fjournal.pone.0142827
PubMed: http://www.ncbi.nlm.nih.gov/pubmed/26560153
PubMed Central: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4641713
Europe PMC: http://europepmc.org/abstract/MED/26560153
Web of Science: 000364433100130
Scopus: 84955504859
Mendeley: http://www.mendeley.com/research/evaluation-major-online-diabetes-risk-calculators-computerized-predictive-models

Loading …

Events

Loading …

CiteULike15 May 21:10 UTC

CiteULike

Mendeley 2006 May 17:13 UTC

Mendeley | Further Information

{"title"=>"Evaluation of major online diabetes risk calculators and computerized predictive models", "type"=>"journal", "authors"=>[{"first_name"=>"Gregor", "last_name"=>"Stiglic", "scopus_author_id"=>"6506110486"}, {"first_name"=>"Majda", "last_name"=>"Pajnkihar", "scopus_author_id"=>"25628436300"}], "year"=>2015, "source"=>"PLoS ONE", "identifiers"=>{"sgr"=>"84955504859", "pmid"=>"26560153", "pui"=>"607878055", "isbn"=>"1932-6203", "scopus"=>"2-s2.0-84955504859", "doi"=>"10.1371/journal.pone.0142827", "issn"=>"19326203"}, "id"=>"502f443d-4508-300d-8fb1-1b020f057ed3", "abstract"=>"Classical paper-and-pencil based risk assessment questionnaires are often accompanied by the online versions of the questionnaire to reach a wider population. This study focuses on the loss, especially in risk estimation performance, that can be inflicted by direct transformation from the paper to online versions of risk estimation calculators by ignoring the possibilities of more complex and accurate calculations that can be performed using the online calculators. We empirically compare the risk estimation performance between four major diabetes risk calculators and two, more advanced, predictive models. National Health and Nutrition Examination Survey (NHANES) data from 1999-2012 was used to evaluate the performance of detecting diabetes and pre-diabetes. American Diabetes Association risk test achieved the best predictive performance in category of classical paper-and-pencil based tests with an Area Under the ROC Curve (AUC) of 0.699 for undiagnosed diabetes (0.662 for pre-diabetes) and 47% (47% for pre-diabetes) persons selected for screening. Our results demonstrate a significant difference in performance with additional benefits for a lower number of persons selected for screening when statistical methods are used. The best AUC overall was obtained in diabetes risk prediction using logistic regression with AUC of 0.775 (0.734) and an average 34% (48%) persons selected for screening. However, generalized boosted regression models might be a better option from the economical point of view as the number of selected persons for screening of 30% (47%) lies significantly lower for diabetes risk assessment in comparison to logistic regression (p < 0.001), with a significantly higher AUC (p < 0.001) of 0.774 (0.740) for the pre-diabetes group. Our results demonstrate a serious lack of predictive performance in four major online diabetes risk calculators. Therefore, one should take great care and consider optimizing the online versions of questionnaires that were primarily developed as classical paper questionnaires.", "link"=>"http://www.mendeley.com/research/evaluation-major-online-diabetes-risk-calculators-computerized-predictive-models", "reader_count"=>17, "reader_count_by_academic_status"=>{"Unspecified"=>1, "Professor > Associate Professor"=>1, "Librarian"=>1, "Student > Doctoral Student"=>1, "Researcher"=>2, "Student > Ph. D. Student"=>3, "Student > Master"=>3, "Other"=>2, "Student > Bachelor"=>2, "Lecturer"=>1}, "reader_count_by_user_role"=>{"Unspecified"=>1, "Professor > Associate Professor"=>1, "Librarian"=>1, "Student > Doctoral Student"=>1, "Researcher"=>2, "Student > Ph. D. Student"=>3, "Student > Master"=>3, "Other"=>2, "Student > Bachelor"=>2, "Lecturer"=>1}, "reader_count_by_subject_area"=>{"Unspecified"=>1, "Nursing and Health Professions"=>4, "Biochemistry, Genetics and Molecular Biology"=>1, "Agricultural and Biological Sciences"=>1, "Medicine and Dentistry"=>4, "Computer Science"=>5, "Linguistics"=>1}, "reader_count_by_subdiscipline"=>{"Medicine and Dentistry"=>{"Medicine and Dentistry"=>4}, "Agricultural and Biological Sciences"=>{"Agricultural and Biological Sciences"=>1}, "Computer Science"=>{"Computer Science"=>5}, "Nursing and Health Professions"=>{"Nursing and Health Professions"=>4}, "Linguistics"=>{"Linguistics"=>1}, "Biochemistry, Genetics and Molecular Biology"=>{"Biochemistry, Genetics and Molecular Biology"=>1}, "Unspecified"=>{"Unspecified"=>1}}, "reader_count_by_country"=>{"Spain"=>1}, "group_count"=>3}

ORCID09 May 18:12 UTC

Scopus | Further Information

{"@_fa"=>"true", "link"=>[{"@_fa"=>"true", "@ref"=>"self", "@href"=>"https://api.elsevier.com/content/abstract/scopus_id/84955504859"}, {"@_fa"=>"true", "@ref"=>"author-affiliation", "@href"=>"https://api.elsevier.com/content/abstract/scopus_id/84955504859?field=author,affiliation"}, {"@_fa"=>"true", "@ref"=>"scopus", "@href"=>"https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=84955504859&origin=inward"}, {"@_fa"=>"true", "@ref"=>"scopus-citedby", "@href"=>"https://www.scopus.com/inward/citedby.uri?partnerID=HzOxMe3b&scp=84955504859&origin=inward"}], "prism:url"=>"https://api.elsevier.com/content/abstract/scopus_id/84955504859", "dc:identifier"=>"SCOPUS_ID:84955504859", "eid"=>"2-s2.0-84955504859", "dc:title"=>"Evaluation of major online diabetes risk calculators and computerized predictive models", "dc:creator"=>"Stiglic G.", "prism:publicationName"=>"PLoS ONE", "prism:eIssn"=>"19326203", "prism:volume"=>"10", "prism:issueIdentifier"=>"11", "prism:pageRange"=>nil, "prism:coverDate"=>"2015-11-01", "prism:coverDisplayDate"=>"1 November 2015", "prism:doi"=>"10.1371/journal.pone.0142827", "citedby-count"=>"8", "affiliation"=>[{"@_fa"=>"true", "affilname"=>"Univerza v Mariboru Fakultete za Elektrotehniko, računalništvo in Informatiko", "affiliation-city"=>"Maribor", "affiliation-country"=>"Slovenia"}, {"@_fa"=>"true", "affilname"=>"Univerza v Mariboru", "affiliation-city"=>"Maribor", "affiliation-country"=>"Slovenia"}], "pubmed-id"=>"26560153", "prism:aggregationType"=>"Journal", "subtype"=>"ar", "subtypeDescription"=>"Article", "article-number"=>"e0142827", "source-id"=>"10600153309", "openaccess"=>"1", "openaccessFlag"=>true, "freetoread"=>{"value"=>[{"$"=>"all"}, {"$"=>"publisherfullgold"}, {"$"=>"repository"}, {"$"=>"repositoryvor"}, {"$"=>"repositoryam"}]}, "freetoreadLabel"=>{"value"=>[{"$"=>"All Open Access"}, {"$"=>"Gold"}, {"$"=>"Green"}]}}

Web of Science®11 Jan 09:09 UTC

{"url"=>"http%3A%2F%2Fjournals.plos.org%2Fplosone%2Farticle%3Fid%3D10.1371%252Fjournal.pone.0142827", "share_count"=>0, "like_count"=>0, "comment_count"=>0, "click_count"=>0, "total_count"=>0}

Journal Comments15 Nov 08:06 UTC

{"month"=>"11", "year"=>"2015", "pdf_views"=>"49", "xml_views"=>"11", "html_views"=>"508"}
{"month"=>"12", "year"=>"2015", "pdf_views"=>"13", "xml_views"=>"0", "html_views"=>"54"}
{"month"=>"1", "year"=>"2016", "pdf_views"=>"14", "xml_views"=>"0", "html_views"=>"77"}
{"month"=>"2", "year"=>"2016", "pdf_views"=>"2", "xml_views"=>"0", "html_views"=>"49"}
{"month"=>"3", "year"=>"2016", "pdf_views"=>"10", "xml_views"=>"0", "html_views"=>"43"}
{"month"=>"4", "year"=>"2016", "pdf_views"=>"4", "xml_views"=>"0", "html_views"=>"53"}
{"month"=>"5", "year"=>"2016", "pdf_views"=>"4", "xml_views"=>"0", "html_views"=>"18"}
{"month"=>"6", "year"=>"2016", "pdf_views"=>"11", "xml_views"=>"0", "html_views"=>"31"}
{"month"=>"7", "year"=>"2016", "pdf_views"=>"7", "xml_views"=>"0", "html_views"=>"40"}
{"month"=>"8", "year"=>"2016", "pdf_views"=>"12", "xml_views"=>"0", "html_views"=>"30"}
{"month"=>"9", "year"=>"2016", "pdf_views"=>"7", "xml_views"=>"0", "html_views"=>"31"}
{"month"=>"10", "year"=>"2016", "pdf_views"=>"5", "xml_views"=>"0", "html_views"=>"22"}
{"month"=>"11", "year"=>"2016", "pdf_views"=>"3", "xml_views"=>"0", "html_views"=>"28"}
{"month"=>"12", "year"=>"2016", "pdf_views"=>"8", "xml_views"=>"0", "html_views"=>"28"}
{"month"=>"1", "year"=>"2017", "pdf_views"=>"11", "xml_views"=>"0", "html_views"=>"37"}
{"month"=>"2", "year"=>"2017", "pdf_views"=>"5", "xml_views"=>"1", "html_views"=>"58"}
{"month"=>"3", "year"=>"2017", "pdf_views"=>"8", "xml_views"=>"0", "html_views"=>"45"}
{"month"=>"4", "year"=>"2017", "pdf_views"=>"7", "xml_views"=>"0", "html_views"=>"43"}
{"month"=>"5", "year"=>"2017", "pdf_views"=>"13", "xml_views"=>"1", "html_views"=>"83"}
{"month"=>"6", "year"=>"2017", "pdf_views"=>"4", "xml_views"=>"0", "html_views"=>"60"}
{"month"=>"7", "year"=>"2017", "pdf_views"=>"28", "xml_views"=>"2", "html_views"=>"49"}
{"month"=>"8", "year"=>"2017", "pdf_views"=>"7", "xml_views"=>"1", "html_views"=>"69"}
{"month"=>"9", "year"=>"2017", "pdf_views"=>"10", "xml_views"=>"1", "html_views"=>"47"}
{"month"=>"10", "year"=>"2017", "pdf_views"=>"7", "xml_views"=>"1", "html_views"=>"68"}
{"month"=>"11", "year"=>"2017", "pdf_views"=>"7", "xml_views"=>"0", "html_views"=>"76"}
{"month"=>"12", "year"=>"2017", "pdf_views"=>"6", "xml_views"=>"1", "html_views"=>"63"}
{"month"=>"1", "year"=>"2018", "pdf_views"=>"12", "xml_views"=>"0", "html_views"=>"59"}
{"month"=>"2", "year"=>"2018", "pdf_views"=>"18", "xml_views"=>"0", "html_views"=>"44"}
{"month"=>"3", "year"=>"2018", "pdf_views"=>"7", "xml_views"=>"1", "html_views"=>"35"}
{"month"=>"4", "year"=>"2018", "pdf_views"=>"16", "xml_views"=>"0", "html_views"=>"32"}
{"month"=>"5", "year"=>"2018", "pdf_views"=>"7", "xml_views"=>"0", "html_views"=>"14"}
{"month"=>"6", "year"=>"2018", "pdf_views"=>"6", "xml_views"=>"1", "html_views"=>"13"}
{"month"=>"7", "year"=>"2018", "pdf_views"=>"1", "xml_views"=>"3", "html_views"=>"14"}
{"month"=>"8", "year"=>"2018", "pdf_views"=>"9", "xml_views"=>"1", "html_views"=>"24"}
{"month"=>"9", "year"=>"2018", "pdf_views"=>"5", "xml_views"=>"0", "html_views"=>"66"}
{"month"=>"10", "year"=>"2018", "pdf_views"=>"6", "xml_views"=>"1", "html_views"=>"41"}
{"month"=>"11", "year"=>"2018", "pdf_views"=>"9", "xml_views"=>"0", "html_views"=>"25"}
{"month"=>"12", "year"=>"2018", "pdf_views"=>"4", "xml_views"=>"0", "html_views"=>"40"}
{"month"=>"1", "year"=>"2019", "pdf_views"=>"5", "xml_views"=>"0", "html_views"=>"16"}
{"month"=>"2", "year"=>"2019", "pdf_views"=>"8", "xml_views"=>"0", "html_views"=>"28"}
{"month"=>"3", "year"=>"2019", "pdf_views"=>"8", "xml_views"=>"0", "html_views"=>"16"}
{"month"=>"4", "year"=>"2019", "pdf_views"=>"6", "xml_views"=>"0", "html_views"=>"25"}
{"month"=>"5", "year"=>"2019", "pdf_views"=>"20", "xml_views"=>"1", "html_views"=>"25"}
{"month"=>"6", "year"=>"2019", "pdf_views"=>"13", "xml_views"=>"0", "html_views"=>"15"}
{"month"=>"7", "year"=>"2019", "pdf_views"=>"6", "xml_views"=>"4", "html_views"=>"11"}
{"month"=>"8", "year"=>"2019", "pdf_views"=>"9", "xml_views"=>"16", "html_views"=>"11"}
{"month"=>"9", "year"=>"2019", "pdf_views"=>"8", "xml_views"=>"0", "html_views"=>"14"}
{"month"=>"10", "year"=>"2019", "pdf_views"=>"18", "xml_views"=>"0", "html_views"=>"16"}
{"month"=>"11", "year"=>"2019", "pdf_views"=>"9", "xml_views"=>"1", "html_views"=>"36"}
{"month"=>"12", "year"=>"2019", "pdf_views"=>"10", "xml_views"=>"0", "html_views"=>"20"}
{"month"=>"1", "year"=>"2020", "pdf_views"=>"11", "xml_views"=>"0", "html_views"=>"11"}
{"month"=>"2", "year"=>"2020", "pdf_views"=>"13", "xml_views"=>"1", "html_views"=>"12"}
{"month"=>"3", "year"=>"2020", "pdf_views"=>"14", "xml_views"=>"0", "html_views"=>"4"}
{"month"=>"4", "year"=>"2020", "pdf_views"=>"4", "xml_views"=>"1", "html_views"=>"3"}
{"month"=>"5", "year"=>"2020", "pdf_views"=>"11", "xml_views"=>"1", "html_views"=>"7"}
{"month"=>"6", "year"=>"2020", "pdf_views"=>"8", "xml_views"=>"1", "html_views"=>"8"}
{"month"=>"7", "year"=>"2020", "pdf_views"=>"2", "xml_views"=>"0", "html_views"=>"5"}
{"month"=>"8", "year"=>"2020", "pdf_views"=>"5", "xml_views"=>"1", "html_views"=>"8"}
{"month"=>"9", "year"=>"2020", "pdf_views"=>"7", "xml_views"=>"1", "html_views"=>"6"}
{"month"=>"10", "year"=>"2020", "pdf_views"=>"8", "xml_views"=>"0", "html_views"=>"32"}
{"month"=>"11", "year"=>"2020", "pdf_views"=>"3", "xml_views"=>"0", "html_views"=>"14"}
{"month"=>"12", "year"=>"2020", "pdf_views"=>"25", "xml_views"=>"1", "html_views"=>"5"}
{"month"=>"1", "year"=>"2021", "pdf_views"=>"22", "xml_views"=>"0", "html_views"=>"9"}

Figshare 4610 May 18:47 UTC

Figshare

{"files"=>["https://ndownloader.figshare.com/files/2437305"], "description"=>"Comparison of AUC for six risk estimation approaches using all available variables.", "links"=>[], "tags"=>["risk estimation performance", "Nutrition Examination Survey", "screening", "paper questionnaires", "diabetes risk calculators", "risk assessment questionnaires", "Major Online Diabetes Risk Calculators", "nhanes", "ROC curve", "National Health", "risk estimation calculators", "diabetes risk prediction", "regression models", "auc", "diabetes risk assessment"], "article_id"=>1600738, "categories"=>["Uncategorised"], "users"=>["Gregor Stiglic", "Majda Pajnkihar"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0142827.g001", "stats"=>{"downloads"=>2, "page_views"=>6, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Comparison_of_AUC_for_six_risk_estimation_approaches_using_all_available_variables_/1600738", "title"=>"Comparison of AUC for six risk estimation approaches using all available variables.", "pos_in_sequence"=>0, "defined_type"=>1, "published_date"=>"2015-11-11 04:03:45"}
{"files"=>["https://ndownloader.figshare.com/files/2437307"], "description"=>"Comparison of AUC for six risk estimation approaches using a set of common variables.", "links"=>[], "tags"=>["risk estimation performance", "Nutrition Examination Survey", "screening", "paper questionnaires", "diabetes risk calculators", "risk assessment questionnaires", "Major Online Diabetes Risk Calculators", "nhanes", "ROC curve", "National Health", "risk estimation calculators", "diabetes risk prediction", "regression models", "auc", "diabetes risk assessment"], "article_id"=>1600740, "categories"=>["Uncategorised"], "users"=>["Gregor Stiglic", "Majda Pajnkihar"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0142827.g002", "stats"=>{"downloads"=>2, "page_views"=>4, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Comparison_of_AUC_for_six_risk_estimation_approaches_using_a_set_of_common_variables_/1600740", "title"=>"Comparison of AUC for six risk estimation approaches using a set of common variables.", "pos_in_sequence"=>0, "defined_type"=>1, "published_date"=>"2015-11-11 04:03:45"}
{"files"=>["https://ndownloader.figshare.com/files/2437309"], "description"=>"Agreement of predictive models by BMI for two classification problems.", "links"=>[], "tags"=>["risk estimation performance", "Nutrition Examination Survey", "screening", "paper questionnaires", "diabetes risk calculators", "risk assessment questionnaires", "Major Online Diabetes Risk Calculators", "nhanes", "ROC curve", "National Health", "risk estimation calculators", "diabetes risk prediction", "regression models", "auc", "diabetes risk assessment"], "article_id"=>1600742, "categories"=>["Uncategorised"], "users"=>["Gregor Stiglic", "Majda Pajnkihar"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0142827.g003", "stats"=>{"downloads"=>1, "page_views"=>0, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Agreement_of_predictive_models_by_BMI_for_two_classification_problems_/1600742", "title"=>"Agreement of predictive models by BMI for two classification problems.", "pos_in_sequence"=>0, "defined_type"=>1, "published_date"=>"2015-11-11 04:03:45"}
{"files"=>["https://ndownloader.figshare.com/files/2437310"], "description"=>"Agreement of predictive models by age for two classification problems.", "links"=>[], "tags"=>["risk estimation performance", "Nutrition Examination Survey", "screening", "paper questionnaires", "diabetes risk calculators", "risk assessment questionnaires", "Major Online Diabetes Risk Calculators", "nhanes", "ROC curve", "National Health", "risk estimation calculators", "diabetes risk prediction", "regression models", "auc", "diabetes risk assessment"], "article_id"=>1600743, "categories"=>["Uncategorised"], "users"=>["Gregor Stiglic", "Majda Pajnkihar"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0142827.g004", "stats"=>{"downloads"=>1, "page_views"=>5, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Agreement_of_predictive_models_by_age_for_two_classification_problems_/1600743", "title"=>"Agreement of predictive models by age for two classification problems.", "pos_in_sequence"=>0, "defined_type"=>1, "published_date"=>"2015-11-11 04:03:45"}
{"files"=>["https://ndownloader.figshare.com/files/2437311"], "description"=>"1Not used in the experiments due to limited availability in NHANES 1999–2012.2Used to remove individuals with already diagnosed diabetes.Variables in bold represent a set of common variables that are used in the majority of compared online calculators.", "links"=>[], "tags"=>["risk estimation performance", "Nutrition Examination Survey", "screening", "paper questionnaires", "diabetes risk calculators", "risk assessment questionnaires", "Major Online Diabetes Risk Calculators", "nhanes", "ROC curve", "National Health", "risk estimation calculators", "diabetes risk prediction", "regression models", "auc", "diabetes risk assessment"], "article_id"=>1600744, "categories"=>["Uncategorised"], "users"=>["Gregor Stiglic", "Majda Pajnkihar"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0142827.t001", "stats"=>{"downloads"=>2, "page_views"=>8, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Presence_of_questions_in_four_compared_diabetes_online_risk_calculators_with_corresponding_score_intervals_used_in_this_study_/1600744", "title"=>"Presence of questions in four compared diabetes online risk calculators with corresponding score intervals used in this study.", "pos_in_sequence"=>0, "defined_type"=>3, "published_date"=>"2015-11-11 04:03:45"}
{"files"=>["https://ndownloader.figshare.com/files/2437312"], "description"=>"MR–moderate risk, HR–high riskComparison is provided for maximal number of points a user can score, cutpoint value for high risk and number of questions in the questionnaire. Additionally, datasets used for development and validation of the model are provided along with the corresponding reported predictive performance values.", "links"=>[], "tags"=>["risk estimation performance", "Nutrition Examination Survey", "screening", "paper questionnaires", "diabetes risk calculators", "risk assessment questionnaires", "Major Online Diabetes Risk Calculators", "nhanes", "ROC curve", "National Health", "risk estimation calculators", "diabetes risk prediction", "regression models", "auc", "diabetes risk assessment"], "article_id"=>1600745, "categories"=>["Uncategorised"], "users"=>["Gregor Stiglic", "Majda Pajnkihar"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0142827.t002", "stats"=>{"downloads"=>1, "page_views"=>6, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Summary_of_questionnaires_used_in_this_study_/1600745", "title"=>"Summary of questionnaires used in this study.", "pos_in_sequence"=>0, "defined_type"=>3, "published_date"=>"2015-11-11 04:03:45"}
{"files"=>["https://ndownloader.figshare.com/files/2437313"], "description"=>"Mean Specificity, Sensitivity, PPV, NPV and Percentage of selected persons (PSP) for 1000 holdout evaluations with corresponding 95% confidence intervals for all available variables.", "links"=>[], "tags"=>["risk estimation performance", "Nutrition Examination Survey", "screening", "paper questionnaires", "diabetes risk calculators", "risk assessment questionnaires", "Major Online Diabetes Risk Calculators", "nhanes", "ROC curve", "National Health", "risk estimation calculators", "diabetes risk prediction", "regression models", "auc", "diabetes risk assessment"], "article_id"=>1600746, "categories"=>["Uncategorised"], "users"=>["Gregor Stiglic", "Majda Pajnkihar"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0142827.t004", "stats"=>{"downloads"=>0, "page_views"=>5, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Mean_Specificity_Sensitivity_PPV_NPV_and_Percentage_of_selected_persons_PSP_for_1000_holdout_evaluations_with_corresponding_95_confidence_intervals_for_all_available_variables_/1600746", "title"=>"Mean Specificity, Sensitivity, PPV, NPV and Percentage of selected persons (PSP) for 1000 holdout evaluations with corresponding 95% confidence intervals for all available variables.", "pos_in_sequence"=>0, "defined_type"=>3, "published_date"=>"2015-11-11 04:03:45"}
{"files"=>["https://ndownloader.figshare.com/files/2437314"], "description"=>"Mean Specificity, Sensitivity, PPV, NPV and Percentage of selected persons (PSP) for 1000 holdout evaluations with corresponding 95% confidence intervals for a set of common variables.", "links"=>[], "tags"=>["risk estimation performance", "Nutrition Examination Survey", "screening", "paper questionnaires", "diabetes risk calculators", "risk assessment questionnaires", "Major Online Diabetes Risk Calculators", "nhanes", "ROC curve", "National Health", "risk estimation calculators", "diabetes risk prediction", "regression models", "auc", "diabetes risk assessment"], "article_id"=>1600747, "categories"=>["Uncategorised"], "users"=>["Gregor Stiglic", "Majda Pajnkihar"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0142827.t005", "stats"=>{"downloads"=>1, "page_views"=>2, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Mean_Specificity_Sensitivity_PPV_NPV_and_Percentage_of_selected_persons_PSP_for_1000_holdout_evaluations_with_corresponding_95_confidence_intervals_for_a_set_of_common_variables_/1600747", "title"=>"Mean Specificity, Sensitivity, PPV, NPV and Percentage of selected persons (PSP) for 1000 holdout evaluations with corresponding 95% confidence intervals for a set of common variables.", "pos_in_sequence"=>0, "defined_type"=>3, "published_date"=>"2015-11-11 04:03:45"}

PMC Usage Stats 123817 Jan 23:05 UTC

PMC Usage Stats | Further Information

{"unique-ip"=>"8", "full-text"=>"12", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"2"}
{"unique-ip"=>"8", "full-text"=>"6", "pdf"=>"5", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"11"}
{"unique-ip"=>"19", "full-text"=>"16", "pdf"=>"10", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"12"}
{"unique-ip"=>"15", "full-text"=>"12", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"1"}
{"unique-ip"=>"13", "full-text"=>"14", "pdf"=>"6", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"3"}
{"unique-ip"=>"18", "full-text"=>"16", "pdf"=>"7", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"4"}
{"unique-ip"=>"12", "full-text"=>"13", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"5"}
{"unique-ip"=>"9", "full-text"=>"9", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"6"}
{"unique-ip"=>"12", "full-text"=>"10", "pdf"=>"7", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"7"}
{"unique-ip"=>"9", "full-text"=>"12", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"8"}
{"unique-ip"=>"14", "full-text"=>"15", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"3", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"9"}
{"unique-ip"=>"12", "full-text"=>"12", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"10"}
{"unique-ip"=>"3", "full-text"=>"3", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"11"}
{"unique-ip"=>"2", "full-text"=>"2", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"12"}
{"unique-ip"=>"14", "full-text"=>"9", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"1"}
{"unique-ip"=>"7", "full-text"=>"8", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"2"}
{"unique-ip"=>"6", "full-text"=>"5", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"3"}
{"unique-ip"=>"9", "full-text"=>"8", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"4"}
{"unique-ip"=>"8", "full-text"=>"10", "pdf"=>"6", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"6", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"5"}
{"unique-ip"=>"17", "full-text"=>"20", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"6"}
{"unique-ip"=>"9", "full-text"=>"11", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"7"}
{"unique-ip"=>"11", "full-text"=>"13", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"8"}
{"unique-ip"=>"21", "full-text"=>"25", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"9"}
{"unique-ip"=>"15", "full-text"=>"15", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"10"}
{"unique-ip"=>"13", "full-text"=>"17", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"4", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"11"}
{"unique-ip"=>"17", "full-text"=>"19", "pdf"=>"6", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"12"}
{"unique-ip"=>"10", "full-text"=>"11", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"1"}
{"unique-ip"=>"16", "full-text"=>"17", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"3"}
{"unique-ip"=>"24", "full-text"=>"29", "pdf"=>"7", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"1"}
{"unique-ip"=>"29", "full-text"=>"30", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"12"}
{"unique-ip"=>"25", "full-text"=>"30", "pdf"=>"5", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"1", "year"=>"2018", "month"=>"9"}
{"unique-ip"=>"22", "full-text"=>"24", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"4"}
{"unique-ip"=>"13", "full-text"=>"13", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"2", "year"=>"2018", "month"=>"5"}
{"unique-ip"=>"18", "full-text"=>"22", "pdf"=>"2", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"1", "year"=>"2018", "month"=>"6"}
{"unique-ip"=>"15", "full-text"=>"15", "pdf"=>"2", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"7"}
{"unique-ip"=>"26", "full-text"=>"29", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"8"}
{"unique-ip"=>"23", "full-text"=>"22", "pdf"=>"4", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"1", "year"=>"2018", "month"=>"10"}
{"unique-ip"=>"21", "full-text"=>"24", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"11"}
{"unique-ip"=>"27", "full-text"=>"30", "pdf"=>"3", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"2"}
{"unique-ip"=>"24", "full-text"=>"23", "pdf"=>"3", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"3"}
{"unique-ip"=>"18", "full-text"=>"21", "pdf"=>"3", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"4"}
{"unique-ip"=>"18", "full-text"=>"23", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"5"}
{"unique-ip"=>"17", "full-text"=>"17", "pdf"=>"4", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"8"}
{"unique-ip"=>"19", "full-text"=>"23", "pdf"=>"4", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"9"}
{"unique-ip"=>"15", "full-text"=>"17", "pdf"=>"3", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"10"}
{"unique-ip"=>"11", "full-text"=>"11", "pdf"=>"4", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"12"}
{"unique-ip"=>"27", "full-text"=>"28", "pdf"=>"3", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2020", "month"=>"2"}
{"unique-ip"=>"17", "full-text"=>"21", "pdf"=>"2", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2020", "month"=>"3"}
{"unique-ip"=>"28", "full-text"=>"30", "pdf"=>"6", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2020", "month"=>"4"}
{"unique-ip"=>"32", "full-text"=>"35", "pdf"=>"3", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2020", "month"=>"5"}
{"unique-ip"=>"36", "full-text"=>"38", "pdf"=>"9", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2020", "month"=>"6"}
{"unique-ip"=>"18", "full-text"=>"23", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2020", "month"=>"7"}
{"unique-ip"=>"13", "full-text"=>"14", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2020", "month"=>"8"}
{"unique-ip"=>"22", "full-text"=>"30", "pdf"=>"3", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"6", "supp-data"=>"0", "cited-by"=>"1", "year"=>"2020", "month"=>"9"}
{"unique-ip"=>"27", "full-text"=>"43", "pdf"=>"7", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2020", "month"=>"10"}
{"unique-ip"=>"16", "full-text"=>"16", "pdf"=>"4", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2020", "month"=>"11"}
{"unique-ip"=>"20", "full-text"=>"17", "pdf"=>"4", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2020", "month"=>"12"}

Relative Metric10 May 18:17 UTC

Relative Metric

{"start_date"=>"2015-01-01T00:00:00Z", "end_date"=>"2015-12-31T00:00:00Z", "subject_areas"=>[]}

F1000Prime20 Jan 13:55 UTC

F1000Prime

Loading …

There are currently no alerts

CiteULike

Mendeley | Further Information

ORCID

CrossRef

DataCite

Europe PMC Citations

Europe PMC Database Citations

PubMed Central

Scopus | Further Information

Web of Science® | Further Information

Article Coverage

Article Coverage Curated

Facebook

Journal Comments

Nature

Reddit

Research Blogging

ScienceSeeker

Twitter

Wikipedia

Wordpress.com

Counter

Figshare

PMC Usage Stats | Further Information

Relative Metric

F1000Prime