Accurate Computation of Survival Statistics in Genome-Wide Studies
Publication Date
May 07, 2015
Journal
PLOS Computational Biology
Authors
Fabio Vandin, Alexandra Papoutsaki, Benjamin J. Raphael & Eli Upfal
Volume
11
Issue
5
Pages
e1004071
DOI
https://dx.plos.org/10.1371/journal.pcbi.1004071
Publisher URL
http://journals.plos.org/ploscompbiol/article?id=10.1371%2Fjournal.pcbi.1004071
PubMed
http://www.ncbi.nlm.nih.gov/pubmed/25950620
PubMed Central
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4423942
Europe PMC
http://europepmc.org/abstract/MED/25950620
Web of Science
000356700200001
Scopus
84930599346
Mendeley
http://www.mendeley.com/research/accurate-computation-survival-statistics-genomewide-studies
Events
Loading … Spinner

Mendeley | Further Information

{"title"=>"Accurate Computation of Survival Statistics in Genome-Wide Studies", "type"=>"journal", "authors"=>[{"first_name"=>"Fabio", "last_name"=>"Vandin", "scopus_author_id"=>"23399209100"}, {"first_name"=>"Alexandra", "last_name"=>"Papoutsaki", "scopus_author_id"=>"55634314200"}, {"first_name"=>"Benjamin J.", "last_name"=>"Raphael", "scopus_author_id"=>"8848793700"}, {"first_name"=>"Eli", "last_name"=>"Upfal", "scopus_author_id"=>"7006574952"}], "year"=>2015, "source"=>"PLoS Computational Biology", "identifiers"=>{"pmid"=>"25950620", "doi"=>"10.1371/journal.pcbi.1004071", "sgr"=>"84930599346", "arxiv"=>"1309.4286", "scopus"=>"2-s2.0-84930599346", "issn"=>"15537358", "pui"=>"604784540"}, "id"=>"d75fb75d-587e-3a49-8e0a-aee00cc14101", "abstract"=>"A key challenge in genomics is to identify genetic variants that distinguish patients with different survival time following diagnosis or treatment. While the log-rank test is widely used for this purpose, nearly all implementations of the log-rank test rely on an asymptotic approximation that is not appropriate in many genomics applications. This is because: the two populations determined by a genetic variant may have very different sizes; and the evaluation of many possible variants demands highly accurate computation of very small p-values. We demonstrate this problem for cancer genomics data where the standard log-rank test leads to many false positive associations between somatic mutations and survival time. We develop and analyze a novel algorithm, Exact Log-rank Test (ExaLT), that accurately computes the p-value of the log-rank statistic under an exact distribution that is appropriate for any size populations. We demonstrate the advantages of ExaLT on data from published cancer genomics studies, finding significant differences from the reported p-values. We analyze somatic mutations in six cancer types from The Cancer Genome Atlas (TCGA), finding mutations with known association to survival as well as several novel associations. In contrast, standard implementations of the log-rank test report dozens-hundreds of likely false positive associations as more significant than these known associations.", "link"=>"http://www.mendeley.com/research/accurate-computation-survival-statistics-genomewide-studies", "reader_count"=>43, "reader_count_by_academic_status"=>{"Unspecified"=>3, "Professor > Associate Professor"=>3, "Researcher"=>17, "Student > Ph. D. Student"=>12, "Student > Master"=>1, "Other"=>1, "Student > Bachelor"=>3, "Professor"=>3}, "reader_count_by_user_role"=>{"Unspecified"=>3, "Professor > Associate Professor"=>3, "Researcher"=>17, "Student > Ph. D. Student"=>12, "Student > Master"=>1, "Other"=>1, "Student > Bachelor"=>3, "Professor"=>3}, "reader_count_by_subject_area"=>{"Unspecified"=>3, "Engineering"=>2, "Biochemistry, Genetics and Molecular Biology"=>10, "Agricultural and Biological Sciences"=>17, "Medicine and Dentistry"=>5, "Physics and Astronomy"=>2, "Computer Science"=>4}, "reader_count_by_subdiscipline"=>{"Engineering"=>{"Engineering"=>2}, "Medicine and Dentistry"=>{"Medicine and Dentistry"=>5}, "Physics and Astronomy"=>{"Physics and Astronomy"=>2}, "Agricultural and Biological Sciences"=>{"Agricultural and Biological Sciences"=>17}, "Computer Science"=>{"Computer Science"=>4}, "Biochemistry, Genetics and Molecular Biology"=>{"Biochemistry, Genetics and Molecular Biology"=>10}, "Unspecified"=>{"Unspecified"=>3}}, "reader_count_by_country"=>{"Canada"=>1, "Venezuela"=>1, "Netherlands"=>1, "United States"=>3, "Brazil"=>1, "Australia"=>1}, "group_count"=>3}

Scopus | Further Information

{"@_fa"=>"true", "link"=>[{"@_fa"=>"true", "@ref"=>"self", "@href"=>"https://api.elsevier.com/content/abstract/scopus_id/84930599346"}, {"@_fa"=>"true", "@ref"=>"author-affiliation", "@href"=>"https://api.elsevier.com/content/abstract/scopus_id/84930599346?field=author,affiliation"}, {"@_fa"=>"true", "@ref"=>"scopus", "@href"=>"https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=84930599346&origin=inward"}, {"@_fa"=>"true", "@ref"=>"scopus-citedby", "@href"=>"https://www.scopus.com/inward/citedby.uri?partnerID=HzOxMe3b&scp=84930599346&origin=inward"}], "prism:url"=>"https://api.elsevier.com/content/abstract/scopus_id/84930599346", "dc:identifier"=>"SCOPUS_ID:84930599346", "eid"=>"2-s2.0-84930599346", "dc:title"=>"Accurate Computation of Survival Statistics in Genome-Wide Studies", "dc:creator"=>"Vandin F.", "prism:publicationName"=>"PLoS Computational Biology", "prism:issn"=>"1553734X", "prism:eIssn"=>"15537358", "prism:volume"=>"11", "prism:issueIdentifier"=>"5", "prism:pageRange"=>nil, "prism:coverDate"=>"2015-01-01", "prism:coverDisplayDate"=>"1 May 2015", "prism:doi"=>"10.1371/journal.pcbi.1004071", "citedby-count"=>"12", "affiliation"=>[{"@_fa"=>"true", "affilname"=>"Syddansk Universitet", "affiliation-city"=>"Odense", "affiliation-country"=>"Denmark"}, {"@_fa"=>"true", "affilname"=>"Brown University", "affiliation-city"=>"Providence", "affiliation-country"=>"United States"}], "pubmed-id"=>"25950620", "prism:aggregationType"=>"Journal", "subtype"=>"ar", "subtypeDescription"=>"Article", "article-number"=>"e1004071", "source-id"=>"4000151810", "openaccess"=>"1", "openaccessFlag"=>true}

Facebook

  • {"url"=>"http%3A%2F%2Fjournals.plos.org%2Fploscompbiol%2Farticle%3Fid%3D10.1371%252Fjournal.pcbi.1004071", "share_count"=>1, "like_count"=>0, "comment_count"=>0, "click_count"=>0, "total_count"=>1}

Counter

  • {"month"=>"5", "year"=>"2015", "pdf_views"=>"194", "xml_views"=>"7", "html_views"=>"1709"}
  • {"month"=>"6", "year"=>"2015", "pdf_views"=>"59", "xml_views"=>"1", "html_views"=>"296"}
  • {"month"=>"7", "year"=>"2015", "pdf_views"=>"13", "xml_views"=>"0", "html_views"=>"93"}
  • {"month"=>"8", "year"=>"2015", "pdf_views"=>"22", "xml_views"=>"0", "html_views"=>"70"}
  • {"month"=>"9", "year"=>"2015", "pdf_views"=>"20", "xml_views"=>"0", "html_views"=>"87"}
  • {"month"=>"10", "year"=>"2015", "pdf_views"=>"18", "xml_views"=>"0", "html_views"=>"63"}
  • {"month"=>"11", "year"=>"2015", "pdf_views"=>"10", "xml_views"=>"1", "html_views"=>"62"}
  • {"month"=>"12", "year"=>"2015", "pdf_views"=>"10", "xml_views"=>"0", "html_views"=>"60"}
  • {"month"=>"1", "year"=>"2016", "pdf_views"=>"16", "xml_views"=>"0", "html_views"=>"80"}
  • {"month"=>"2", "year"=>"2016", "pdf_views"=>"9", "xml_views"=>"0", "html_views"=>"45"}
  • {"month"=>"3", "year"=>"2016", "pdf_views"=>"9", "xml_views"=>"0", "html_views"=>"50"}
  • {"month"=>"4", "year"=>"2016", "pdf_views"=>"21", "xml_views"=>"0", "html_views"=>"50"}
  • {"month"=>"5", "year"=>"2016", "pdf_views"=>"9", "xml_views"=>"0", "html_views"=>"62"}
  • {"month"=>"6", "year"=>"2016", "pdf_views"=>"7", "xml_views"=>"0", "html_views"=>"75"}
  • {"month"=>"7", "year"=>"2016", "pdf_views"=>"9", "xml_views"=>"0", "html_views"=>"28"}
  • {"month"=>"8", "year"=>"2016", "pdf_views"=>"17", "xml_views"=>"0", "html_views"=>"46"}
  • {"month"=>"9", "year"=>"2016", "pdf_views"=>"20", "xml_views"=>"0", "html_views"=>"40"}
  • {"month"=>"10", "year"=>"2016", "pdf_views"=>"17", "xml_views"=>"0", "html_views"=>"31"}
  • {"month"=>"11", "year"=>"2016", "pdf_views"=>"7", "xml_views"=>"0", "html_views"=>"50"}
  • {"month"=>"12", "year"=>"2016", "pdf_views"=>"18", "xml_views"=>"0", "html_views"=>"32"}
  • {"month"=>"1", "year"=>"2017", "pdf_views"=>"5", "xml_views"=>"1", "html_views"=>"25"}
  • {"month"=>"2", "year"=>"2017", "pdf_views"=>"4", "xml_views"=>"0", "html_views"=>"28"}
  • {"month"=>"3", "year"=>"2017", "pdf_views"=>"15", "xml_views"=>"0", "html_views"=>"49"}
  • {"month"=>"4", "year"=>"2017", "pdf_views"=>"11", "xml_views"=>"0", "html_views"=>"45"}
  • {"month"=>"5", "year"=>"2017", "pdf_views"=>"20", "xml_views"=>"1", "html_views"=>"55"}
  • {"month"=>"6", "year"=>"2017", "pdf_views"=>"8", "xml_views"=>"1", "html_views"=>"47"}
  • {"month"=>"7", "year"=>"2017", "pdf_views"=>"5", "xml_views"=>"0", "html_views"=>"46"}
  • {"month"=>"8", "year"=>"2017", "pdf_views"=>"16", "xml_views"=>"0", "html_views"=>"44"}
  • {"month"=>"9", "year"=>"2017", "pdf_views"=>"16", "xml_views"=>"2", "html_views"=>"24"}
  • {"month"=>"10", "year"=>"2017", "pdf_views"=>"12", "xml_views"=>"0", "html_views"=>"46"}
  • {"month"=>"11", "year"=>"2017", "pdf_views"=>"11", "xml_views"=>"0", "html_views"=>"61"}
  • {"month"=>"12", "year"=>"2017", "pdf_views"=>"10", "xml_views"=>"1", "html_views"=>"24"}
  • {"month"=>"1", "year"=>"2018", "pdf_views"=>"16", "xml_views"=>"2", "html_views"=>"33"}
  • {"month"=>"2", "year"=>"2018", "pdf_views"=>"4", "xml_views"=>"0", "html_views"=>"9"}
  • {"month"=>"3", "year"=>"2018", "pdf_views"=>"13", "xml_views"=>"0", "html_views"=>"23"}
  • {"month"=>"4", "year"=>"2018", "pdf_views"=>"5", "xml_views"=>"1", "html_views"=>"16"}
  • {"month"=>"5", "year"=>"2018", "pdf_views"=>"4", "xml_views"=>"0", "html_views"=>"9"}
  • {"month"=>"6", "year"=>"2018", "pdf_views"=>"9", "xml_views"=>"0", "html_views"=>"25"}
  • {"month"=>"7", "year"=>"2018", "pdf_views"=>"16", "xml_views"=>"3", "html_views"=>"30"}
  • {"month"=>"8", "year"=>"2018", "pdf_views"=>"7", "xml_views"=>"1", "html_views"=>"21"}
  • {"month"=>"9", "year"=>"2018", "pdf_views"=>"15", "xml_views"=>"0", "html_views"=>"13"}
  • {"month"=>"10", "year"=>"2018", "pdf_views"=>"9", "xml_views"=>"2", "html_views"=>"21"}
  • {"month"=>"11", "year"=>"2018", "pdf_views"=>"5", "xml_views"=>"0", "html_views"=>"19"}
  • {"month"=>"12", "year"=>"2018", "pdf_views"=>"5", "xml_views"=>"0", "html_views"=>"15"}
  • {"month"=>"1", "year"=>"2019", "pdf_views"=>"5", "xml_views"=>"0", "html_views"=>"19"}
  • {"month"=>"2", "year"=>"2019", "pdf_views"=>"3", "xml_views"=>"0", "html_views"=>"8"}
  • {"month"=>"3", "year"=>"2019", "pdf_views"=>"1", "xml_views"=>"3", "html_views"=>"10"}
  • {"month"=>"4", "year"=>"2019", "pdf_views"=>"7", "xml_views"=>"0", "html_views"=>"20"}
  • {"month"=>"5", "year"=>"2019", "pdf_views"=>"5", "xml_views"=>"0", "html_views"=>"33"}
  • {"month"=>"6", "year"=>"2019", "pdf_views"=>"6", "xml_views"=>"0", "html_views"=>"30"}
  • {"month"=>"7", "year"=>"2019", "pdf_views"=>"9", "xml_views"=>"0", "html_views"=>"17"}
  • {"month"=>"8", "year"=>"2019", "pdf_views"=>"10", "xml_views"=>"0", "html_views"=>"19"}
  • {"month"=>"9", "year"=>"2019", "pdf_views"=>"13", "xml_views"=>"0", "html_views"=>"14"}
  • {"month"=>"10", "year"=>"2019", "pdf_views"=>"6", "xml_views"=>"0", "html_views"=>"9"}
  • {"month"=>"11", "year"=>"2019", "pdf_views"=>"12", "xml_views"=>"0", "html_views"=>"15"}
  • {"month"=>"12", "year"=>"2019", "pdf_views"=>"5", "xml_views"=>"0", "html_views"=>"19"}
  • {"month"=>"1", "year"=>"2020", "pdf_views"=>"12", "xml_views"=>"0", "html_views"=>"23"}
  • {"month"=>"2", "year"=>"2020", "pdf_views"=>"8", "xml_views"=>"1", "html_views"=>"26"}
  • {"month"=>"3", "year"=>"2020", "pdf_views"=>"13", "xml_views"=>"0", "html_views"=>"15"}
  • {"month"=>"4", "year"=>"2020", "pdf_views"=>"18", "xml_views"=>"0", "html_views"=>"12"}
  • {"month"=>"5", "year"=>"2020", "pdf_views"=>"19", "xml_views"=>"0", "html_views"=>"12"}
  • {"month"=>"6", "year"=>"2020", "pdf_views"=>"12", "xml_views"=>"0", "html_views"=>"31"}
  • {"month"=>"7", "year"=>"2020", "pdf_views"=>"8", "xml_views"=>"3", "html_views"=>"5"}
  • {"month"=>"8", "year"=>"2020", "pdf_views"=>"15", "xml_views"=>"2", "html_views"=>"16"}
  • {"month"=>"9", "year"=>"2020", "pdf_views"=>"15", "xml_views"=>"0", "html_views"=>"14"}
  • {"month"=>"10", "year"=>"2020", "pdf_views"=>"17", "xml_views"=>"0", "html_views"=>"12"}
  • {"month"=>"11", "year"=>"2020", "pdf_views"=>"12", "xml_views"=>"0", "html_views"=>"27"}

Figshare

  • {"files"=>["https://ndownloader.figshare.com/files/2059300"], "description"=>"<p>Each data point represents a gene. (A) Comparison of the Rsurvdiff<i>p</i>-values and the exact permutational <i>p</i>-values for the GBM dataset. (B) Comparison of the Rsurvdiff<i>p</i>-values and the exact permutational <i>p</i>-values for the OV dataset.</p>", "links"=>[], "tags"=>["Cancer Genome Atlas", "cancer genomics studies", "implementation", "survival time", "mutation", "variant", "ExaLT", "association", "TCGA", "cancer genomics data"], "article_id"=>1408049, "categories"=>["Biological Sciences"], "users"=>["Fabio Vandin", "Alexandra Papoutsaki", "Benjamin J. Raphael", "Eli Upfal"], "doi"=>"https://dx.doi.org/10.1371/journal.pcbi.1004071.g003", "stats"=>{"downloads"=>3, "page_views"=>73, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Comparison_of_the_p_values_of_association_between_somatic_mutations_and_survival_time_for_TCGA_glioblastoma_GBM_and_ovarian_OV_datasets_/1408049", "title"=>"Comparison of the <i>p</i>-values of association between somatic mutations and survival time for TCGA glioblastoma (GBM) and ovarian (OV) datasets.", "pos_in_sequence"=>0, "defined_type"=>1, "published_date"=>"2015-05-07 03:25:55"}
  • {"files"=>["https://ndownloader.figshare.com/files/2059306", "https://ndownloader.figshare.com/files/2059307", "https://ndownloader.figshare.com/files/2059308", "https://ndownloader.figshare.com/files/2059309", "https://ndownloader.figshare.com/files/2059310", "https://ndownloader.figshare.com/files/2059311", "https://ndownloader.figshare.com/files/2059312", "https://ndownloader.figshare.com/files/2059313", "https://ndownloader.figshare.com/files/2059314", "https://ndownloader.figshare.com/files/2059315", "https://ndownloader.figshare.com/files/2059317", "https://ndownloader.figshare.com/files/2059318", "https://ndownloader.figshare.com/files/2059319"], "description"=>"<div><p>A key challenge in genomics is to identify genetic variants that distinguish patients with different <i>survival time</i> following diagnosis or treatment. While the log-rank test is widely used for this purpose, nearly all implementations of the log-rank test rely on an asymptotic approximation that is not appropriate in many genomics applications. This is because: the two populations determined by a genetic variant may have very different sizes; and the evaluation of many possible variants demands highly accurate computation of very small <i>p</i>-values. We demonstrate this problem for cancer genomics data where the standard log-rank test leads to many false positive associations between somatic mutations and survival time. We develop and analyze a novel algorithm, Exact Log-rank Test (ExaLT), that accurately computes the <i>p</i>-value of the log-rank statistic under an exact distribution that is appropriate for any size populations. We demonstrate the advantages of ExaLT on data from published cancer genomics studies, finding significant differences from the reported <i>p</i>-values. We analyze somatic mutations in six cancer types from The Cancer Genome Atlas (TCGA), finding mutations with known association to survival as well as several novel associations. In contrast, standard implementations of the log-rank test report dozens-hundreds of likely false positive associations as more significant than these known associations.</p></div>", "links"=>[], "tags"=>["Cancer Genome Atlas", "cancer genomics studies", "implementation", "survival time", "mutation", "variant", "ExaLT", "association", "TCGA", "cancer genomics data"], "article_id"=>1408055, "categories"=>["Biological Sciences"], "users"=>["Fabio Vandin", "Alexandra Papoutsaki", "Benjamin J. Raphael", "Eli Upfal"], "doi"=>["https://dx.doi.org/10.1371/journal.pcbi.1004071.s001", "https://dx.doi.org/10.1371/journal.pcbi.1004071.s002", "https://dx.doi.org/10.1371/journal.pcbi.1004071.s003", "https://dx.doi.org/10.1371/journal.pcbi.1004071.s004", "https://dx.doi.org/10.1371/journal.pcbi.1004071.s005", "https://dx.doi.org/10.1371/journal.pcbi.1004071.s006", "https://dx.doi.org/10.1371/journal.pcbi.1004071.s007", "https://dx.doi.org/10.1371/journal.pcbi.1004071.s008", "https://dx.doi.org/10.1371/journal.pcbi.1004071.s009", "https://dx.doi.org/10.1371/journal.pcbi.1004071.s010", "https://dx.doi.org/10.1371/journal.pcbi.1004071.s011", "https://dx.doi.org/10.1371/journal.pcbi.1004071.s012", "https://dx.doi.org/10.1371/journal.pcbi.1004071.s013"], "stats"=>{"downloads"=>45, "page_views"=>14, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Accurate_Computation_of_Survival_Statistics_in_Genome_Wide_Studies_/1408055", "title"=>"Accurate Computation of Survival Statistics in Genome-Wide Studies", "pos_in_sequence"=>0, "defined_type"=>4, "published_date"=>"2015-05-07 03:25:55"}
  • {"files"=>["https://ndownloader.figshare.com/files/2059296"], "description"=>"<p>(A) In a typical clinical study, two pre-selected groups of similar size are compared. Because the groups are balanced and each has a suitable number of patients, the asymptotic approximation (normal distribution) used in common implementations of the log-rank test gives an accurate approximation of the exact distribution, resulting in accurate <i>p</i>-values. (B) In a genomics study, the two groups are defined by a genetic variant. In many cases, the sizes of the groups are unbalanced, with one group being much larger than the other. In this situation, the asymptotic distribution does not accurately approximate the exact distribution of the log-rank statistic, and the resulting <i>p</i>-values computed from the tail of the distribution (see inset) are inaccurate.</p>", "links"=>[], "tags"=>["Cancer Genome Atlas", "cancer genomics studies", "implementation", "survival time", "mutation", "variant", "ExaLT", "association", "TCGA", "cancer genomics data"], "article_id"=>1408046, "categories"=>["Biological Sciences"], "users"=>["Fabio Vandin", "Alexandra Papoutsaki", "Benjamin J. Raphael", "Eli Upfal"], "doi"=>"https://dx.doi.org/10.1371/journal.pcbi.1004071.g001", "stats"=>{"downloads"=>2, "page_views"=>19, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Difference_between_survival_analysis_in_a_clinical_setting_with_balanced_populations_and_genomics_setting_with_unbalanced_populations_/1408046", "title"=>"Difference between survival analysis in a clinical setting with balanced populations and genomics setting, with unbalanced populations.", "pos_in_sequence"=>0, "defined_type"=>1, "published_date"=>"2015-05-07 03:25:55"}
  • {"files"=>["https://ndownloader.figshare.com/files/2059298"], "description"=>"<p>The <i>p</i>-values for the genes should be distributed uniformly (green line), since there is no association between mutations and survival in this random data. Asymptotic approximations of the log-rank statistic (purple and blue) yield <i>p</i>-values that deviate significantly from the uniform distribution, incorrectly reporting many genes whose mutations are significantly associated with survival. In particular, the asymptotic log-rank test in R reports 110 genes with significant association, using a Bonferroni corrected <i>p</i>-value < 0.05 (black line), or 291 genes with significant association using a less conservative FDR = 0.05. In contrast, the exact test makes no false discoveries.</p>", "links"=>[], "tags"=>["Cancer Genome Atlas", "cancer genomics studies", "implementation", "survival time", "mutation", "variant", "ExaLT", "association", "TCGA", "cancer genomics data"], "article_id"=>1408047, "categories"=>["Biological Sciences"], "users"=>["Fabio Vandin", "Alexandra Papoutsaki", "Benjamin J. Raphael", "Eli Upfal"], "doi"=>"https://dx.doi.org/10.1371/journal.pcbi.1004071.g002", "stats"=>{"downloads"=>2, "page_views"=>19, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Differences_between_observed_and_expected_p_values_from_different_forms_of_the_log_rank_test_on_a_randomized_cancer_dataset_consisting_of_somatic_mutations_in_6184_genes_/1408047", "title"=>"Differences between observed and expected <i>p</i>-values from different forms of the log-rank test on a randomized cancer dataset consisting of somatic mutations in 6184 genes.", "pos_in_sequence"=>0, "defined_type"=>1, "published_date"=>"2015-05-07 03:25:55"}

PMC Usage Stats | Further Information

  • {"unique-ip"=>"13", "full-text"=>"15", "pdf"=>"7", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"7", "cited-by"=>"0", "year"=>"2015", "month"=>"5"}
  • {"unique-ip"=>"16", "full-text"=>"15", "pdf"=>"9", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"6"}
  • {"unique-ip"=>"10", "full-text"=>"9", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"7"}
  • {"unique-ip"=>"7", "full-text"=>"6", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2015", "month"=>"8"}
  • {"unique-ip"=>"16", "full-text"=>"14", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"9"}
  • {"unique-ip"=>"7", "full-text"=>"7", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"10"}
  • {"unique-ip"=>"19", "full-text"=>"11", "pdf"=>"10", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"11"}
  • {"unique-ip"=>"20", "full-text"=>"7", "pdf"=>"17", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"12"}
  • {"unique-ip"=>"12", "full-text"=>"9", "pdf"=>"6", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"1"}
  • {"unique-ip"=>"7", "full-text"=>"6", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"2"}
  • {"unique-ip"=>"8", "full-text"=>"7", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"6", "supp-data"=>"2", "cited-by"=>"0", "year"=>"2016", "month"=>"3"}
  • {"unique-ip"=>"4", "full-text"=>"4", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"4"}
  • {"unique-ip"=>"19", "full-text"=>"22", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"3", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2016", "month"=>"5"}
  • {"unique-ip"=>"9", "full-text"=>"11", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"2", "cited-by"=>"0", "year"=>"2016", "month"=>"6"}
  • {"unique-ip"=>"3", "full-text"=>"2", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"7"}
  • {"unique-ip"=>"10", "full-text"=>"12", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"8"}
  • {"unique-ip"=>"6", "full-text"=>"9", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"9"}
  • {"unique-ip"=>"10", "full-text"=>"10", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"10"}
  • {"unique-ip"=>"16", "full-text"=>"18", "pdf"=>"5", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"3", "supp-data"=>"10", "cited-by"=>"0", "year"=>"2016", "month"=>"11"}
  • {"unique-ip"=>"9", "full-text"=>"5", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"12"}
  • {"unique-ip"=>"6", "full-text"=>"5", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"1", "year"=>"2017", "month"=>"1"}
  • {"unique-ip"=>"3", "full-text"=>"3", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"2"}
  • {"unique-ip"=>"10", "full-text"=>"9", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"3"}
  • {"unique-ip"=>"3", "full-text"=>"2", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"4"}
  • {"unique-ip"=>"11", "full-text"=>"10", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"3", "cited-by"=>"0", "year"=>"2017", "month"=>"5"}
  • {"unique-ip"=>"5", "full-text"=>"4", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"2", "year"=>"2017", "month"=>"6"}
  • {"unique-ip"=>"11", "full-text"=>"14", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"4", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2017", "month"=>"7"}
  • {"unique-ip"=>"9", "full-text"=>"8", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"8"}
  • {"unique-ip"=>"5", "full-text"=>"4", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"9"}
  • {"unique-ip"=>"6", "full-text"=>"4", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"0", "cited-by"=>"1", "year"=>"2017", "month"=>"10"}
  • {"unique-ip"=>"6", "full-text"=>"9", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"11"}
  • {"unique-ip"=>"14", "full-text"=>"9", "pdf"=>"5", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"6", "cited-by"=>"0", "year"=>"2017", "month"=>"12"}
  • {"unique-ip"=>"3", "full-text"=>"2", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"1"}
  • {"unique-ip"=>"7", "full-text"=>"13", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"3", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"3"}
  • {"unique-ip"=>"7", "full-text"=>"6", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"4", "cited-by"=>"0", "year"=>"2019", "month"=>"1"}
  • {"unique-ip"=>"9", "full-text"=>"8", "pdf"=>"2", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"5"}
  • {"unique-ip"=>"33", "full-text"=>"14", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"3", "supp-data"=>"13", "cited-by"=>"1", "year"=>"2018", "month"=>"4"}
  • {"unique-ip"=>"9", "full-text"=>"10", "pdf"=>"4", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"9", "cited-by"=>"1", "year"=>"2018", "month"=>"6"}
  • {"unique-ip"=>"21", "full-text"=>"15", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"7", "cited-by"=>"0", "year"=>"2018", "month"=>"7"}
  • {"unique-ip"=>"2", "full-text"=>"4", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"8"}
  • {"unique-ip"=>"9", "full-text"=>"10", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"1", "year"=>"2018", "month"=>"9"}
  • {"unique-ip"=>"5", "full-text"=>"4", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"10"}
  • {"unique-ip"=>"6", "full-text"=>"6", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"13", "cited-by"=>"0", "year"=>"2018", "month"=>"11"}
  • {"unique-ip"=>"10", "full-text"=>"7", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"11", "cited-by"=>"0", "year"=>"2018", "month"=>"12"}
  • {"unique-ip"=>"4", "full-text"=>"4", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"2"}
  • {"unique-ip"=>"9", "full-text"=>"8", "pdf"=>"3", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"2", "cited-by"=>"0", "year"=>"2019", "month"=>"3"}
  • {"unique-ip"=>"6", "full-text"=>"5", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"4"}
  • {"unique-ip"=>"8", "full-text"=>"10", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"1", "year"=>"2019", "month"=>"5"}
  • {"unique-ip"=>"4", "full-text"=>"3", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"8"}
  • {"unique-ip"=>"14", "full-text"=>"11", "pdf"=>"2", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"13", "cited-by"=>"0", "year"=>"2019", "month"=>"9"}
  • {"unique-ip"=>"12", "full-text"=>"11", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"10"}
  • {"unique-ip"=>"10", "full-text"=>"6", "pdf"=>"4", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"12"}
  • {"unique-ip"=>"10", "full-text"=>"8", "pdf"=>"3", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"2", "year"=>"2020", "month"=>"2"}
  • {"unique-ip"=>"8", "full-text"=>"9", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2020", "month"=>"3"}
  • {"unique-ip"=>"8", "full-text"=>"7", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2020", "month"=>"4"}
  • {"unique-ip"=>"20", "full-text"=>"12", "pdf"=>"3", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"11", "cited-by"=>"0", "year"=>"2020", "month"=>"5"}
  • {"unique-ip"=>"10", "full-text"=>"11", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2020", "month"=>"6"}
  • {"unique-ip"=>"5", "full-text"=>"4", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2020", "month"=>"7"}
  • {"unique-ip"=>"7", "full-text"=>"6", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2020", "month"=>"8"}
  • {"unique-ip"=>"12", "full-text"=>"11", "pdf"=>"5", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2020", "month"=>"9"}
  • {"unique-ip"=>"12", "full-text"=>"18", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"2", "cited-by"=>"0", "year"=>"2020", "month"=>"10"}

Relative Metric

{"start_date"=>"2015-01-01T00:00:00Z", "end_date"=>"2015-12-31T00:00:00Z", "subject_areas"=>[]}
Loading … Spinner
There are currently no alerts