CiteULike

Mendeley | Further Information

{"title"=>"Qualichem in vivo: A tool for assessing the quality of in vivo studies and its application for bisphenol a", "type"=>"journal", "authors"=>[{"first_name"=>"Laura", "last_name"=>"Maxim", "scopus_author_id"=>"55673974700"}, {"first_name"=>"Jeroen P.", "last_name"=>"Van Der Sluijs", "scopus_author_id"=>"7003576366"}], "year"=>2014, "source"=>"PLoS ONE", "identifiers"=>{"pmid"=>"24489958", "sgr"=>"84897408686", "doi"=>"10.1371/journal.pone.0087738", "scopus"=>"2-s2.0-84897408686", "pui"=>"373070272", "issn"=>"19326203"}, "id"=>"c5f696fc-3d32-3a28-a719-68257ac25c55", "abstract"=>"In regulatory toxicology, quality assessment of in vivo studies is a critical step for assessing chemical risks. It is crucial for preserving public health studies that are considered suitable for regulating chemicals are robust. Current procedures for conducting quality assessments in safety agencies are not structured, clear or consistent. This leaves room for criticism about lack of transparency, subjective influence and the potential for insufficient protection provided by resulting safety standards. We propose a tool called \"Qualichem in vivo\" that is designed to systematically and transparently assess the quality of in vivo studies used in chemical health risk assessment. We demonstrate its use here with 12 experts, using two controversial studies on Bisphenol A (BPA) that played an important role in BPA regulation in Europe. The results obtained with Qualichem contradict the quality assessments conducted by expert committees in safety agencies for both of these studies. Furthermore, they show that reliance on standardized guidelines to ensure scientific quality is only partially justified. Qualichem allows experts with different disciplinary backgrounds and professional experiences to express their individual and sometimes divergent views-an improvement over the current way of dealing with minority opinions. It provides a transparent framework for expressing an aggregated, multi-expert level of confidence in a study, and allows a simple graphical representation of how well the study integrates the best available scientific knowledge. Qualichem can be used to compare assessments of the same study by different health agencies, increasing transparency and trust in the work of expert committees. In addition, it may be used in systematic evaluation of in vivo studies submitted by industry in the dossiers that are required for compliance with the REACH Regulation. Qualichem provides a balanced, common framework for assessing the quality of studies that may or may not be following standardized guidelines.", "link"=>"http://www.mendeley.com/research/qualichem-vivo-tool-assessing-quality-vivo-studies-application-bisphenol", "reader_count"=>20, "reader_count_by_academic_status"=>{"Student > Doctoral Student"=>2, "Researcher"=>5, "Student > Ph. D. Student"=>2, "Student > Postgraduate"=>1, "Student > Master"=>4, "Student > Bachelor"=>4, "Professor"=>2}, "reader_count_by_user_role"=>{"Student > Doctoral Student"=>2, "Researcher"=>5, "Student > Ph. D. Student"=>2, "Student > Postgraduate"=>1, "Student > Master"=>4, "Student > Bachelor"=>4, "Professor"=>2}, "reader_count_by_subject_area"=>{"Unspecified"=>2, "Environmental Science"=>7, "Nursing and Health Professions"=>1, "Medicine and Dentistry"=>2, "Agricultural and Biological Sciences"=>2, "Pharmacology, Toxicology and Pharmaceutical Science"=>1, "Business, Management and Accounting"=>1, "Social Sciences"=>2, "Computer Science"=>1, "Economics, Econometrics and Finance"=>1}, "reader_count_by_subdiscipline"=>{"Medicine and Dentistry"=>{"Medicine and Dentistry"=>2}, "Social Sciences"=>{"Social Sciences"=>2}, "Economics, Econometrics and Finance"=>{"Economics, Econometrics and Finance"=>1}, "Agricultural and Biological Sciences"=>{"Agricultural and Biological Sciences"=>2}, "Computer Science"=>{"Computer Science"=>1}, "Nursing and Health Professions"=>{"Nursing and Health Professions"=>1}, "Business, Management and Accounting"=>{"Business, Management and Accounting"=>1}, "Unspecified"=>{"Unspecified"=>2}, "Environmental Science"=>{"Environmental Science"=>7}, "Pharmacology, Toxicology and Pharmaceutical Science"=>{"Pharmacology, Toxicology and Pharmaceutical Science"=>1}}, "reader_count_by_country"=>{"United States"=>1, "Norway"=>1, "Brazil"=>1, "United Kingdom"=>1}, "group_count"=>2}

ORCID | Further Information

CrossRef

• http://doi.org/10.1016/j.coph.2014.08.005
• http://doi.org/10.1002/etc.2955
• http://doi.org/10.1016/j.envint.2016.07.011
• http://doi.org/10.1016/j.envint.2016.03.010
• http://doi.org/10.1051/nss/2017037
• http://doi.org/10.1016/j.scitotenv.2014.03.046
• http://doi.org/10.1016/j.envsci.2018.03.010
• http://doi.org/10.1080/10807039.2014.928104
• http://doi.org/10.1080/09640568.2017.1407299

DataCite

Europe PMC Citations | Further Information

Europe PMC Database Citations

PubMed Central

Scopus | Further Information

{"@_fa"=>"true", "link"=>[{"@_fa"=>"true", "@ref"=>"self", "@href"=>"https://api.elsevier.com/content/abstract/scopus_id/84897408686"}, {"@_fa"=>"true", "@ref"=>"author-affiliation", "@href"=>"https://api.elsevier.com/content/abstract/scopus_id/84897408686?field=author,affiliation"}, {"@_fa"=>"true", "@ref"=>"scopus", "@href"=>"https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=84897408686&origin=inward"}, {"@_fa"=>"true", "@ref"=>"scopus-citedby", "@href"=>"https://www.scopus.com/inward/citedby.uri?partnerID=HzOxMe3b&scp=84897408686&origin=inward"}], "prism:url"=>"https://api.elsevier.com/content/abstract/scopus_id/84897408686", "dc:identifier"=>"SCOPUS_ID:84897408686", "eid"=>"2-s2.0-84897408686", "dc:title"=>"Qualichem in vivo: A tool for assessing the quality of in vivo studies and its application for bisphenol a", "dc:creator"=>"Maxim L.", "prism:publicationName"=>"PLoS ONE", "prism:eIssn"=>"19326203", "prism:volume"=>"9", "prism:issueIdentifier"=>"1", "prism:pageRange"=>nil, "prism:coverDate"=>"2014-01-29", "prism:coverDisplayDate"=>"29 January 2014", "prism:doi"=>"10.1371/journal.pone.0087738", "citedby-count"=>"12", "affiliation"=>[{"@_fa"=>"true", "affilname"=>"CNRS Centre National de la Recherche Scientifique", "affiliation-city"=>"Paris", "affiliation-country"=>"France"}], "pubmed-id"=>"24489958", "prism:aggregationType"=>"Journal", "subtype"=>"ar", "subtypeDescription"=>"Article", "article-number"=>"e87738", "source-id"=>"10600153309", "openaccess"=>"1", "openaccessFlag"=>true}

Web of Science® | Further Information

Article Coverage

Article Coverage Curated

Facebook

• {"url"=>"http%3A%2F%2Fjournals.plos.org%2Fplosone%2Farticle%3Fid%3D10.1371%252Fjournal.pone.0087738", "share_count"=>0, "like_count"=>0, "comment_count"=>0, "click_count"=>0, "total_count"=>0}

Journal Comments

Nature

Reddit

Research Blogging

ScienceSeeker | Further Information

Twitter

• {"id"=>"428801509061435392", "text"=>"New tool for quality assessment in #regulatory #science: Qualichem PLOS ONE #Ctgb #EFSA #EPA http://t.co/EQTOdST8iK", "created_at"=>"2014-01-30T08:07:01Z", "user"=>"bijensterfte", "user_name"=>"bijensterfte", "user_profile_image"=>"http://pbs.twimg.com/profile_images/1553569090/garland_logo_normal.jpg"}
• {"id"=>"428866823829073920", "text"=>"RT @bijensterfte: New tool for quality assessment in #regulatory #science: Qualichem PLOS ONE #Ctgb #EFSA #EPA http://t.co/EQTOdST8iK", "created_at"=>"2014-01-30T12:26:33Z", "user"=>"BijenlintDevntr", "user_name"=>"BijenlintDeventer", "user_profile_image"=>"http://pbs.twimg.com/profile_images/3623707048/49516ad5f57775f61cceb23dc6135e90_normal.jpeg"}
• {"id"=>"428998332963643392", "text"=>"RT @bijensterfte: New tool for quality assessment in #regulatory #science: Qualichem PLOS ONE #Ctgb #EFSA #EPA http://t.co/EQTOdST8iK", "created_at"=>"2014-01-30T21:09:07Z", "user"=>"mennozwart_", "user_name"=>"Menno Zwart", "user_profile_image"=>"http://pbs.twimg.com/profile_images/378800000177695093/15304cabb145bc2a7576a6b22d2e4e10_normal.jpeg"}
• {"id"=>"431649382249684992", "text"=>"#unpeudelecture Qualichem In Vivo: A Tool for Assessing the Quality of In Vivo Studies (BPA application) http://t.co/BrvcoSFebV", "created_at"=>"2014-02-07T04:43:27Z", "user"=>"josquindebaz", "user_name"=>"Josquin Debaz", "user_profile_image"=>"http://pbs.twimg.com/profile_images/1894919771/01_normal.jpg"}
• {"id"=>"453233075825418240", "text"=>"RT @josquindebaz: #unpeudelecture Qualichem In Vivo: A Tool for Assessing the Quality of In Vivo Studies (BPA application) http://t.co/Brvc…", "created_at"=>"2014-04-07T18:09:20Z", "user"=>"bijensterfte", "user_name"=>"bijensterfte", "user_profile_image"=>"http://pbs.twimg.com/profile_images/1553569090/garland_logo_normal.jpg"}
• {"id"=>"453497701146320896", "text"=>"RT @josquindebaz: #unpeudelecture Qualichem In Vivo: A Tool for Assessing the Quality of In Vivo Studies (BPA application) http://t.co/Brvc…", "created_at"=>"2014-04-08T11:40:52Z", "user"=>"mennozwart_", "user_name"=>"Menno Zwart", "user_profile_image"=>"http://pbs.twimg.com/profile_images/378800000177695093/15304cabb145bc2a7576a6b22d2e4e10_normal.jpeg"}
• {"id"=>"453498501788606464", "text"=>"Qualichem In Vivo: A Tool for Assessing the Quality of In Vivo Studies (BPA application) http://t.co/0agJDexyxB #BPA #BisphenolA", "created_at"=>"2014-04-08T11:44:03Z", "user"=>"mennozwart_", "user_name"=>"Menno Zwart", "user_profile_image"=>"http://pbs.twimg.com/profile_images/378800000177695093/15304cabb145bc2a7576a6b22d2e4e10_normal.jpeg"}

Wikipedia

Wordpress.com | Further Information

Counter

• {"month"=>"1", "year"=>"2014", "pdf_views"=>"29", "xml_views"=>"7", "html_views"=>"163"}
• {"month"=>"2", "year"=>"2014", "pdf_views"=>"56", "xml_views"=>"1", "html_views"=>"255"}
• {"month"=>"3", "year"=>"2014", "pdf_views"=>"24", "xml_views"=>"1", "html_views"=>"178"}
• {"month"=>"4", "year"=>"2014", "pdf_views"=>"13", "xml_views"=>"2", "html_views"=>"114"}
• {"month"=>"5", "year"=>"2014", "pdf_views"=>"17", "xml_views"=>"1", "html_views"=>"95"}
• {"month"=>"6", "year"=>"2014", "pdf_views"=>"14", "xml_views"=>"0", "html_views"=>"71"}
• {"month"=>"7", "year"=>"2014", "pdf_views"=>"3", "xml_views"=>"0", "html_views"=>"62"}
• {"month"=>"8", "year"=>"2014", "pdf_views"=>"4", "xml_views"=>"2", "html_views"=>"40"}
• {"month"=>"9", "year"=>"2014", "pdf_views"=>"3", "xml_views"=>"1", "html_views"=>"42"}
• {"month"=>"10", "year"=>"2014", "pdf_views"=>"4", "xml_views"=>"1", "html_views"=>"40"}
• {"month"=>"11", "year"=>"2014", "pdf_views"=>"2", "xml_views"=>"1", "html_views"=>"18"}
• {"month"=>"12", "year"=>"2014", "pdf_views"=>"3", "xml_views"=>"1", "html_views"=>"18"}
• {"month"=>"1", "year"=>"2015", "pdf_views"=>"8", "xml_views"=>"0", "html_views"=>"50"}
• {"month"=>"2", "year"=>"2015", "pdf_views"=>"6", "xml_views"=>"0", "html_views"=>"51"}
• {"month"=>"3", "year"=>"2015", "pdf_views"=>"2", "xml_views"=>"0", "html_views"=>"18"}
• {"month"=>"4", "year"=>"2015", "pdf_views"=>"3", "xml_views"=>"1", "html_views"=>"28"}
• {"month"=>"5", "year"=>"2015", "pdf_views"=>"5", "xml_views"=>"0", "html_views"=>"28"}
• {"month"=>"6", "year"=>"2015", "pdf_views"=>"4", "xml_views"=>"0", "html_views"=>"26"}
• {"month"=>"7", "year"=>"2015", "pdf_views"=>"3", "xml_views"=>"0", "html_views"=>"23"}
• {"month"=>"8", "year"=>"2015", "pdf_views"=>"1", "xml_views"=>"0", "html_views"=>"17"}
• {"month"=>"9", "year"=>"2015", "pdf_views"=>"4", "xml_views"=>"1", "html_views"=>"56"}
• {"month"=>"10", "year"=>"2015", "pdf_views"=>"4", "xml_views"=>"0", "html_views"=>"83"}
• {"month"=>"11", "year"=>"2015", "pdf_views"=>"6", "xml_views"=>"1", "html_views"=>"77"}
• {"month"=>"12", "year"=>"2015", "pdf_views"=>"3", "xml_views"=>"0", "html_views"=>"79"}
• {"month"=>"1", "year"=>"2016", "pdf_views"=>"5", "xml_views"=>"0", "html_views"=>"58"}
• {"month"=>"2", "year"=>"2016", "pdf_views"=>"1", "xml_views"=>"0", "html_views"=>"35"}
• {"month"=>"3", "year"=>"2016", "pdf_views"=>"5", "xml_views"=>"0", "html_views"=>"53"}
• {"month"=>"4", "year"=>"2016", "pdf_views"=>"1", "xml_views"=>"0", "html_views"=>"37"}
• {"month"=>"5", "year"=>"2016", "pdf_views"=>"6", "xml_views"=>"0", "html_views"=>"15"}
• {"month"=>"6", "year"=>"2016", "pdf_views"=>"2", "xml_views"=>"0", "html_views"=>"27"}
• {"month"=>"7", "year"=>"2016", "pdf_views"=>"4", "xml_views"=>"0", "html_views"=>"20"}
• {"month"=>"8", "year"=>"2016", "pdf_views"=>"4", "xml_views"=>"0", "html_views"=>"15"}
• {"month"=>"9", "year"=>"2016", "pdf_views"=>"7", "xml_views"=>"0", "html_views"=>"22"}
• {"month"=>"10", "year"=>"2016", "pdf_views"=>"4", "xml_views"=>"0", "html_views"=>"24"}
• {"month"=>"11", "year"=>"2016", "pdf_views"=>"5", "xml_views"=>"0", "html_views"=>"28"}
• {"month"=>"12", "year"=>"2016", "pdf_views"=>"6", "xml_views"=>"1", "html_views"=>"30"}
• {"month"=>"1", "year"=>"2017", "pdf_views"=>"1", "xml_views"=>"0", "html_views"=>"16"}
• {"month"=>"2", "year"=>"2017", "pdf_views"=>"3", "xml_views"=>"0", "html_views"=>"30"}
• {"month"=>"3", "year"=>"2017", "pdf_views"=>"1", "xml_views"=>"0", "html_views"=>"32"}
• {"month"=>"4", "year"=>"2017", "pdf_views"=>"5", "xml_views"=>"3", "html_views"=>"22"}
• {"month"=>"5", "year"=>"2017", "pdf_views"=>"1", "xml_views"=>"0", "html_views"=>"16"}
• {"month"=>"6", "year"=>"2017", "pdf_views"=>"3", "xml_views"=>"0", "html_views"=>"24"}
• {"month"=>"7", "year"=>"2017", "pdf_views"=>"2", "xml_views"=>"0", "html_views"=>"13"}
• {"month"=>"8", "year"=>"2017", "pdf_views"=>"1", "xml_views"=>"0", "html_views"=>"16"}
• {"month"=>"9", "year"=>"2017", "pdf_views"=>"4", "xml_views"=>"1", "html_views"=>"21"}
• {"month"=>"10", "year"=>"2017", "pdf_views"=>"8", "xml_views"=>"1", "html_views"=>"33"}
• {"month"=>"11", "year"=>"2017", "pdf_views"=>"4", "xml_views"=>"1", "html_views"=>"65"}
• {"month"=>"12", "year"=>"2017", "pdf_views"=>"4", "xml_views"=>"2", "html_views"=>"35"}
• {"month"=>"1", "year"=>"2018", "pdf_views"=>"1", "xml_views"=>"0", "html_views"=>"18"}
• {"month"=>"2", "year"=>"2018", "pdf_views"=>"1", "xml_views"=>"0", "html_views"=>"9"}
• {"month"=>"3", "year"=>"2018", "pdf_views"=>"0", "xml_views"=>"0", "html_views"=>"5"}
• {"month"=>"4", "year"=>"2018", "pdf_views"=>"3", "xml_views"=>"0", "html_views"=>"7"}
• {"month"=>"5", "year"=>"2018", "pdf_views"=>"0", "xml_views"=>"0", "html_views"=>"3"}
• {"month"=>"6", "year"=>"2018", "pdf_views"=>"3", "xml_views"=>"2", "html_views"=>"6"}
• {"month"=>"7", "year"=>"2018", "pdf_views"=>"2", "xml_views"=>"3", "html_views"=>"4"}
• {"month"=>"8", "year"=>"2018", "pdf_views"=>"1", "xml_views"=>"1", "html_views"=>"7"}
• {"month"=>"9", "year"=>"2018", "pdf_views"=>"3", "xml_views"=>"0", "html_views"=>"2"}
• {"month"=>"10", "year"=>"2018", "pdf_views"=>"4", "xml_views"=>"2", "html_views"=>"9"}
• {"month"=>"11", "year"=>"2018", "pdf_views"=>"3", "xml_views"=>"0", "html_views"=>"8"}
• {"month"=>"12", "year"=>"2018", "pdf_views"=>"0", "xml_views"=>"0", "html_views"=>"4"}
• {"month"=>"1", "year"=>"2019", "pdf_views"=>"3", "xml_views"=>"0", "html_views"=>"5"}
• {"month"=>"2", "year"=>"2019", "pdf_views"=>"2", "xml_views"=>"0", "html_views"=>"5"}
• {"month"=>"3", "year"=>"2019", "pdf_views"=>"10", "xml_views"=>"0", "html_views"=>"9"}
• {"month"=>"4", "year"=>"2019", "pdf_views"=>"2", "xml_views"=>"0", "html_views"=>"2"}
• {"month"=>"5", "year"=>"2019", "pdf_views"=>"5", "xml_views"=>"0", "html_views"=>"7"}
• {"month"=>"6", "year"=>"2019", "pdf_views"=>"1", "xml_views"=>"0", "html_views"=>"5"}
• {"month"=>"7", "year"=>"2019", "pdf_views"=>"6", "xml_views"=>"4", "html_views"=>"7"}
• {"month"=>"8", "year"=>"2019", "pdf_views"=>"4", "xml_views"=>"0", "html_views"=>"4"}
• {"month"=>"9", "year"=>"2019", "pdf_views"=>"1", "xml_views"=>"0", "html_views"=>"7"}
• {"month"=>"10", "year"=>"2019", "pdf_views"=>"3", "xml_views"=>"0", "html_views"=>"9"}
• {"month"=>"11", "year"=>"2019", "pdf_views"=>"4", "xml_views"=>"0", "html_views"=>"4"}
• {"month"=>"12", "year"=>"2019", "pdf_views"=>"1", "xml_views"=>"0", "html_views"=>"0"}

Figshare

• {"files"=>["https://ndownloader.figshare.com/files/1365879"], "description"=>"<p>For the study of Tyl et al. (2002), of the 45 criteria, the figure represents only the 30 controversial criteria for the two respondents who included “endocrinology” or “endocrine toxicology” among their fields of competence. The figure is divided into three colored areas: red (including scores and medians <3), orange (for scores and medians between 3 and 4) and green (for scores and medians >4). A line covers the full range from the lowest score to the highest score in the group of responding experts. The median of the scores is represented by an “x” and the interquartile range is represented by a rectangle. If the median (x) is in the red area, the aggregated quality of the criterion is low. If the median is in the orange area, the aggregated quality is average. If the median is in the green area, the aggregated quality is high. The interquartile range is an indicator of inter-expert heterogeneity. The number of criteria that fell in the orange or red areas is much higher for these two respondents than for all respondents together: 16 vs 3 in the orange area, 9 vs 2 in the red area, and only 5 vs 30 in the green area. This indicates lower levels of aggregated quality for these criteria, compared to the 8 respondents together.</p>", "links"=>[], "tags"=>["Public health", "Environmental health", "Occupational and industrial health", "Socioeconomic aspects of health", "toxicology", "Research assessment", "Research validity", "reproducibility", "Research errors", "Research reporting guidelines", "Research laboratories", "Company laboratories", "University laboratories", "Technology regulations", "Political science", "Political aspects of health", "public policy", "Sociology", "Sociology of knowledge", "endocrinologists", "qualichem", "tyl", "et"], "article_id"=>917613, "categories"=>["Medicine", "Science Policy", "Sociology"], "users"=>["Laura Maxim", "Jeroen P. Van der Sluijs"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0087738.g005", "stats"=>{"downloads"=>1, "page_views"=>7, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Quality_assessment_by_two_endocrinologists_using_Qualichem_to_evaluate_Tyl_et_al_2002_/917613", "title"=>"Quality assessment by two endocrinologists using Qualichem to evaluate Tyl et al. (2002).", "pos_in_sequence"=>0, "defined_type"=>1, "published_date"=>"2014-01-29 03:18:00"}
• {"files"=>["https://ndownloader.figshare.com/files/1365873"], "description"=>"<p>For the study of Tyl et al. (2002), of the 45 criteria, the figure represents only the 35 controversial criteria out of the total set of 45 criteria. The remaining 10 criteria were not controversial according to our definition; they received scores of 5 or 6 and were considered to be of high aggregated quality. The figure is divided in three colored areas: red (including scores and medians <3), orange (for scores and medians between 3 and 4) and green (for scores and medians >4). A line covers the full range, from the lowest score to the highest score in the group of responding experts. The median of the scores is represented by an “x” and the interquartile range is represented by a rectangle. If the median (x) is in the red area, the aggregated quality of the criterion is low. If the median is in the orange area, the aggregated quality is average. If the median is in the green area, the aggregated quality is high. The interquartile range is an indicator of inter-expert heterogeneity. Thirty of the 35 controversial criteria were of high aggregated quality (the median is in the green area). Of the five remaining criteria, three were of average aggregated quality (the median in the orange area) and two were of low aggregated quality (the median is in the red area).</p>", "links"=>[], "tags"=>["Public health", "Environmental health", "Occupational and industrial health", "Socioeconomic aspects of health", "toxicology", "Research assessment", "Research validity", "reproducibility", "Research errors", "Research reporting guidelines", "Research laboratories", "Company laboratories", "University laboratories", "Technology regulations", "Political science", "Political aspects of health", "public policy", "Sociology", "Sociology of knowledge", "tyl", "et", "qualichem"], "article_id"=>917607, "categories"=>["Medicine", "Science Policy", "Sociology"], "users"=>["Laura Maxim", "Jeroen P. Van der Sluijs"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0087738.g001", "stats"=>{"downloads"=>0, "page_views"=>9, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Quality_assessment_of_Tyl_et_al_2002_using_Qualichem_with_eight_respondents_/917607", "title"=>"Quality assessment of Tyl et al. (2002), using Qualichem with eight respondents.", "pos_in_sequence"=>0, "defined_type"=>1, "published_date"=>"2014-01-29 03:18:00"}
• {"files"=>["https://ndownloader.figshare.com/files/1365874"], "description"=>"<p>For the report of Stump (2009), of the possible 45, the figure represents only the 16 controversial criteria. All the other criteria—those that are not controversial according to our definition—received scores of 5 or 6 and were considered as having a high aggregated quality. The figure is divided in three colored areas: red (including scores and medians <3), orange (for scores and medians between 3 and 4) and green (for scores or medians >4). A line covers the full range from the lowest score to the highest score in the group of responding experts. The median of the scores is represented by an “x” and the interquartile range is represented with a rectangle. If the median (x) is in the red area, the aggregated quality of the criterion is low. If the median is in the orange area, the aggregated quality is average. If the median is in the green area, the aggregated quality is high. The interquartile range is an indicator of inter-expert heterogeneity. Nine of the 16 controversial criteria were of high aggregated quality (median fell in the green area). The remaining 7 criteria were all of average aggregated quality (median fell in the orange area).</p>", "links"=>[], "tags"=>["Public health", "Environmental health", "Occupational and industrial health", "Socioeconomic aspects of health", "toxicology", "Research assessment", "Research validity", "reproducibility", "Research errors", "Research reporting guidelines", "Research laboratories", "Company laboratories", "University laboratories", "Technology regulations", "Political science", "Political aspects of health", "public policy", "Sociology", "Sociology of knowledge", "stump", "qualichem"], "article_id"=>917608, "categories"=>["Medicine", "Science Policy", "Sociology"], "users"=>["Laura Maxim", "Jeroen P. Van der Sluijs"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0087738.g002", "stats"=>{"downloads"=>0, "page_views"=>9, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Quality_assessment_of_Stump_2009_using_Qualichem_with_four_respondents_/917608", "title"=>"Quality assessment of Stump (2009), using Qualichem with four respondents.", "pos_in_sequence"=>0, "defined_type"=>1, "published_date"=>"2014-01-29 03:18:00"}
• {"files"=>["https://ndownloader.figshare.com/files/1365881"], "description"=>"_", "links"=>[], "tags"=>["Public health", "Environmental health", "Occupational and industrial health", "Socioeconomic aspects of health", "toxicology", "Research assessment", "Research validity", "reproducibility", "Research errors", "Research reporting guidelines", "Research laboratories", "Company laboratories", "University laboratories", "Technology regulations", "Political science", "Political aspects of health", "public policy", "Sociology", "Sociology of knowledge", "qualichem"], "article_id"=>917615, "categories"=>["Medicine", "Science Policy", "Sociology"], "users"=>["Laura Maxim", "Jeroen P. Van der Sluijs"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0087738.t003", "stats"=>{"downloads"=>0, "page_views"=>9, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Comparison_between_Qualichem_and_other_reporting_and_or_quality_assessment_frameworks_/917615", "title"=>"Comparison between Qualichem and other reporting and/or quality assessment frameworks.", "pos_in_sequence"=>0, "defined_type"=>3, "published_date"=>"2014-01-29 03:18:00"}
• {"files"=>["https://ndownloader.figshare.com/files/1365882"], "description"=>"_", "links"=>[], "tags"=>["Public health", "Environmental health", "Occupational and industrial health", "Socioeconomic aspects of health", "toxicology", "Research assessment", "Research validity", "reproducibility", "Research errors", "Research reporting guidelines", "Research laboratories", "Company laboratories", "University laboratories", "Technology regulations", "Political science", "Political aspects of health", "public policy", "Sociology", "Sociology of knowledge"], "article_id"=>917616, "categories"=>["Medicine", "Science Policy", "Sociology"], "users"=>["Laura Maxim", "Jeroen P. Van der Sluijs"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0087738.t002", "stats"=>{"downloads"=>3, "page_views"=>4, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Scale_used_for_expert_elicitation_/917616", "title"=>"Scale used for expert elicitation.", "pos_in_sequence"=>0, "defined_type"=>3, "published_date"=>"2014-01-29 03:18:00"}
• {"files"=>["https://ndownloader.figshare.com/files/1365880"], "description"=>"_", "links"=>[], "tags"=>["Public health", "Environmental health", "Occupational and industrial health", "Socioeconomic aspects of health", "toxicology", "Research assessment", "Research validity", "reproducibility", "Research errors", "Research reporting guidelines", "Research laboratories", "Company laboratories", "University laboratories", "Technology regulations", "Political science", "Political aspects of health", "public policy", "Sociology", "Sociology of knowledge"], "article_id"=>917614, "categories"=>["Medicine", "Science Policy", "Sociology"], "users"=>["Laura Maxim", "Jeroen P. Van der Sluijs"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0087738.t001", "stats"=>{"downloads"=>2, "page_views"=>3, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Typology_of_quality_criteria_for_in_vivo_studies_/917614", "title"=>"Typology of quality criteria for <i>in vivo</i> studies.", "pos_in_sequence"=>0, "defined_type"=>3, "published_date"=>"2014-01-29 03:18:00"}
• {"files"=>["https://ndownloader.figshare.com/files/1365877"], "description"=>"<p>The vertical axis represents the disciplinary areas chosen by the experts. The horizontal axis represents the number of experts who chose each disciplinary area to describe his/her work.</p>", "links"=>[], "tags"=>["Public health", "Environmental health", "Occupational and industrial health", "Socioeconomic aspects of health", "toxicology", "Research assessment", "Research validity", "reproducibility", "Research errors", "Research reporting guidelines", "Research laboratories", "Company laboratories", "University laboratories", "Technology regulations", "Political science", "Political aspects of health", "public policy", "Sociology", "Sociology of knowledge", "qualichem"], "article_id"=>917611, "categories"=>["Medicine", "Science Policy", "Sociology"], "users"=>["Laura Maxim", "Jeroen P. Van der Sluijs"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0087738.g004", "stats"=>{"downloads"=>0, "page_views"=>5, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Disciplines_of_Qualichem_respondents_/917611", "title"=>"Disciplines of Qualichem respondents.", "pos_in_sequence"=>0, "defined_type"=>1, "published_date"=>"2014-01-29 03:18:00"}
• {"files"=>["https://ndownloader.figshare.com/files/1365876"], "description"=>"<p>Eight of the twelve respondents agreed to select a subset of up to 15 criteria that they considered to be the most important for the quality of <i>in vivo</i> study results. The figure shows the combined 39 criteria chosen by these eight experts. The vertical axis represents the 39 criteria, and the horizontal axis represents the percentage of respondents that selected each criterion.</p>", "links"=>[], "tags"=>["Public health", "Environmental health", "Occupational and industrial health", "Socioeconomic aspects of health", "toxicology", "Research assessment", "Research validity", "reproducibility", "Research errors", "Research reporting guidelines", "Research laboratories", "Company laboratories", "University laboratories", "Technology regulations", "Political science", "Political aspects of health", "public policy", "Sociology", "Sociology of knowledge", "qualichem"], "article_id"=>917610, "categories"=>["Medicine", "Science Policy", "Sociology"], "users"=>["Laura Maxim", "Jeroen P. Van der Sluijs"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0087738.g003", "stats"=>{"downloads"=>3, "page_views"=>4, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Relative_importance_of_the_Qualichem_quality_criteria_to_the_global_quality_of_the_study_/917610", "title"=>"Relative importance of the Qualichem quality criteria to the global quality of the study.", "pos_in_sequence"=>0, "defined_type"=>1, "published_date"=>"2014-01-29 03:18:00"}
• {"files"=>["https://ndownloader.figshare.com/files/1365885", "https://ndownloader.figshare.com/files/1365886", "https://ndownloader.figshare.com/files/1365887", "https://ndownloader.figshare.com/files/1365888", "https://ndownloader.figshare.com/files/1365889", "https://ndownloader.figshare.com/files/1365890", "https://ndownloader.figshare.com/files/1365891", "https://ndownloader.figshare.com/files/1365892", "https://ndownloader.figshare.com/files/1365893", "https://ndownloader.figshare.com/files/1365894"], "description"=>"<div><p>In regulatory toxicology, quality assessment of <i>in vivo</i> studies is a critical step for assessing chemical risks. It is crucial for preserving public health studies that are considered suitable for regulating chemicals are robust. Current procedures for conducting quality assessments in safety agencies are not structured, clear or consistent. This leaves room for criticism about lack of transparency, subjective influence and the potential for insufficient protection provided by resulting safety standards. We propose a tool called “Qualichem <i>in vivo</i>” that is designed to systematically and transparently assess the quality of <i>in vivo</i> studies used in chemical health risk assessment. We demonstrate its use here with 12 experts, using two controversial studies on Bisphenol A (BPA) that played an important role in BPA regulation in Europe. The results obtained with Qualichem contradict the quality assessments conducted by expert committees in safety agencies for both of these studies. Furthermore, they show that reliance on standardized guidelines to ensure scientific quality is only partially justified. Qualichem allows experts with different disciplinary backgrounds and professional experiences to express their individual and sometimes divergent views—an improvement over the current way of dealing with minority opinions. It provides a transparent framework for expressing an aggregated, multi-expert level of confidence in a study, and allows a simple graphical representation of how well the study integrates the best available scientific knowledge. Qualichem can be used to compare assessments of the same study by different health agencies, increasing transparency and trust in the work of expert committees. In addition, it may be used in systematic evaluation of <i>in vivo</i> studies submitted by industry in the dossiers that are required for compliance with the REACH Regulation. Qualichem provides a balanced, common framework for assessing the quality of studies that may or may not be following standardized guidelines.</p></div>", "links"=>[], "tags"=>["Public health", "Environmental health", "Occupational and industrial health", "Socioeconomic aspects of health", "toxicology", "Research assessment", "Research validity", "reproducibility", "Research errors", "Research reporting guidelines", "Research laboratories", "Company laboratories", "University laboratories", "Technology regulations", "Political science", "Political aspects of health", "public policy", "Sociology", "Sociology of knowledge", "qualichem", "studies", "bisphenol"], "article_id"=>917619, "categories"=>["Medicine", "Science Policy", "Sociology"], "users"=>["Laura Maxim", "Jeroen P. Van der Sluijs"], "doi"=>["https://dx.doi.org/10.1371/journal.pone.0087738.s001", "https://dx.doi.org/10.1371/journal.pone.0087738.s002", "https://dx.doi.org/10.1371/journal.pone.0087738.s003", "https://dx.doi.org/10.1371/journal.pone.0087738.s004", "https://dx.doi.org/10.1371/journal.pone.0087738.s005", "https://dx.doi.org/10.1371/journal.pone.0087738.s006", "https://dx.doi.org/10.1371/journal.pone.0087738.s007", "https://dx.doi.org/10.1371/journal.pone.0087738.s008", "https://dx.doi.org/10.1371/journal.pone.0087738.s009", "https://dx.doi.org/10.1371/journal.pone.0087738.s010"], "stats"=>{"downloads"=>47, "page_views"=>13, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/Qualichem_In_Vivo_A_Tool_for_Assessing_the_Quality_of_In_Vivo_Studies_and_Its_Application_for_Bisphenol_A/917619", "title"=>"Qualichem <i>In Vivo</i>: A Tool for Assessing the Quality of <i>In Vivo</i> Studies and Its Application for Bisphenol A", "pos_in_sequence"=>0, "defined_type"=>4, "published_date"=>"2014-01-29 03:18:00"}

PMC Usage Stats | Further Information

• {"unique-ip"=>"11", "full-text"=>"8", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"3", "supp-data"=>"8", "cited-by"=>"0", "year"=>"2014", "month"=>"2"}
• {"unique-ip"=>"4", "full-text"=>"4", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"2", "cited-by"=>"0", "year"=>"2014", "month"=>"3"}
• {"unique-ip"=>"6", "full-text"=>"6", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2014", "month"=>"5"}
• {"unique-ip"=>"11", "full-text"=>"20", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2014", "month"=>"6"}
• {"unique-ip"=>"5", "full-text"=>"2", "pdf"=>"6", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2014", "month"=>"4"}
• {"unique-ip"=>"10", "full-text"=>"14", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"4"}
• {"unique-ip"=>"10", "full-text"=>"12", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"5"}
• {"unique-ip"=>"5", "full-text"=>"10", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"6"}
• {"unique-ip"=>"6", "full-text"=>"6", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"7"}
• {"unique-ip"=>"9", "full-text"=>"9", "pdf"=>"5", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"3"}
• {"unique-ip"=>"3", "full-text"=>"2", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"2"}
• {"unique-ip"=>"6", "full-text"=>"6", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"3", "cited-by"=>"0", "year"=>"2015", "month"=>"8"}
• {"unique-ip"=>"11", "full-text"=>"9", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"9"}
• {"unique-ip"=>"6", "full-text"=>"6", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"10"}
• {"unique-ip"=>"11", "full-text"=>"11", "pdf"=>"5", "abstract"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2014", "month"=>"7"}
• {"unique-ip"=>"8", "full-text"=>"8", "pdf"=>"6", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2014", "month"=>"8"}
• {"unique-ip"=>"4", "full-text"=>"4", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2014", "month"=>"9"}
• {"unique-ip"=>"10", "full-text"=>"14", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"3", "cited-by"=>"0", "year"=>"2014", "month"=>"10"}
• {"unique-ip"=>"6", "full-text"=>"5", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"2"}
• {"unique-ip"=>"4", "full-text"=>"5", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2014", "month"=>"11"}
• {"unique-ip"=>"6", "full-text"=>"8", "pdf"=>"5", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"3", "cited-by"=>"0", "year"=>"2014", "month"=>"12"}
• {"unique-ip"=>"9", "full-text"=>"8", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"1"}
• {"unique-ip"=>"18", "full-text"=>"10", "pdf"=>"10", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"1", "year"=>"2015", "month"=>"11"}
• {"unique-ip"=>"11", "full-text"=>"9", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"12"}
• {"unique-ip"=>"7", "full-text"=>"8", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"1"}
• {"unique-ip"=>"7", "full-text"=>"8", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"3"}
• {"unique-ip"=>"7", "full-text"=>"8", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"4"}
• {"unique-ip"=>"5", "full-text"=>"4", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"5"}
• {"unique-ip"=>"10", "full-text"=>"10", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"4", "cited-by"=>"0", "year"=>"2016", "month"=>"6"}
• {"unique-ip"=>"11", "full-text"=>"15", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"7"}
• {"unique-ip"=>"5", "full-text"=>"3", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"2", "cited-by"=>"0", "year"=>"2016", "month"=>"8"}
• {"unique-ip"=>"6", "full-text"=>"6", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"9"}
• {"unique-ip"=>"9", "full-text"=>"10", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"10"}
• {"unique-ip"=>"4", "full-text"=>"2", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2016", "month"=>"11"}
• {"unique-ip"=>"1", "full-text"=>"1", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"12"}
• {"unique-ip"=>"11", "full-text"=>"8", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"1"}
• {"unique-ip"=>"7", "full-text"=>"7", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"2"}
• {"unique-ip"=>"3", "full-text"=>"1", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"3"}
• {"unique-ip"=>"2", "full-text"=>"3", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"4"}
• {"unique-ip"=>"2", "full-text"=>"2", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"5"}
• {"unique-ip"=>"3", "full-text"=>"3", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"6"}
• {"unique-ip"=>"4", "full-text"=>"4", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2017", "month"=>"7"}
• {"unique-ip"=>"1", "full-text"=>"0", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2017", "month"=>"8"}
• {"unique-ip"=>"8", "full-text"=>"6", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"2", "cited-by"=>"0", "year"=>"2017", "month"=>"9"}
• {"unique-ip"=>"4", "full-text"=>"1", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"3", "cited-by"=>"0", "year"=>"2017", "month"=>"10"}
• {"unique-ip"=>"4", "full-text"=>"4", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"11"}
• {"unique-ip"=>"1", "full-text"=>"1", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"12"}
• {"unique-ip"=>"3", "full-text"=>"3", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"1"}
• {"unique-ip"=>"2", "full-text"=>"2", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"3"}
• {"unique-ip"=>"9", "full-text"=>"8", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"3", "cited-by"=>"0", "year"=>"2019", "month"=>"1"}
• {"unique-ip"=>"1", "full-text"=>"0", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"7", "cited-by"=>"0", "year"=>"2018", "month"=>"11"}
• {"unique-ip"=>"11", "full-text"=>"7", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"6", "cited-by"=>"0", "year"=>"2018", "month"=>"12"}
• {"unique-ip"=>"1", "full-text"=>"3", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"9"}
• {"unique-ip"=>"5", "full-text"=>"4", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"5"}
• {"unique-ip"=>"3", "full-text"=>"2", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"6"}
• {"unique-ip"=>"8", "full-text"=>"4", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"3", "cited-by"=>"0", "year"=>"2018", "month"=>"7"}
• {"unique-ip"=>"6", "full-text"=>"4", "pdf"=>"2", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"10"}
• {"unique-ip"=>"5", "full-text"=>"5", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"10", "cited-by"=>"0", "year"=>"2018", "month"=>"8"}
• {"unique-ip"=>"2", "full-text"=>"2", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"2"}
• {"unique-ip"=>"3", "full-text"=>"5", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"3"}
• {"unique-ip"=>"5", "full-text"=>"5", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"4"}
• {"unique-ip"=>"3", "full-text"=>"3", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"10", "cited-by"=>"0", "year"=>"2019", "month"=>"5"}
• {"unique-ip"=>"1", "full-text"=>"1", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"8"}
• {"unique-ip"=>"6", "full-text"=>"4", "pdf"=>"2", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"9"}
• {"unique-ip"=>"6", "full-text"=>"6", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"10"}

Relative Metric

{"start_date"=>"2014-01-01T00:00:00Z", "end_date"=>"2014-12-31T00:00:00Z", "subject_areas"=>[{"subject_area"=>"/Biology and life sciences/Toxicology", "average_usage"=>[266, 408]}, {"subject_area"=>"/Medicine and health sciences/Pharmacology", "average_usage"=>[286]}, {"subject_area"=>"/People and places/Population groupings", "average_usage"=>[300]}, {"subject_area"=>"/Physical sciences", "average_usage"=>[271]}, {"subject_area"=>"/Physical sciences/Mathematics", "average_usage"=>[286]}]}

F1000Prime