"Rate My Therapist": Automated Detection of Empathy in Drug and Alcohol Counseling via Speech and Language Processing
- Publication Date
- December 02, 2015
- Journal
- PLOS ONE
- Authors
- Bo Xiao, Zac E. Imel, Panayiotis G. Georgiou, David C. Atkins, et al
- Volume
- 10
- Issue
- 12
- Pages
- e0143055
- DOI
- https://dx.plos.org/10.1371/journal.pone.0143055
- Publisher URL
- http://journals.plos.org/plosone/article?id=10.1371%2Fjournal.pone.0143055
- PubMed
- http://www.ncbi.nlm.nih.gov/pubmed/26630392
- PubMed Central
- http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4668058
- Europe PMC
- http://europepmc.org/abstract/MED/26630392
- Scopus
- 84955508891
- Mendeley
- http://www.mendeley.com/research/rate-therapist-automated-detection-empathy-drug-alcohol-counseling-via-speech-language-processing
Loading … 

Events
Loading … 

Mendeley | Further Information
{"title"=>"\"Rate My Therapist\": Automated Detection of Empathy in Drug and Alcohol Counseling via Speech and Language Processing", "type"=>"journal", "authors"=>[{"last_name"=>"Bo Xiao", "scopus_author_id"=>"57076927300"}, {"first_name"=>"Zac E.", "last_name"=>"Imel", "scopus_author_id"=>"13405510700"}, {"first_name"=>"Panayiotis G.", "last_name"=>"Georgiou", "scopus_author_id"=>"7003719827"}, {"first_name"=>"David C.", "last_name"=>"Atkins", "scopus_author_id"=>"7102290550"}, {"first_name"=>"Shrikanth S.", "last_name"=>"Narayanan", "scopus_author_id"=>"11539478500"}], "year"=>2015, "source"=>"PLoS ONE", "identifiers"=>{"issn"=>"19326203", "scopus"=>"2-s2.0-84955508891", "sgr"=>"84955508891", "pui"=>"607883997", "isbn"=>"1932-6203", "pmid"=>"26630392", "doi"=>"10.1371/journal.pone.0143055"}, "id"=>"20883af5-2b63-3761-8cab-b65eb38f642e", "abstract"=>"The technology for evaluating patient-provider interactions in psychotherapy-observational coding-has not changed in 70 years. It is labor-intensive, error prone, and expensive, limiting its use in evaluating psychotherapy in the real world. Engineering solutions from speech and language processing provide new methods for the automatic evaluation of provider ratings from session recordings. The primary data are 200 Motivational Interviewing (MI) sessions from a study on MI training methods with observer ratings of counselor empathy. Automatic Speech Recognition (ASR) was used to transcribe sessions, and the resulting words were used in a text-based predictive model of empathy. Two supporting datasets trained the speech processing tasks including ASR (1200 transcripts from heterogeneous psychotherapy sessions and 153 transcripts and session recordings from 5 MI clinical trials). The accuracy of computationally-derived empathy ratings were evaluated against human ratings for each provider. Computationally-derived empathy scores and classifications (high vs. low) were highly accurate against human-based codes and classifications, with a correlation of 0.65 and F-score (a weighted average of sensitivity and specificity) of 0.86, respectively. Empathy prediction using human transcription as input (as opposed to ASR) resulted in a slight increase in prediction accuracies, suggesting that the fully automatic system with ASR is relatively robust. Using speech and language processing methods, it is possible to generate accurate predictions of provider performance in psychotherapy from audio recordings alone. This technology can support large-scale evaluation of psychotherapy for dissemination and process studies.", "link"=>"http://www.mendeley.com/research/rate-therapist-automated-detection-empathy-drug-alcohol-counseling-via-speech-language-processing", "reader_count"=>40, "reader_count_by_academic_status"=>{"Unspecified"=>2, "Professor > Associate Professor"=>1, "Librarian"=>1, "Student > Doctoral Student"=>5, "Researcher"=>8, "Student > Ph. D. Student"=>9, "Student > Master"=>6, "Student > Bachelor"=>3, "Lecturer > Senior Lecturer"=>1, "Professor"=>4}, "reader_count_by_user_role"=>{"Unspecified"=>2, "Professor > Associate Professor"=>1, "Librarian"=>1, "Student > Doctoral Student"=>5, "Researcher"=>8, "Student > Ph. D. Student"=>9, "Student > Master"=>6, "Student > Bachelor"=>3, "Lecturer > Senior Lecturer"=>1, "Professor"=>4}, "reader_count_by_subject_area"=>{"Engineering"=>2, "Unspecified"=>3, "Nursing and Health Professions"=>2, "Medicine and Dentistry"=>3, "Business, Management and Accounting"=>1, "Psychology"=>16, "Social Sciences"=>1, "Computer Science"=>12}, "reader_count_by_subdiscipline"=>{"Engineering"=>{"Engineering"=>2}, "Medicine and Dentistry"=>{"Medicine and Dentistry"=>3}, "Social Sciences"=>{"Social Sciences"=>1}, "Psychology"=>{"Psychology"=>16}, "Computer Science"=>{"Computer Science"=>12}, "Nursing and Health Professions"=>{"Nursing and Health Professions"=>2}, "Business, Management and Accounting"=>{"Business, Management and Accounting"=>1}, "Unspecified"=>{"Unspecified"=>3}}, "reader_count_by_country"=>{"Australia"=>2, "Spain"=>1}, "group_count"=>4}CrossRef
- http://doi.org/10.1186/s13012-017-0697-2
- http://doi.org/10.1016/j.csl.2018.11.002
- http://doi.org/10.1007/s10935-018-00534-z
- http://doi.org/10.1007/s11920-017-0839-x
- http://doi.org/10.1080/15374416.2018.1561295
- http://doi.org/10.3389/fpubh.2018.00293
- http://doi.org/10.1002/da.22640
- http://doi.org/10.1186/s13012-017-0633-5
- http://doi.org/10.7717/peerj-cs.59
- http://doi.org/10.1109/MSP.2017.2718581
- http://doi.org/10.2196/10148
Scopus | Further Information
{"@_fa"=>"true", "link"=>[{"@_fa"=>"true", "@ref"=>"self", "@href"=>"https://api.elsevier.com/content/abstract/scopus_id/84955508891"}, {"@_fa"=>"true", "@ref"=>"author-affiliation", "@href"=>"https://api.elsevier.com/content/abstract/scopus_id/84955508891?field=author,affiliation"}, {"@_fa"=>"true", "@ref"=>"scopus", "@href"=>"https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=84955508891&origin=inward"}, {"@_fa"=>"true", "@ref"=>"scopus-citedby", "@href"=>"https://www.scopus.com/inward/citedby.uri?partnerID=HzOxMe3b&scp=84955508891&origin=inward"}], "prism:url"=>"https://api.elsevier.com/content/abstract/scopus_id/84955508891", "dc:identifier"=>"SCOPUS_ID:84955508891", "eid"=>"2-s2.0-84955508891", "dc:title"=>"\"Rate My Therapist\": Automated Detection of Empathy in Drug and Alcohol Counseling via Speech and Language Processing", "dc:creator"=>"Bo Xiao", "prism:publicationName"=>"PLoS ONE", "prism:eIssn"=>"19326203", "prism:volume"=>"10", "prism:issueIdentifier"=>"12", "prism:pageRange"=>nil, "prism:coverDate"=>"2015-12-01", "prism:coverDisplayDate"=>"1 December 2015", "prism:doi"=>"10.1371/journal.pone.0143055", "citedby-count"=>"24", "affiliation"=>[{"@_fa"=>"true", "affilname"=>"University of Southern California", "affiliation-city"=>"Los Angeles", "affiliation-country"=>"United States"}], "pubmed-id"=>"26630392", "prism:aggregationType"=>"Journal", "subtype"=>"ar", "subtypeDescription"=>"Article", "article-number"=>"e0143055", "source-id"=>"10600153309", "openaccess"=>"1", "openaccessFlag"=>true}- {"url"=>"http%3A%2F%2Fjournals.plos.org%2Fplosone%2Farticle%3Fid%3D10.1371%252Fjournal.pone.0143055", "share_count"=>3, "like_count"=>2, "comment_count"=>3, "click_count"=>0, "total_count"=>8}
- {"id"=>"672285533251375104", "text"=>"セッション中の発話からカウンセラーの共感レベルを自動で判定する方法を開発。\"Rate My Therapist\": Automated Detection of Empathy in Drug and Alcohol… https://t.co/IHFiQPlUco", "created_at"=>"2015-12-03T05:25:36Z", "user"=>"uranus_2", "user_name"=>"マーキュリー2世", "user_profile_image"=>"http://pbs.twimg.com/profile_images/650483455248064512/EOJq3sZX_normal.png"}
- {"id"=>"672551018106765314", "text"=>"RT @uranus_2: セッション中の発話からカウンセラーの共感レベルを自動で判定する方法を開発。\"Rate My Therapist\": Automated Detection of Empathy in Drug and Alcohol… https://t.co/IH…", "created_at"=>"2015-12-03T23:00:32Z", "user"=>"Xx__SaSuKe__xX", "user_name"=>"さっちん。", "user_profile_image"=>"http://pbs.twimg.com/profile_images/583283450318221312/h4-HJbXA_normal.jpg"}
- {"id"=>"674854199016886272", "text"=>"Software eating psychiatry? Check out this system that auto-detects #empathy. https://t.co/uGOqH0phVj @PLOSONE cc: @pmarca @bhorowitz @a16z", "created_at"=>"2015-12-10T07:32:33Z", "user"=>"ryanlouie", "user_name"=>"Ryan K. Louie MD PhD", "user_profile_image"=>"http://pbs.twimg.com/profile_images/661669866265448448/bCobRaD8_normal.jpg"}
- {"id"=>"676340917658365952", "text"=>"Rating empathy of provider through speech and language processing software. Will this replace observer coding?!?https://t.co/i3WreFr6zO", "created_at"=>"2015-12-14T10:00:15Z", "user"=>"IsabelleScholl", "user_name"=>"Isabelle Scholl", "user_profile_image"=>"http://pbs.twimg.com/profile_images/2320268505/9cdw0p7igllvpsr6czin_normal.jpeg"}
- {"id"=>"676783613552234496", "text"=>"Way cheaper than grad students: Atkins taught a computer to code interviews, coded ~1.5k in 2 weeks #discience15 https://t.co/SB1C6F5vI0", "created_at"=>"2015-12-15T15:19:22Z", "user"=>"HowardChiou", "user_name"=>"Howard Chiou", "user_profile_image"=>"http://pbs.twimg.com/profile_images/1898895677/ToTing39_normal.jpg"}
- {"id"=>"676783787410399232", "text"=>"RT @HowardChiou: Way cheaper than grad students: Atkins taught a computer to code interviews, coded ~1.5k in 2 weeks #discience15 https://…", "created_at"=>"2015-12-15T15:20:03Z", "user"=>"edm_ah", "user_name"=>"EDM Forum", "user_profile_image"=>"http://pbs.twimg.com/profile_images/603912460026777600/VQhcQ4Oi_normal.jpg"}
- {"id"=>"676783790291820544", "text"=>"RT @HowardChiou: Way cheaper than grad students: Atkins taught a computer to code interviews, coded ~1.5k in 2 weeks #discience15 https://…", "created_at"=>"2015-12-15T15:20:04Z", "user"=>"diportal_unc", "user_name"=>"D&I portal", "user_profile_image"=>"http://pbs.twimg.com/profile_images/483693561284526080/l1QWkY9Y_normal.png"}
- {"id"=>"676783882113564673", "text"=>"RT @HowardChiou: Way cheaper than grad students: Atkins taught a computer to code interviews, coded ~1.5k in 2 weeks #discience15 https://…", "created_at"=>"2015-12-15T15:20:26Z", "user"=>"ConsortiumforIS", "user_name"=>"ConsortiumforIS", "user_profile_image"=>"http://pbs.twimg.com/profile_images/530437161615503360/4vdH_JBn_normal.png"}
- {"id"=>"676783899272433668", "text"=>"RT @HowardChiou: Way cheaper than grad students: Atkins taught a computer to code interviews, coded ~1.5k in 2 weeks #discience15 https://…", "created_at"=>"2015-12-15T15:20:30Z", "user"=>"SJLandes", "user_name"=>"Sara J. Landes", "user_profile_image"=>"http://pbs.twimg.com/profile_images/567513289404334081/uvjUyOYf_normal.jpeg"}
- {"id"=>"676789169520312320", "text"=>"RT @HowardChiou: Way cheaper than grad students: Atkins taught a computer to code interviews, coded ~1.5k in 2 weeks #discience15 https://…", "created_at"=>"2015-12-15T15:41:26Z", "user"=>"wendyr13", "user_name"=>"Wendy Rueda", "user_profile_image"=>"http://pbs.twimg.com/profile_images/622044876054507520/OMwBPJLq_normal.jpg"}
- {"id"=>"806277228296179712", "text"=>"Narayanan refs paper, which drew lots of attn in popular media perhaps due 2 cool title \"Rate my therapist\" https://t.co/7DNOEgiZ4P #SST2016", "created_at"=>"2016-12-06T23:20:45Z", "user"=>"joshuaclx", "user_name"=>"Joshua J. Clothier", "user_profile_image"=>"http://pbs.twimg.com/profile_images/484158139109883904/rIi_xatj_normal.jpeg"}
- {"id"=>"806277539811315712", "text"=>"Curious - Using tech to identify empathy in therapists. Just cited by co-auth Narayanan at #SST2016 https://t.co/D6Dx9vZ9KS", "created_at"=>"2016-12-06T23:22:00Z", "user"=>"SarahMasso", "user_name"=>"Sarah Masso", "user_profile_image"=>"http://pbs.twimg.com/profile_images/3122989651/fea999f592d660e7334781999ca9efe5_normal.jpeg"}
Counter
- {"month"=>"12", "year"=>"2015", "pdf_views"=>"116", "xml_views"=>"4", "html_views"=>"943"}
- {"month"=>"1", "year"=>"2016", "pdf_views"=>"36", "xml_views"=>"0", "html_views"=>"216"}
- {"month"=>"2", "year"=>"2016", "pdf_views"=>"4", "xml_views"=>"0", "html_views"=>"99"}
- {"month"=>"3", "year"=>"2016", "pdf_views"=>"21", "xml_views"=>"0", "html_views"=>"98"}
- {"month"=>"4", "year"=>"2016", "pdf_views"=>"25", "xml_views"=>"0", "html_views"=>"88"}
- {"month"=>"5", "year"=>"2016", "pdf_views"=>"18", "xml_views"=>"0", "html_views"=>"89"}
- {"month"=>"6", "year"=>"2016", "pdf_views"=>"26", "xml_views"=>"0", "html_views"=>"69"}
- {"month"=>"7", "year"=>"2016", "pdf_views"=>"25", "xml_views"=>"0", "html_views"=>"57"}
- {"month"=>"8", "year"=>"2016", "pdf_views"=>"19", "xml_views"=>"0", "html_views"=>"58"}
- {"month"=>"9", "year"=>"2016", "pdf_views"=>"20", "xml_views"=>"0", "html_views"=>"60"}
- {"month"=>"10", "year"=>"2016", "pdf_views"=>"33", "xml_views"=>"0", "html_views"=>"100"}
- {"month"=>"11", "year"=>"2016", "pdf_views"=>"18", "xml_views"=>"0", "html_views"=>"56"}
- {"month"=>"12", "year"=>"2016", "pdf_views"=>"11", "xml_views"=>"0", "html_views"=>"71"}
- {"month"=>"1", "year"=>"2017", "pdf_views"=>"20", "xml_views"=>"0", "html_views"=>"74"}
- {"month"=>"2", "year"=>"2017", "pdf_views"=>"4", "xml_views"=>"1", "html_views"=>"54"}
- {"month"=>"3", "year"=>"2017", "pdf_views"=>"19", "xml_views"=>"4", "html_views"=>"84"}
- {"month"=>"4", "year"=>"2017", "pdf_views"=>"16", "xml_views"=>"1", "html_views"=>"65"}
- {"month"=>"5", "year"=>"2017", "pdf_views"=>"24", "xml_views"=>"1", "html_views"=>"80"}
- {"month"=>"6", "year"=>"2017", "pdf_views"=>"14", "xml_views"=>"0", "html_views"=>"78"}
- {"month"=>"7", "year"=>"2017", "pdf_views"=>"21", "xml_views"=>"0", "html_views"=>"63"}
- {"month"=>"8", "year"=>"2017", "pdf_views"=>"11", "xml_views"=>"1", "html_views"=>"47"}
- {"month"=>"9", "year"=>"2017", "pdf_views"=>"21", "xml_views"=>"1", "html_views"=>"57"}
- {"month"=>"10", "year"=>"2017", "pdf_views"=>"12", "xml_views"=>"0", "html_views"=>"79"}
- {"month"=>"11", "year"=>"2017", "pdf_views"=>"9", "xml_views"=>"0", "html_views"=>"122"}
- {"month"=>"12", "year"=>"2017", "pdf_views"=>"13", "xml_views"=>"1", "html_views"=>"125"}
- {"month"=>"1", "year"=>"2018", "pdf_views"=>"11", "xml_views"=>"0", "html_views"=>"57"}
- {"month"=>"2", "year"=>"2018", "pdf_views"=>"28", "xml_views"=>"0", "html_views"=>"73"}
- {"month"=>"3", "year"=>"2018", "pdf_views"=>"20", "xml_views"=>"1", "html_views"=>"39"}
- {"month"=>"4", "year"=>"2018", "pdf_views"=>"32", "xml_views"=>"0", "html_views"=>"63"}
- {"month"=>"5", "year"=>"2018", "pdf_views"=>"35", "xml_views"=>"1", "html_views"=>"51"}
- {"month"=>"6", "year"=>"2018", "pdf_views"=>"12", "xml_views"=>"3", "html_views"=>"38"}
- {"month"=>"7", "year"=>"2018", "pdf_views"=>"16", "xml_views"=>"3", "html_views"=>"32"}
- {"month"=>"8", "year"=>"2018", "pdf_views"=>"11", "xml_views"=>"1", "html_views"=>"25"}
- {"month"=>"9", "year"=>"2018", "pdf_views"=>"11", "xml_views"=>"0", "html_views"=>"46"}
- {"month"=>"10", "year"=>"2018", "pdf_views"=>"35", "xml_views"=>"1", "html_views"=>"71"}
- {"month"=>"11", "year"=>"2018", "pdf_views"=>"10", "xml_views"=>"0", "html_views"=>"28"}
- {"month"=>"12", "year"=>"2018", "pdf_views"=>"8", "xml_views"=>"0", "html_views"=>"23"}
- {"month"=>"1", "year"=>"2019", "pdf_views"=>"15", "xml_views"=>"1", "html_views"=>"36"}
- {"month"=>"2", "year"=>"2019", "pdf_views"=>"16", "xml_views"=>"0", "html_views"=>"29"}
PMC Usage Stats | Further Information
- {"unique-ip"=>"7", "full-text"=>"7", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"2"}
- {"unique-ip"=>"21", "full-text"=>"19", "pdf"=>"11", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"12"}
- {"unique-ip"=>"22", "full-text"=>"23", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2016", "month"=>"1"}
- {"unique-ip"=>"10", "full-text"=>"9", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"3"}
- {"unique-ip"=>"9", "full-text"=>"7", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"4"}
- {"unique-ip"=>"6", "full-text"=>"9", "pdf"=>"6", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"5"}
- {"unique-ip"=>"10", "full-text"=>"9", "pdf"=>"5", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"6"}
- {"unique-ip"=>"7", "full-text"=>"6", "pdf"=>"5", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"7"}
- {"unique-ip"=>"13", "full-text"=>"16", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"8"}
- {"unique-ip"=>"10", "full-text"=>"10", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"9"}
- {"unique-ip"=>"6", "full-text"=>"7", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"10"}
- {"unique-ip"=>"19", "full-text"=>"20", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2016", "month"=>"11"}
- {"unique-ip"=>"10", "full-text"=>"9", "pdf"=>"6", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"12"}
- {"unique-ip"=>"14", "full-text"=>"10", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"1", "year"=>"2017", "month"=>"1"}
- {"unique-ip"=>"9", "full-text"=>"8", "pdf"=>"8", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"2"}
- {"unique-ip"=>"10", "full-text"=>"8", "pdf"=>"5", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2017", "month"=>"3"}
- {"unique-ip"=>"5", "full-text"=>"3", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"4"}
- {"unique-ip"=>"4", "full-text"=>"4", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"5"}
- {"unique-ip"=>"6", "full-text"=>"7", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"6"}
- {"unique-ip"=>"8", "full-text"=>"9", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"7"}
- {"unique-ip"=>"9", "full-text"=>"9", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2017", "month"=>"8"}
- {"unique-ip"=>"6", "full-text"=>"5", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"9"}
- {"unique-ip"=>"11", "full-text"=>"6", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2017", "month"=>"10"}
- {"unique-ip"=>"13", "full-text"=>"7", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2017", "month"=>"11"}
- {"unique-ip"=>"9", "full-text"=>"9", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"12"}
- {"unique-ip"=>"6", "full-text"=>"6", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"1"}
- {"unique-ip"=>"13", "full-text"=>"15", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"1", "year"=>"2018", "month"=>"3"}
- {"unique-ip"=>"7", "full-text"=>"6", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2019", "month"=>"1"}
Relative Metric
{"start_date"=>"2015-01-01T00:00:00Z", "end_date"=>"2015-12-31T00:00:00Z", "subject_areas"=>[]}Loading … 

There are currently no alerts