CiteULike

Mendeley | Further Information

{"title"=>"\"Rate My Therapist\": Automated Detection of Empathy in Drug and Alcohol Counseling via Speech and Language Processing", "type"=>"journal", "authors"=>[{"last_name"=>"Bo Xiao", "scopus_author_id"=>"57076927300"}, {"first_name"=>"Zac E.", "last_name"=>"Imel", "scopus_author_id"=>"13405510700"}, {"first_name"=>"Panayiotis G.", "last_name"=>"Georgiou", "scopus_author_id"=>"7003719827"}, {"first_name"=>"David C.", "last_name"=>"Atkins", "scopus_author_id"=>"7102290550"}, {"first_name"=>"Shrikanth S.", "last_name"=>"Narayanan", "scopus_author_id"=>"11539478500"}], "year"=>2015, "source"=>"PLoS ONE", "identifiers"=>{"issn"=>"19326203", "scopus"=>"2-s2.0-84955508891", "sgr"=>"84955508891", "pui"=>"607883997", "isbn"=>"1932-6203", "pmid"=>"26630392", "doi"=>"10.1371/journal.pone.0143055"}, "id"=>"20883af5-2b63-3761-8cab-b65eb38f642e", "abstract"=>"The technology for evaluating patient-provider interactions in psychotherapy-observational coding-has not changed in 70 years. It is labor-intensive, error prone, and expensive, limiting its use in evaluating psychotherapy in the real world. Engineering solutions from speech and language processing provide new methods for the automatic evaluation of provider ratings from session recordings. The primary data are 200 Motivational Interviewing (MI) sessions from a study on MI training methods with observer ratings of counselor empathy. Automatic Speech Recognition (ASR) was used to transcribe sessions, and the resulting words were used in a text-based predictive model of empathy. Two supporting datasets trained the speech processing tasks including ASR (1200 transcripts from heterogeneous psychotherapy sessions and 153 transcripts and session recordings from 5 MI clinical trials). The accuracy of computationally-derived empathy ratings were evaluated against human ratings for each provider. Computationally-derived empathy scores and classifications (high vs. low) were highly accurate against human-based codes and classifications, with a correlation of 0.65 and F-score (a weighted average of sensitivity and specificity) of 0.86, respectively. Empathy prediction using human transcription as input (as opposed to ASR) resulted in a slight increase in prediction accuracies, suggesting that the fully automatic system with ASR is relatively robust. Using speech and language processing methods, it is possible to generate accurate predictions of provider performance in psychotherapy from audio recordings alone. This technology can support large-scale evaluation of psychotherapy for dissemination and process studies.", "link"=>"http://www.mendeley.com/research/rate-therapist-automated-detection-empathy-drug-alcohol-counseling-via-speech-language-processing", "reader_count"=>40, "reader_count_by_academic_status"=>{"Unspecified"=>2, "Professor > Associate Professor"=>1, "Librarian"=>1, "Student > Doctoral Student"=>5, "Researcher"=>8, "Student > Ph. D. Student"=>9, "Student > Master"=>6, "Student > Bachelor"=>3, "Lecturer > Senior Lecturer"=>1, "Professor"=>4}, "reader_count_by_user_role"=>{"Unspecified"=>2, "Professor > Associate Professor"=>1, "Librarian"=>1, "Student > Doctoral Student"=>5, "Researcher"=>8, "Student > Ph. D. Student"=>9, "Student > Master"=>6, "Student > Bachelor"=>3, "Lecturer > Senior Lecturer"=>1, "Professor"=>4}, "reader_count_by_subject_area"=>{"Engineering"=>2, "Unspecified"=>3, "Nursing and Health Professions"=>2, "Medicine and Dentistry"=>3, "Business, Management and Accounting"=>1, "Psychology"=>16, "Social Sciences"=>1, "Computer Science"=>12}, "reader_count_by_subdiscipline"=>{"Engineering"=>{"Engineering"=>2}, "Medicine and Dentistry"=>{"Medicine and Dentistry"=>3}, "Social Sciences"=>{"Social Sciences"=>1}, "Psychology"=>{"Psychology"=>16}, "Computer Science"=>{"Computer Science"=>12}, "Nursing and Health Professions"=>{"Nursing and Health Professions"=>2}, "Business, Management and Accounting"=>{"Business, Management and Accounting"=>1}, "Unspecified"=>{"Unspecified"=>3}}, "reader_count_by_country"=>{"Australia"=>2, "Spain"=>1}, "group_count"=>4}

ORCID

CrossRef

• http://doi.org/10.1186/s13012-017-0697-2
• http://doi.org/10.1016/j.csl.2018.11.002
• http://doi.org/10.1007/s10935-018-00534-z
• http://doi.org/10.1007/s11920-017-0839-x
• http://doi.org/10.1080/15374416.2018.1561295
• http://doi.org/10.3389/fpubh.2018.00293
• http://doi.org/10.1002/da.22640
• http://doi.org/10.1186/s13012-017-0633-5
• http://doi.org/10.7717/peerj-cs.59
• http://doi.org/10.1109/MSP.2017.2718581
• http://doi.org/10.2196/10148

DataCite

Europe PMC Citations

Europe PMC Database Citations

PubMed Central

Scopus | Further Information

{"@_fa"=>"true", "link"=>[{"@_fa"=>"true", "@ref"=>"self", "@href"=>"https://api.elsevier.com/content/abstract/scopus_id/84955508891"}, {"@_fa"=>"true", "@ref"=>"author-affiliation", "@href"=>"https://api.elsevier.com/content/abstract/scopus_id/84955508891?field=author,affiliation"}, {"@_fa"=>"true", "@ref"=>"scopus", "@href"=>"https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=84955508891&origin=inward"}, {"@_fa"=>"true", "@ref"=>"scopus-citedby", "@href"=>"https://www.scopus.com/inward/citedby.uri?partnerID=HzOxMe3b&scp=84955508891&origin=inward"}], "prism:url"=>"https://api.elsevier.com/content/abstract/scopus_id/84955508891", "dc:identifier"=>"SCOPUS_ID:84955508891", "eid"=>"2-s2.0-84955508891", "dc:title"=>"\"Rate My Therapist\": Automated Detection of Empathy in Drug and Alcohol Counseling via Speech and Language Processing", "dc:creator"=>"Bo Xiao", "prism:publicationName"=>"PLoS ONE", "prism:eIssn"=>"19326203", "prism:volume"=>"10", "prism:issueIdentifier"=>"12", "prism:pageRange"=>nil, "prism:coverDate"=>"2015-12-01", "prism:coverDisplayDate"=>"1 December 2015", "prism:doi"=>"10.1371/journal.pone.0143055", "citedby-count"=>"24", "affiliation"=>[{"@_fa"=>"true", "affilname"=>"University of Southern California", "affiliation-city"=>"Los Angeles", "affiliation-country"=>"United States"}], "pubmed-id"=>"26630392", "prism:aggregationType"=>"Journal", "subtype"=>"ar", "subtypeDescription"=>"Article", "article-number"=>"e0143055", "source-id"=>"10600153309", "openaccess"=>"1", "openaccessFlag"=>true}

Web of Science®

Article Coverage

Article Coverage Curated

Facebook

• {"url"=>"http%3A%2F%2Fjournals.plos.org%2Fplosone%2Farticle%3Fid%3D10.1371%252Fjournal.pone.0143055", "share_count"=>3, "like_count"=>2, "comment_count"=>3, "click_count"=>0, "total_count"=>8}

Journal Comments

Reddit

Twitter

• {"id"=>"672285533251375104", "text"=>"セッション中の発話からカウンセラーの共感レベルを自動で判定する方法を開発。\"Rate My Therapist\": Automated Detection of Empathy in Drug and Alcohol… https://t.co/IHFiQPlUco", "created_at"=>"2015-12-03T05:25:36Z", "user"=>"uranus_2", "user_name"=>"マーキュリー２世", "user_profile_image"=>"http://pbs.twimg.com/profile_images/650483455248064512/EOJq3sZX_normal.png"}
• {"id"=>"672551018106765314", "text"=>"RT @uranus_2: セッション中の発話からカウンセラーの共感レベルを自動で判定する方法を開発。\"Rate My Therapist\": Automated Detection of Empathy in Drug and Alcohol… https://t.co/IH…", "created_at"=>"2015-12-03T23:00:32Z", "user"=>"Xx__SaSuKe__xX", "user_name"=>"さっちん。", "user_profile_image"=>"http://pbs.twimg.com/profile_images/583283450318221312/h4-HJbXA_normal.jpg"}
• {"id"=>"674854199016886272", "text"=>"Software eating psychiatry? Check out this system that auto-detects #empathy. https://t.co/uGOqH0phVj @PLOSONE cc: @pmarca @bhorowitz @a16z", "created_at"=>"2015-12-10T07:32:33Z", "user"=>"ryanlouie", "user_name"=>"Ryan K. Louie MD PhD", "user_profile_image"=>"http://pbs.twimg.com/profile_images/661669866265448448/bCobRaD8_normal.jpg"}
• {"id"=>"676340917658365952", "text"=>"Rating empathy of provider through speech and language processing software. Will this replace observer coding?!?https://t.co/i3WreFr6zO", "created_at"=>"2015-12-14T10:00:15Z", "user"=>"IsabelleScholl", "user_name"=>"Isabelle Scholl", "user_profile_image"=>"http://pbs.twimg.com/profile_images/2320268505/9cdw0p7igllvpsr6czin_normal.jpeg"}
• {"id"=>"676783613552234496", "text"=>"Way cheaper than grad students: Atkins taught a computer to code interviews, coded ~1.5k in 2 weeks #discience15 https://t.co/SB1C6F5vI0", "created_at"=>"2015-12-15T15:19:22Z", "user"=>"HowardChiou", "user_name"=>"Howard Chiou", "user_profile_image"=>"http://pbs.twimg.com/profile_images/1898895677/ToTing39_normal.jpg"}
• {"id"=>"676783787410399232", "text"=>"RT @HowardChiou: Way cheaper than grad students: Atkins taught a computer to code interviews, coded ~1.5k in 2 weeks #discience15 https://…", "created_at"=>"2015-12-15T15:20:03Z", "user"=>"edm_ah", "user_name"=>"EDM Forum", "user_profile_image"=>"http://pbs.twimg.com/profile_images/603912460026777600/VQhcQ4Oi_normal.jpg"}
• {"id"=>"676783790291820544", "text"=>"RT @HowardChiou: Way cheaper than grad students: Atkins taught a computer to code interviews, coded ~1.5k in 2 weeks #discience15 https://…", "created_at"=>"2015-12-15T15:20:04Z", "user"=>"diportal_unc", "user_name"=>"D&I portal", "user_profile_image"=>"http://pbs.twimg.com/profile_images/483693561284526080/l1QWkY9Y_normal.png"}
• {"id"=>"676783882113564673", "text"=>"RT @HowardChiou: Way cheaper than grad students: Atkins taught a computer to code interviews, coded ~1.5k in 2 weeks #discience15 https://…", "created_at"=>"2015-12-15T15:20:26Z", "user"=>"ConsortiumforIS", "user_name"=>"ConsortiumforIS", "user_profile_image"=>"http://pbs.twimg.com/profile_images/530437161615503360/4vdH_JBn_normal.png"}
• {"id"=>"676783899272433668", "text"=>"RT @HowardChiou: Way cheaper than grad students: Atkins taught a computer to code interviews, coded ~1.5k in 2 weeks #discience15 https://…", "created_at"=>"2015-12-15T15:20:30Z", "user"=>"SJLandes", "user_name"=>"Sara J. Landes", "user_profile_image"=>"http://pbs.twimg.com/profile_images/567513289404334081/uvjUyOYf_normal.jpeg"}
• {"id"=>"676789169520312320", "text"=>"RT @HowardChiou: Way cheaper than grad students: Atkins taught a computer to code interviews, coded ~1.5k in 2 weeks #discience15 https://…", "created_at"=>"2015-12-15T15:41:26Z", "user"=>"wendyr13", "user_name"=>"Wendy Rueda", "user_profile_image"=>"http://pbs.twimg.com/profile_images/622044876054507520/OMwBPJLq_normal.jpg"}
• {"id"=>"806277228296179712", "text"=>"Narayanan refs paper, which drew lots of attn in popular media perhaps due 2 cool title \"Rate my therapist\" https://t.co/7DNOEgiZ4P #SST2016", "created_at"=>"2016-12-06T23:20:45Z", "user"=>"joshuaclx", "user_name"=>"Joshua J. Clothier", "user_profile_image"=>"http://pbs.twimg.com/profile_images/484158139109883904/rIi_xatj_normal.jpeg"}
• {"id"=>"806277539811315712", "text"=>"Curious - Using tech to identify empathy in therapists. Just cited by co-auth Narayanan at #SST2016 https://t.co/D6Dx9vZ9KS", "created_at"=>"2016-12-06T23:22:00Z", "user"=>"SarahMasso", "user_name"=>"Sarah Masso", "user_profile_image"=>"http://pbs.twimg.com/profile_images/3122989651/fea999f592d660e7334781999ca9efe5_normal.jpeg"}

Wikipedia

Counter

• {"month"=>"12", "year"=>"2015", "pdf_views"=>"116", "xml_views"=>"4", "html_views"=>"943"}
• {"month"=>"1", "year"=>"2016", "pdf_views"=>"36", "xml_views"=>"0", "html_views"=>"216"}
• {"month"=>"2", "year"=>"2016", "pdf_views"=>"4", "xml_views"=>"0", "html_views"=>"99"}
• {"month"=>"3", "year"=>"2016", "pdf_views"=>"21", "xml_views"=>"0", "html_views"=>"98"}
• {"month"=>"4", "year"=>"2016", "pdf_views"=>"25", "xml_views"=>"0", "html_views"=>"88"}
• {"month"=>"5", "year"=>"2016", "pdf_views"=>"18", "xml_views"=>"0", "html_views"=>"89"}
• {"month"=>"6", "year"=>"2016", "pdf_views"=>"26", "xml_views"=>"0", "html_views"=>"69"}
• {"month"=>"7", "year"=>"2016", "pdf_views"=>"25", "xml_views"=>"0", "html_views"=>"57"}
• {"month"=>"8", "year"=>"2016", "pdf_views"=>"19", "xml_views"=>"0", "html_views"=>"58"}
• {"month"=>"9", "year"=>"2016", "pdf_views"=>"20", "xml_views"=>"0", "html_views"=>"60"}
• {"month"=>"10", "year"=>"2016", "pdf_views"=>"33", "xml_views"=>"0", "html_views"=>"100"}
• {"month"=>"11", "year"=>"2016", "pdf_views"=>"18", "xml_views"=>"0", "html_views"=>"56"}
• {"month"=>"12", "year"=>"2016", "pdf_views"=>"11", "xml_views"=>"0", "html_views"=>"71"}
• {"month"=>"1", "year"=>"2017", "pdf_views"=>"20", "xml_views"=>"0", "html_views"=>"74"}
• {"month"=>"2", "year"=>"2017", "pdf_views"=>"4", "xml_views"=>"1", "html_views"=>"54"}
• {"month"=>"3", "year"=>"2017", "pdf_views"=>"19", "xml_views"=>"4", "html_views"=>"84"}
• {"month"=>"4", "year"=>"2017", "pdf_views"=>"16", "xml_views"=>"1", "html_views"=>"65"}
• {"month"=>"5", "year"=>"2017", "pdf_views"=>"24", "xml_views"=>"1", "html_views"=>"80"}
• {"month"=>"6", "year"=>"2017", "pdf_views"=>"14", "xml_views"=>"0", "html_views"=>"78"}
• {"month"=>"7", "year"=>"2017", "pdf_views"=>"21", "xml_views"=>"0", "html_views"=>"63"}
• {"month"=>"8", "year"=>"2017", "pdf_views"=>"11", "xml_views"=>"1", "html_views"=>"47"}
• {"month"=>"9", "year"=>"2017", "pdf_views"=>"21", "xml_views"=>"1", "html_views"=>"57"}
• {"month"=>"10", "year"=>"2017", "pdf_views"=>"12", "xml_views"=>"0", "html_views"=>"79"}
• {"month"=>"11", "year"=>"2017", "pdf_views"=>"9", "xml_views"=>"0", "html_views"=>"122"}
• {"month"=>"12", "year"=>"2017", "pdf_views"=>"13", "xml_views"=>"1", "html_views"=>"125"}
• {"month"=>"1", "year"=>"2018", "pdf_views"=>"11", "xml_views"=>"0", "html_views"=>"57"}
• {"month"=>"2", "year"=>"2018", "pdf_views"=>"28", "xml_views"=>"0", "html_views"=>"73"}
• {"month"=>"3", "year"=>"2018", "pdf_views"=>"20", "xml_views"=>"1", "html_views"=>"39"}
• {"month"=>"4", "year"=>"2018", "pdf_views"=>"32", "xml_views"=>"0", "html_views"=>"63"}
• {"month"=>"5", "year"=>"2018", "pdf_views"=>"35", "xml_views"=>"1", "html_views"=>"51"}
• {"month"=>"6", "year"=>"2018", "pdf_views"=>"12", "xml_views"=>"3", "html_views"=>"38"}
• {"month"=>"7", "year"=>"2018", "pdf_views"=>"16", "xml_views"=>"3", "html_views"=>"32"}
• {"month"=>"8", "year"=>"2018", "pdf_views"=>"11", "xml_views"=>"1", "html_views"=>"25"}
• {"month"=>"9", "year"=>"2018", "pdf_views"=>"11", "xml_views"=>"0", "html_views"=>"46"}
• {"month"=>"10", "year"=>"2018", "pdf_views"=>"35", "xml_views"=>"1", "html_views"=>"71"}
• {"month"=>"11", "year"=>"2018", "pdf_views"=>"10", "xml_views"=>"0", "html_views"=>"28"}
• {"month"=>"12", "year"=>"2018", "pdf_views"=>"8", "xml_views"=>"0", "html_views"=>"23"}
• {"month"=>"1", "year"=>"2019", "pdf_views"=>"15", "xml_views"=>"1", "html_views"=>"36"}
• {"month"=>"2", "year"=>"2019", "pdf_views"=>"16", "xml_views"=>"0", "html_views"=>"29"}

Figshare

• {"files"=>["https://ndownloader.figshare.com/files/2598554"], "description"=>"<p>The lower portion of the figure represents the process for a single session recording, whereas the upper portion represents various speech signal processing tasks, learned from all available corpora (as indicated in the text).</p>", "links"=>[], "tags"=>["rating", "speech processing tasks", "prediction", "provider", "evaluation", "empathy", "session recordings", "classification", "asr", "language processing methods", "psychotherapy", "MI training methods", "technology", "automatic speech recognition", "transcript", "200 Motivational Interviewing"], "article_id"=>1617393, "categories"=>["Biological Sciences", "Science Policy"], "users"=>["Bo Xiao", "Zac E. Imel", "Panayiotis G. Georgiou", "David C. Atkins", "Shrikanth S. Narayanan"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0143055.g002", "stats"=>{"downloads"=>0, "page_views"=>0, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Overview_of_processing_steps_for_moving_from_audio_recording_of_session_to_predicted_value_of_empathy_/1617393", "title"=>"Overview of processing steps for moving from audio recording of session to predicted value of empathy.", "pos_in_sequence"=>0, "defined_type"=>1, "published_date"=>"2015-12-02 04:58:24"}
• {"files"=>["https://ndownloader.figshare.com/files/2598555"], "description"=>"<p><i>Note</i>. ASR = Automatic speech recognition; LM = language model; AM = acoustic model</p><p>^a For further information on the specific MI randomized trials are summarized see. [<a href=\"http://www.plosone.org/article/info:doi/10.1371/journal.pone.0143055#pone.0143055.ref024\" target=\"_blank\">24</a>] Specific studies include Alcohol Research Collaborative: Peer Programs; [<a href=\"http://www.plosone.org/article/info:doi/10.1371/journal.pone.0143055#pone.0143055.ref052\" target=\"_blank\">52</a>] Event Specific Prevention: Spring Break; [<a href=\"http://www.plosone.org/article/info:doi/10.1371/journal.pone.0143055#pone.0143055.ref053\" target=\"_blank\">53</a>] Event Specific Prevention: Twenty First Birthday; [<a href=\"http://www.plosone.org/article/info:doi/10.1371/journal.pone.0143055#pone.0143055.ref054\" target=\"_blank\">54</a>] Brief Intervention for Problem Drug Use and Abuse in Primary Care; [<a href=\"http://www.plosone.org/article/info:doi/10.1371/journal.pone.0143055#pone.0143055.ref055\" target=\"_blank\">55</a>] Indicated Marijuana Prevention for Frequently Using College Students. [<a href=\"http://www.plosone.org/article/info:doi/10.1371/journal.pone.0143055#pone.0143055.ref056\" target=\"_blank\">56</a>]</p><p>^b CTT = Context Tailored Training. [<a href=\"http://www.plosone.org/article/info:doi/10.1371/journal.pone.0143055#pone.0143055.ref023\" target=\"_blank\">23</a>]</p><p>Summary of psychotherapy corpora and role in automatic empathy evaluation.</p>", "links"=>[], "tags"=>["rating", "speech processing tasks", "prediction", "provider", "evaluation", "empathy", "session recordings", "classification", "asr", "language processing methods", "psychotherapy", "MI training methods", "technology", "automatic speech recognition", "transcript", "200 Motivational Interviewing"], "article_id"=>1617394, "categories"=>["Biological Sciences", "Science Policy"], "users"=>["Bo Xiao", "Zac E. Imel", "Panayiotis G. Georgiou", "David C. Atkins", "Shrikanth S. Narayanan"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0143055.t001", "stats"=>{"downloads"=>1, "page_views"=>3, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Summary_of_psychotherapy_corpora_and_role_in_automatic_empathy_evaluation_/1617394", "title"=>"Summary of psychotherapy corpora and role in automatic empathy evaluation.", "pos_in_sequence"=>0, "defined_type"=>3, "published_date"=>"2015-12-02 04:58:24"}
• {"files"=>["https://ndownloader.figshare.com/files/2598556"], "description"=>"<p>^a These results were calculated on 63 sessions instead of 200. On sessions coded by multiple coders, the average opinion is used to derive the dichotomous (binarized) decision. The opinion of the individual coder is compared with the average decision to establish this coder-agreement.</p><p>^b Result is fully automatic, no human intervention in algorithm.</p><p>Empathy prediction performance.</p>", "links"=>[], "tags"=>["rating", "speech processing tasks", "prediction", "provider", "evaluation", "empathy", "session recordings", "classification", "asr", "language processing methods", "psychotherapy", "MI training methods", "technology", "automatic speech recognition", "transcript", "200 Motivational Interviewing"], "article_id"=>1617395, "categories"=>["Biological Sciences", "Science Policy"], "users"=>["Bo Xiao", "Zac E. Imel", "Panayiotis G. Georgiou", "David C. Atkins", "Shrikanth S. Narayanan"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0143055.t002", "stats"=>{"downloads"=>1, "page_views"=>1, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Empathy_prediction_performance_/1617395", "title"=>"Empathy prediction performance.", "pos_in_sequence"=>0, "defined_type"=>3, "published_date"=>"2015-12-02 04:58:24"}
• {"files"=>["https://ndownloader.figshare.com/files/2598557"], "description"=>"<p>High vs. low empathy tri-grams.</p>", "links"=>[], "tags"=>["rating", "speech processing tasks", "prediction", "provider", "evaluation", "empathy", "session recordings", "classification", "asr", "language processing methods", "psychotherapy", "MI training methods", "technology", "automatic speech recognition", "transcript", "200 Motivational Interviewing"], "article_id"=>1617396, "categories"=>["Biological Sciences", "Science Policy"], "users"=>["Bo Xiao", "Zac E. Imel", "Panayiotis G. Georgiou", "David C. Atkins", "Shrikanth S. Narayanan"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0143055.t003", "stats"=>{"downloads"=>0, "page_views"=>8, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_High_vs_low_empathy_tri_grams_/1617396", "title"=>"High vs. low empathy tri-grams.", "pos_in_sequence"=>0, "defined_type"=>3, "published_date"=>"2015-12-02 04:58:24"}
• {"files"=>["https://ndownloader.figshare.com/files/2598558"], "description"=>"<div><p>The technology for evaluating patient-provider interactions in psychotherapy–observational coding–has not changed in 70 years. It is labor-intensive, error prone, and expensive, limiting its use in evaluating psychotherapy in the real world. Engineering solutions from speech and language processing provide new methods for the automatic evaluation of provider ratings from session recordings. The primary data are 200 Motivational Interviewing (MI) sessions from a study on MI training methods with observer ratings of counselor empathy. Automatic Speech Recognition (ASR) was used to transcribe sessions, and the resulting words were used in a text-based predictive model of empathy. Two supporting datasets trained the speech processing tasks including ASR (1200 transcripts from heterogeneous psychotherapy sessions and 153 transcripts and session recordings from 5 MI clinical trials). The accuracy of computationally-derived empathy ratings were evaluated against human ratings for each provider. Computationally-derived empathy scores and classifications (high vs. low) were highly accurate against human-based codes and classifications, with a correlation of 0.65 and F-score (a weighted average of sensitivity and specificity) of 0.86, respectively. Empathy prediction using human transcription as input (as opposed to ASR) resulted in a slight increase in prediction accuracies, suggesting that the fully automatic system with ASR is relatively robust. Using speech and language processing methods, it is possible to generate accurate predictions of provider performance in psychotherapy from audio recordings alone. This technology can support large-scale evaluation of psychotherapy for dissemination and process studies.</p></div>", "links"=>[], "tags"=>["rating", "speech processing tasks", "prediction", "provider", "evaluation", "empathy", "session recordings", "classification", "asr", "language processing methods", "psychotherapy", "MI training methods", "technology", "automatic speech recognition", "transcript", "200 Motivational Interviewing"], "article_id"=>1617397, "categories"=>["Biological Sciences", "Science Policy"], "users"=>["Bo Xiao", "Zac E. Imel", "Panayiotis G. Georgiou", "David C. Atkins", "Shrikanth S. Narayanan"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0143055", "stats"=>{"downloads"=>5, "page_views"=>3, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Rate_My_Therapist_Automated_Detection_of_Empathy_in_Drug_and_Alcohol_Counseling_via_Speech_and_Language_Processing_/1617397", "title"=>"\"Rate My Therapist\": Automated Detection of Empathy in Drug and Alcohol Counseling via Speech and Language Processing", "pos_in_sequence"=>0, "defined_type"=>3, "published_date"=>"2015-12-02 04:58:24"}
• {"files"=>["https://ndownloader.figshare.com/files/2598551"], "description"=>"<p>Distribution of human empathy ratings for the 200 sessions in the CTT trial.</p>", "links"=>[], "tags"=>["rating", "speech processing tasks", "prediction", "provider", "evaluation", "empathy", "session recordings", "classification", "asr", "language processing methods", "psychotherapy", "MI training methods", "technology", "automatic speech recognition", "transcript", "200 Motivational Interviewing"], "article_id"=>1617390, "categories"=>["Biological Sciences", "Science Policy"], "users"=>["Bo Xiao", "Zac E. Imel", "Panayiotis G. Georgiou", "David C. Atkins", "Shrikanth S. Narayanan"], "doi"=>"https://dx.doi.org/10.1371/journal.pone.0143055.g001", "stats"=>{"downloads"=>1, "page_views"=>1, "likes"=>0}, "figshare_url"=>"https://figshare.com/articles/_Distribution_of_human_empathy_ratings_for_the_200_sessions_in_the_CTT_trial_/1617390", "title"=>"Distribution of human empathy ratings for the 200 sessions in the CTT trial.", "pos_in_sequence"=>0, "defined_type"=>1, "published_date"=>"2015-12-02 04:58:24"}

PMC Usage Stats | Further Information

• {"unique-ip"=>"7", "full-text"=>"7", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"2"}
• {"unique-ip"=>"21", "full-text"=>"19", "pdf"=>"11", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2015", "month"=>"12"}
• {"unique-ip"=>"22", "full-text"=>"23", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2016", "month"=>"1"}
• {"unique-ip"=>"10", "full-text"=>"9", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"3"}
• {"unique-ip"=>"9", "full-text"=>"7", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"4"}
• {"unique-ip"=>"6", "full-text"=>"9", "pdf"=>"6", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"5"}
• {"unique-ip"=>"10", "full-text"=>"9", "pdf"=>"5", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"6"}
• {"unique-ip"=>"7", "full-text"=>"6", "pdf"=>"5", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"7"}
• {"unique-ip"=>"13", "full-text"=>"16", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"8"}
• {"unique-ip"=>"10", "full-text"=>"10", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"9"}
• {"unique-ip"=>"6", "full-text"=>"7", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"10"}
• {"unique-ip"=>"19", "full-text"=>"20", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2016", "month"=>"11"}
• {"unique-ip"=>"10", "full-text"=>"9", "pdf"=>"6", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"12"}
• {"unique-ip"=>"14", "full-text"=>"10", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"1", "year"=>"2017", "month"=>"1"}
• {"unique-ip"=>"9", "full-text"=>"8", "pdf"=>"8", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"2"}
• {"unique-ip"=>"10", "full-text"=>"8", "pdf"=>"5", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2017", "month"=>"3"}
• {"unique-ip"=>"5", "full-text"=>"3", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"4"}
• {"unique-ip"=>"4", "full-text"=>"4", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"5"}
• {"unique-ip"=>"6", "full-text"=>"7", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"6"}
• {"unique-ip"=>"8", "full-text"=>"9", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"7"}
• {"unique-ip"=>"9", "full-text"=>"9", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2017", "month"=>"8"}
• {"unique-ip"=>"6", "full-text"=>"5", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"9"}
• {"unique-ip"=>"11", "full-text"=>"6", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2017", "month"=>"10"}
• {"unique-ip"=>"13", "full-text"=>"7", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2017", "month"=>"11"}
• {"unique-ip"=>"9", "full-text"=>"9", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"12"}
• {"unique-ip"=>"6", "full-text"=>"6", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"1"}
• {"unique-ip"=>"13", "full-text"=>"15", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"1", "year"=>"2018", "month"=>"3"}
• {"unique-ip"=>"7", "full-text"=>"6", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2019", "month"=>"1"}

Relative Metric

{"start_date"=>"2015-01-01T00:00:00Z", "end_date"=>"2015-12-31T00:00:00Z", "subject_areas"=>[]}

F1000Prime