How Big of a Problem is Analytic Error in Secondary Analyses of Survey Data?
Publication Date
June 29, 2016
Journal
PLOS ONE
Authors
Brady T. West, Joseph W. Sakshaug & Guy Alain S. Aurelien
Volume
11
Issue
6
Pages
e0158120
DOI
https://dx.plos.org/10.1371/journal.pone.0158120
Publisher URL
http://journals.plos.org/plosone/article?id=10.1371%2Fjournal.pone.0158120
Scopus
84977657882
Mendeley
http://www.mendeley.com/research/big-problem-analytic-error-secondary-analyses-survey-data
Events
Loading … Spinner

Mendeley | Further Information

{"title"=>"How big of a problem is analytic error in secondary analyses of survey data?", "type"=>"journal", "authors"=>[{"first_name"=>"Brady T.", "last_name"=>"West", "scopus_author_id"=>"12753624200"}, {"first_name"=>"Joseph W.", "last_name"=>"Sakshaug", "scopus_author_id"=>"35300521200"}, {"first_name"=>"Guy Alain S.", "last_name"=>"Aurelien", "scopus_author_id"=>"57190133589"}], "year"=>2016, "source"=>"PLoS ONE", "identifiers"=>{"sgr"=>"84977657882", "pui"=>"611071370", "issn"=>"19326203", "isbn"=>"1932-6203", "scopus"=>"2-s2.0-84977657882", "doi"=>"10.1371/journal.pone.0158120"}, "id"=>"609b9eee-525a-344f-a273-8610b2b15590", "abstract"=>"Secondary analyses of survey data collected from large probability samples of persons or establishments further scientific progress in many fields. The complex design features of these samples improve data collection efficiency, but also require analysts to account for these features when conducting analysis. Unfortunately, many secondary analysts from fields outside of statistics, biostatistics, and survey methodology do not have adequate training in this area, and as a result may apply incorrect statistical methods when analyzing these survey data sets. This in turn could lead to the publication of incorrect inferences based on the survey data that effectively negate the resources dedicated to these surveys. In this article, we build on the results of a preliminary meta-analysis of 100 peer-reviewed journal articles presenting analyses of data from a variety of national health surveys, which suggested that analytic errors may be extremely prevalent in these types of investigations. We first perform a meta-analysis of a stratified random sample of 145 additional research products analyzing survey data from the Scientists and Engineers Statistical Data System (SESTAT), which describes features of the U.S. Science and Engineering workforce, and examine trends in the prevalence of analytic error across the decades used to stratify the sample. We once again find that analytic errors appear to be quite prevalent in these studies. Next, we present several example analyses of real SESTAT data, and demonstrate that a failure to perform these analyses correctly can result in substantially biased estimates with standard errors that do not adequately reflect complex sample design features. Collectively, the results of this investigation suggest that reviewers of this type of research need to pay much closer attention to the analytic methods employed by researchers attempting to publish or present secondary analyses of survey data.", "link"=>"http://www.mendeley.com/research/big-problem-analytic-error-secondary-analyses-survey-data", "reader_count"=>18, "reader_count_by_academic_status"=>{"Student > Doctoral Student"=>3, "Researcher"=>4, "Student > Ph. D. Student"=>5, "Other"=>3, "Student > Master"=>2, "Lecturer"=>1}, "reader_count_by_user_role"=>{"Student > Doctoral Student"=>3, "Researcher"=>4, "Student > Ph. D. Student"=>5, "Other"=>3, "Student > Master"=>2, "Lecturer"=>1}, "reader_count_by_subject_area"=>{"Unspecified"=>2, "Mathematics"=>1, "Medicine and Dentistry"=>1, "Business, Management and Accounting"=>2, "Social Sciences"=>8, "Computer Science"=>3, "Economics, Econometrics and Finance"=>1}, "reader_count_by_subdiscipline"=>{"Medicine and Dentistry"=>{"Medicine and Dentistry"=>1}, "Social Sciences"=>{"Social Sciences"=>8}, "Economics, Econometrics and Finance"=>{"Economics, Econometrics and Finance"=>1}, "Computer Science"=>{"Computer Science"=>3}, "Business, Management and Accounting"=>{"Business, Management and Accounting"=>2}, "Mathematics"=>{"Mathematics"=>1}, "Unspecified"=>{"Unspecified"=>2}}, "reader_count_by_country"=>{"United States"=>1, "Germany"=>1}, "group_count"=>2}

Scopus | Further Information

{"@_fa"=>"true", "link"=>[{"@_fa"=>"true", "@ref"=>"self", "@href"=>"https://api.elsevier.com/content/abstract/scopus_id/84977657882"}, {"@_fa"=>"true", "@ref"=>"author-affiliation", "@href"=>"https://api.elsevier.com/content/abstract/scopus_id/84977657882?field=author,affiliation"}, {"@_fa"=>"true", "@ref"=>"scopus", "@href"=>"https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=84977657882&origin=inward"}, {"@_fa"=>"true", "@ref"=>"scopus-citedby", "@href"=>"https://www.scopus.com/inward/citedby.uri?partnerID=HzOxMe3b&scp=84977657882&origin=inward"}], "prism:url"=>"https://api.elsevier.com/content/abstract/scopus_id/84977657882", "dc:identifier"=>"SCOPUS_ID:84977657882", "eid"=>"2-s2.0-84977657882", "dc:title"=>"How big of a problem is analytic error in secondary analyses of survey data?", "dc:creator"=>"West B.", "prism:publicationName"=>"PLoS ONE", "prism:eIssn"=>"19326203", "prism:volume"=>"11", "prism:issueIdentifier"=>"6", "prism:pageRange"=>nil, "prism:coverDate"=>"2016-06-01", "prism:coverDisplayDate"=>"June 2016", "prism:doi"=>"10.1371/journal.pone.0158120", "citedby-count"=>"6", "affiliation"=>[{"@_fa"=>"true", "affilname"=>"University of Michigan, Ann Arbor", "affiliation-city"=>"Ann Arbor", "affiliation-country"=>"United States"}], "pubmed-id"=>"27355817", "prism:aggregationType"=>"Journal", "subtype"=>"ar", "subtypeDescription"=>"Article", "article-number"=>"e0158120", "source-id"=>"10600153309", "openaccess"=>"1", "openaccessFlag"=>true}

Facebook

  • {"url"=>"http%3A%2F%2Fjournals.plos.org%2Fplosone%2Farticle%3Fid%3D10.1371%252Fjournal.pone.0158120", "share_count"=>7, "like_count"=>42, "comment_count"=>6, "click_count"=>0, "total_count"=>55}

Twitter

Counter

  • {"month"=>"6", "year"=>"2016", "pdf_views"=>"7", "xml_views"=>"0", "html_views"=>"137"}
  • {"month"=>"7", "year"=>"2016", "pdf_views"=>"49", "xml_views"=>"0", "html_views"=>"383"}
  • {"month"=>"8", "year"=>"2016", "pdf_views"=>"11", "xml_views"=>"0", "html_views"=>"61"}
  • {"month"=>"9", "year"=>"2016", "pdf_views"=>"27", "xml_views"=>"0", "html_views"=>"194"}
  • {"month"=>"10", "year"=>"2016", "pdf_views"=>"21", "xml_views"=>"0", "html_views"=>"94"}
  • {"month"=>"11", "year"=>"2016", "pdf_views"=>"8", "xml_views"=>"0", "html_views"=>"38"}
  • {"month"=>"12", "year"=>"2016", "pdf_views"=>"7", "xml_views"=>"0", "html_views"=>"38"}
  • {"month"=>"1", "year"=>"2017", "pdf_views"=>"3", "xml_views"=>"0", "html_views"=>"38"}
  • {"month"=>"2", "year"=>"2017", "pdf_views"=>"5", "xml_views"=>"0", "html_views"=>"49"}
  • {"month"=>"3", "year"=>"2017", "pdf_views"=>"11", "xml_views"=>"0", "html_views"=>"65"}
  • {"month"=>"4", "year"=>"2017", "pdf_views"=>"3", "xml_views"=>"0", "html_views"=>"45"}
  • {"month"=>"5", "year"=>"2017", "pdf_views"=>"6", "xml_views"=>"0", "html_views"=>"84"}
  • {"month"=>"6", "year"=>"2017", "pdf_views"=>"11", "xml_views"=>"4", "html_views"=>"77"}
  • {"month"=>"7", "year"=>"2017", "pdf_views"=>"25", "xml_views"=>"7", "html_views"=>"62"}
  • {"month"=>"8", "year"=>"2017", "pdf_views"=>"8", "xml_views"=>"2", "html_views"=>"96"}
  • {"month"=>"9", "year"=>"2017", "pdf_views"=>"8", "xml_views"=>"1", "html_views"=>"201"}
  • {"month"=>"10", "year"=>"2017", "pdf_views"=>"14", "xml_views"=>"0", "html_views"=>"216"}
  • {"month"=>"11", "year"=>"2017", "pdf_views"=>"14", "xml_views"=>"0", "html_views"=>"275"}
  • {"month"=>"12", "year"=>"2017", "pdf_views"=>"6", "xml_views"=>"1", "html_views"=>"285"}
  • {"month"=>"1", "year"=>"2018", "pdf_views"=>"11", "xml_views"=>"0", "html_views"=>"131"}
  • {"month"=>"2", "year"=>"2018", "pdf_views"=>"14", "xml_views"=>"0", "html_views"=>"20"}
  • {"month"=>"3", "year"=>"2018", "pdf_views"=>"10", "xml_views"=>"1", "html_views"=>"29"}
  • {"month"=>"4", "year"=>"2018", "pdf_views"=>"11", "xml_views"=>"0", "html_views"=>"40"}
  • {"month"=>"5", "year"=>"2018", "pdf_views"=>"18", "xml_views"=>"1", "html_views"=>"30"}
  • {"month"=>"6", "year"=>"2018", "pdf_views"=>"15", "xml_views"=>"6", "html_views"=>"32"}
  • {"month"=>"7", "year"=>"2018", "pdf_views"=>"45", "xml_views"=>"3", "html_views"=>"154"}
  • {"month"=>"8", "year"=>"2018", "pdf_views"=>"36", "xml_views"=>"1", "html_views"=>"62"}
  • {"month"=>"9", "year"=>"2018", "pdf_views"=>"15", "xml_views"=>"0", "html_views"=>"45"}
  • {"month"=>"10", "year"=>"2018", "pdf_views"=>"5", "xml_views"=>"1", "html_views"=>"28"}
  • {"month"=>"11", "year"=>"2018", "pdf_views"=>"6", "xml_views"=>"0", "html_views"=>"28"}
  • {"month"=>"12", "year"=>"2018", "pdf_views"=>"19", "xml_views"=>"0", "html_views"=>"24"}
  • {"month"=>"1", "year"=>"2019", "pdf_views"=>"11", "xml_views"=>"0", "html_views"=>"24"}
  • {"month"=>"2", "year"=>"2019", "pdf_views"=>"14", "xml_views"=>"0", "html_views"=>"28"}
  • {"month"=>"3", "year"=>"2019", "pdf_views"=>"14", "xml_views"=>"0", "html_views"=>"59"}
  • {"month"=>"4", "year"=>"2019", "pdf_views"=>"17", "xml_views"=>"0", "html_views"=>"46"}
  • {"month"=>"5", "year"=>"2019", "pdf_views"=>"23", "xml_views"=>"1", "html_views"=>"43"}
  • {"month"=>"6", "year"=>"2019", "pdf_views"=>"13", "xml_views"=>"0", "html_views"=>"40"}
  • {"month"=>"7", "year"=>"2019", "pdf_views"=>"9", "xml_views"=>"0", "html_views"=>"22"}

PMC Usage Stats

  • {"unique-ip"=>"3", "full-text"=>"4", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"7"}
  • {"unique-ip"=>"10", "full-text"=>"12", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2016", "month"=>"8"}
  • {"unique-ip"=>"21", "full-text"=>"22", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"9"}
  • {"unique-ip"=>"8", "full-text"=>"7", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"10"}
  • {"unique-ip"=>"6", "full-text"=>"8", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"11"}
  • {"unique-ip"=>"3", "full-text"=>"4", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2016", "month"=>"12"}
  • {"unique-ip"=>"15", "full-text"=>"7", "pdf"=>"5", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"1"}
  • {"unique-ip"=>"12", "full-text"=>"13", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2017", "month"=>"2"}
  • {"unique-ip"=>"4", "full-text"=>"3", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2017", "month"=>"3"}
  • {"unique-ip"=>"6", "full-text"=>"6", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"4"}
  • {"unique-ip"=>"11", "full-text"=>"9", "pdf"=>"5", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"5"}
  • {"unique-ip"=>"5", "full-text"=>"2", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"6"}
  • {"unique-ip"=>"6", "full-text"=>"7", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"7"}
  • {"unique-ip"=>"3", "full-text"=>"2", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"9"}
  • {"unique-ip"=>"1", "full-text"=>"1", "pdf"=>"1", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"10"}
  • {"unique-ip"=>"7", "full-text"=>"6", "pdf"=>"4", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"11"}
  • {"unique-ip"=>"8", "full-text"=>"7", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"2", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"12"}
  • {"unique-ip"=>"4", "full-text"=>"5", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"1"}
  • {"unique-ip"=>"1", "full-text"=>"1", "pdf"=>"0", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"2"}
  • {"unique-ip"=>"28", "full-text"=>"11", "pdf"=>"7", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"3", "cited-by"=>"1", "year"=>"2018", "month"=>"3"}
  • {"unique-ip"=>"22", "full-text"=>"20", "pdf"=>"11", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2019", "month"=>"1"}
  • {"unique-ip"=>"16", "full-text"=>"14", "pdf"=>"2", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2018", "month"=>"12"}
  • {"unique-ip"=>"17", "full-text"=>"17", "pdf"=>"2", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"4", "cited-by"=>"0", "year"=>"2018", "month"=>"11"}
  • {"unique-ip"=>"19", "full-text"=>"17", "pdf"=>"4", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"9"}
  • {"unique-ip"=>"8", "full-text"=>"7", "pdf"=>"2", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"1", "year"=>"2018", "month"=>"4"}
  • {"unique-ip"=>"11", "full-text"=>"13", "pdf"=>"4", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"5"}
  • {"unique-ip"=>"8", "full-text"=>"7", "pdf"=>"2", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"6"}
  • {"unique-ip"=>"10", "full-text"=>"8", "pdf"=>"2", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"6", "cited-by"=>"0", "year"=>"2018", "month"=>"7"}
  • {"unique-ip"=>"16", "full-text"=>"15", "pdf"=>"3", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"8"}
  • {"unique-ip"=>"19", "full-text"=>"16", "pdf"=>"9", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"1", "cited-by"=>"0", "year"=>"2018", "month"=>"10"}
  • {"unique-ip"=>"24", "full-text"=>"20", "pdf"=>"7", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"2"}
  • {"unique-ip"=>"21", "full-text"=>"20", "pdf"=>"4", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"3"}
  • {"unique-ip"=>"33", "full-text"=>"34", "pdf"=>"5", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"4"}
  • {"unique-ip"=>"23", "full-text"=>"20", "pdf"=>"7", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"5"}
Loading … Spinner
There are currently no alerts